[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:22:26.621393 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:42741
I20260709 12:22:26.623086 11392 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:22:26.624202 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:26.639990 11399 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.641993 11401 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:26.641264 11398 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:27.835332 11400 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:22:27.835659 11392 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:22:27.839555 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:27.839843 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:27.840075 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599747840046 us; error 0 us; skew 500 ppm
I20260709 12:22:27.840957 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:27.847813 11392 webserver.cc:533] Webserver started at http://127.11.32.62:34587/ using document root <none> and password file <none>
I20260709 12:22:27.848783 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:27.849058 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:27.849617 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:27.855820 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "96b43011efe74dc690b12ec18793b4f7"
format_stamp: "Formatted at 2026-07-09 12:22:27 on dist-test-slave-sckv"
I20260709 12:22:27.864357 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:22:27.869910 11407 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:27.871259 11392 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:22:27.871670 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "96b43011efe74dc690b12ec18793b4f7"
format_stamp: "Formatted at 2026-07-09 12:22:27 on dist-test-slave-sckv"
I20260709 12:22:27.872089 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:27.943434 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:27.945082 11392 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:22:27.945618 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.021162 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:42741
I20260709 12:22:28.021253 11458 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:42741 every 8 connection(s)
I20260709 12:22:28.029464 11459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.052145 11459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7: Bootstrap starting.
I20260709 12:22:28.058319 11459 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:28.060242 11459 log.cc:826] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7: Log is configured to *not* fsync() on all Append() calls
I20260709 12:22:28.065053 11459 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7: No bootstrap required, opened a new log
I20260709 12:22:28.085927 11459 raft_consensus.cc:359] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b43011efe74dc690b12ec18793b4f7" member_type: VOTER }
I20260709 12:22:28.086491 11459 raft_consensus.cc:385] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:28.086697 11459 raft_consensus.cc:740] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 96b43011efe74dc690b12ec18793b4f7, State: Initialized, Role: FOLLOWER
I20260709 12:22:28.087556 11459 consensus_queue.cc:260] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b43011efe74dc690b12ec18793b4f7" member_type: VOTER }
I20260709 12:22:28.088048 11459 raft_consensus.cc:399] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:28.088295 11459 raft_consensus.cc:493] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:28.088591 11459 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:28.092864 11459 raft_consensus.cc:515] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b43011efe74dc690b12ec18793b4f7" member_type: VOTER }
I20260709 12:22:28.093705 11459 leader_election.cc:304] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 96b43011efe74dc690b12ec18793b4f7; no voters: 
I20260709 12:22:28.095432 11459 leader_election.cc:290] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:28.095803 11462 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:28.098156 11462 raft_consensus.cc:697] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 1 LEADER]: Becoming Leader. State: Replica: 96b43011efe74dc690b12ec18793b4f7, State: Running, Role: LEADER
I20260709 12:22:28.099196 11462 consensus_queue.cc:237] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b43011efe74dc690b12ec18793b4f7" member_type: VOTER }
I20260709 12:22:28.100270 11459 sys_catalog.cc:565] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:28.112057 11464 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 96b43011efe74dc690b12ec18793b4f7. Latest consensus state: current_term: 1 leader_uuid: "96b43011efe74dc690b12ec18793b4f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b43011efe74dc690b12ec18793b4f7" member_type: VOTER } }
I20260709 12:22:28.112102 11463 sys_catalog.cc:455] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "96b43011efe74dc690b12ec18793b4f7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "96b43011efe74dc690b12ec18793b4f7" member_type: VOTER } }
I20260709 12:22:28.113068 11464 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:28.113112 11463 sys_catalog.cc:458] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:28.120545 11472 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:28.134115 11472 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:28.136572 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:28.152709 11472 catalog_manager.cc:1383] Generated new cluster ID: bbe4b832883f4591b4cff9b46e26b91d
I20260709 12:22:28.152992 11472 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:28.175734 11472 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:28.177867 11472 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:28.195804 11472 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7: Generated new TSK 0
I20260709 12:22:28.196823 11472 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:28.203567 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:28.212327 11481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.214159 11482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.218103 11484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.218887 11392 server_base.cc:1061] running on GCE node
I20260709 12:22:28.219723 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:28.219941 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:28.220155 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599748220135 us; error 0 us; skew 500 ppm
I20260709 12:22:28.220784 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:28.225359 11392 webserver.cc:533] Webserver started at http://127.11.32.1:40647/ using document root <none> and password file <none>
I20260709 12:22:28.225986 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:28.226197 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:28.226504 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:28.227710 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "1d3a219803ca4b708e71d76aec975169"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-sckv"
I20260709 12:22:28.233697 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:22:28.238369 11489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.239403 11392 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.003s
I20260709 12:22:28.239818 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "1d3a219803ca4b708e71d76aec975169"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-sckv"
I20260709 12:22:28.240260 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:28.279072 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:28.280900 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.283803 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:28.289476 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:28.289814 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:22:28.290140 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:28.290375 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.383230 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:37399
I20260709 12:22:28.383420 11551 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:37399 every 8 connection(s)
I20260709 12:22:28.391194 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:28.400355 11556 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.403599 11557 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.409862 11559 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.410310 11392 server_base.cc:1061] running on GCE node
I20260709 12:22:28.411679 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:28.412020 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:28.412273 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599748412253 us; error 0 us; skew 500 ppm
I20260709 12:22:28.413157 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:28.421135 11552 heartbeater.cc:344] Connected to a master server at 127.11.32.62:42741
I20260709 12:22:28.421880 11552 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:28.423502 11552 heartbeater.cc:507] Master 127.11.32.62:42741 requested a full tablet report, sending...
I20260709 12:22:28.426092 11392 webserver.cc:533] Webserver started at http://127.11.32.2:45375/ using document root <none> and password file <none>
I20260709 12:22:28.427012 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:28.427393 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:28.427835 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:28.428304 11424 ts_manager.cc:194] Registered new tserver with Master: 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399)
I20260709 12:22:28.429693 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "548873a7c3ac4adf871cb74234767f99"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-sckv"
I20260709 12:22:28.431689 11424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37348
I20260709 12:22:28.437736 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:22:28.443975 11564 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.445065 11392 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:22:28.445443 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "548873a7c3ac4adf871cb74234767f99"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-sckv"
I20260709 12:22:28.445781 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:28.465778 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:28.467623 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.470450 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:28.473625 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:28.473853 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.474120 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:28.474295 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.569125 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:45087
I20260709 12:22:28.569377 11626 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:45087 every 8 connection(s)
I20260709 12:22:28.576138 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:28.585296 11630 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.591470 11627 heartbeater.cc:344] Connected to a master server at 127.11.32.62:42741
I20260709 12:22:28.593235 11627 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:28.594535 11627 heartbeater.cc:507] Master 127.11.32.62:42741 requested a full tablet report, sending...
W20260709 12:22:28.593250 11631 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:28.596633 11633 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:28.596967 11424 ts_manager.cc:194] Registered new tserver with Master: 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:28.598362 11424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37350
I20260709 12:22:28.601059 11392 server_base.cc:1061] running on GCE node
I20260709 12:22:28.602007 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:28.602265 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:28.602461 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599748602441 us; error 0 us; skew 500 ppm
I20260709 12:22:28.603017 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:28.605636 11392 webserver.cc:533] Webserver started at http://127.11.32.3:41469/ using document root <none> and password file <none>
I20260709 12:22:28.606130 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:28.606351 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:28.606628 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:28.607755 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "64ff38ca6bdc4065a7417acbc241824c"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-sckv"
I20260709 12:22:28.612886 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:22:28.616408 11638 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.617270 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:22:28.617609 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "64ff38ca6bdc4065a7417acbc241824c"
format_stamp: "Formatted at 2026-07-09 12:22:28 on dist-test-slave-sckv"
I20260709 12:22:28.617981 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:28.638732 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:28.640057 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:28.641525 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:28.644508 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:28.644743 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.644987 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:28.645162 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:28.737659 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:40283
I20260709 12:22:28.737787 11700 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:40283 every 8 connection(s)
I20260709 12:22:28.754377 11701 heartbeater.cc:344] Connected to a master server at 127.11.32.62:42741
I20260709 12:22:28.754774 11701 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:28.755551 11701 heartbeater.cc:507] Master 127.11.32.62:42741 requested a full tablet report, sending...
I20260709 12:22:28.757591 11424 ts_manager.cc:194] Registered new tserver with Master: 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:28.758050 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015996682s
I20260709 12:22:28.758973 11424 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:37352
I20260709 12:22:28.814323 11424 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:37360:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:28.818279 11424 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:28.928752 11666 tablet_service.cc:1511] Processing CreateTablet for tablet e3a106b8133b403c9bf018314ffc2efa (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:28.933017 11665 tablet_service.cc:1511] Processing CreateTablet for tablet c6a7ad18e0b24a4a9858b0d433c6e908 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:28.932265 11664 tablet_service.cc:1511] Processing CreateTablet for tablet 14b83a8436774f8ba98d318ad112f103 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:28.936892 11665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a7ad18e0b24a4a9858b0d433c6e908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.933861 11663 tablet_service.cc:1511] Processing CreateTablet for tablet 61216f18721f4d5c8b3bafbb92da8b10 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:28.938900 11664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b83a8436774f8ba98d318ad112f103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.943245 11663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61216f18721f4d5c8b3bafbb92da8b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.942247 11662 tablet_service.cc:1511] Processing CreateTablet for tablet bbac668d555142ba867757f2060e8d32 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:28.944159 11666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106b8133b403c9bf018314ffc2efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.948084 11662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbac668d555142ba867757f2060e8d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.959630 11592 tablet_service.cc:1511] Processing CreateTablet for tablet e3a106b8133b403c9bf018314ffc2efa (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:28.961391 11592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106b8133b403c9bf018314ffc2efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.964144 11591 tablet_service.cc:1511] Processing CreateTablet for tablet c6a7ad18e0b24a4a9858b0d433c6e908 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:28.969005 11590 tablet_service.cc:1511] Processing CreateTablet for tablet 14b83a8436774f8ba98d318ad112f103 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:28.971060 11591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a7ad18e0b24a4a9858b0d433c6e908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:28.972656 11590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b83a8436774f8ba98d318ad112f103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.007318 11589 tablet_service.cc:1511] Processing CreateTablet for tablet 61216f18721f4d5c8b3bafbb92da8b10 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:29.008880 11589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61216f18721f4d5c8b3bafbb92da8b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.010102 11517 tablet_service.cc:1511] Processing CreateTablet for tablet e3a106b8133b403c9bf018314ffc2efa (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:29.011523 11517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3a106b8133b403c9bf018314ffc2efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.014725 11516 tablet_service.cc:1511] Processing CreateTablet for tablet c6a7ad18e0b24a4a9858b0d433c6e908 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:29.016088 11516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a7ad18e0b24a4a9858b0d433c6e908. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.018759 11719 tablet_bootstrap.cc:492] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.010066 11512 tablet_service.cc:1511] Processing CreateTablet for tablet 501d13e6899d4f879b1d4e07a985b21e (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:29.022297 11588 tablet_service.cc:1511] Processing CreateTablet for tablet bbac668d555142ba867757f2060e8d32 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:29.022439 11514 tablet_service.cc:1511] Processing CreateTablet for tablet 61216f18721f4d5c8b3bafbb92da8b10 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:29.018790 11515 tablet_service.cc:1511] Processing CreateTablet for tablet 14b83a8436774f8ba98d318ad112f103 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:29.029012 11512 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501d13e6899d4f879b1d4e07a985b21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.026930 11513 tablet_service.cc:1511] Processing CreateTablet for tablet bbac668d555142ba867757f2060e8d32 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:29.030109 11588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbac668d555142ba867757f2060e8d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.034934 11514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61216f18721f4d5c8b3bafbb92da8b10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.039820 11587 tablet_service.cc:1511] Processing CreateTablet for tablet 501d13e6899d4f879b1d4e07a985b21e (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:29.039923 11511 tablet_service.cc:1511] Processing CreateTablet for tablet c98b840c096a42abaeac652ea30b0b0d (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:29.052531 11587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501d13e6899d4f879b1d4e07a985b21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.048454 11515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 14b83a8436774f8ba98d318ad112f103. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.047956 11586 tablet_service.cc:1511] Processing CreateTablet for tablet c98b840c096a42abaeac652ea30b0b0d (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:29.069031 11513 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bbac668d555142ba867757f2060e8d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.049986 11662 tablet_service.cc:1511] Processing CreateTablet for tablet 501d13e6899d4f879b1d4e07a985b21e (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:29.065521 11666 tablet_service.cc:1511] Processing CreateTablet for tablet c98b840c096a42abaeac652ea30b0b0d (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:29.071561 11586 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b840c096a42abaeac652ea30b0b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.075555 11665 tablet_service.cc:1511] Processing CreateTablet for tablet d907483bc3c14a97bbcd20f76852e42b (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:29.077819 11661 tablet_service.cc:1511] Processing CreateTablet for tablet 9e545c9f9fb747e9a3067b9d8690f951 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:29.085690 11510 tablet_service.cc:1511] Processing CreateTablet for tablet 9e545c9f9fb747e9a3067b9d8690f951 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:29.065696 11585 tablet_service.cc:1511] Processing CreateTablet for tablet 9e545c9f9fb747e9a3067b9d8690f951 (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:29.087749 11584 tablet_service.cc:1511] Processing CreateTablet for tablet d907483bc3c14a97bbcd20f76852e42b (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:29.087389 11511 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b840c096a42abaeac652ea30b0b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.095904 11509 tablet_service.cc:1511] Processing CreateTablet for tablet d907483bc3c14a97bbcd20f76852e42b (DEFAULT_TABLE table=test-workload [id=0a34d91f38c141dab2cf2b33481789d4]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:29.100319 11666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c98b840c096a42abaeac652ea30b0b0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.102615 11584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d907483bc3c14a97bbcd20f76852e42b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.111773 11585 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e545c9f9fb747e9a3067b9d8690f951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.112385 11665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d907483bc3c14a97bbcd20f76852e42b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:29.129233 11471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:29.136086 11509 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d907483bc3c14a97bbcd20f76852e42b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.139731 11510 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e545c9f9fb747e9a3067b9d8690f951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.151610 11662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 501d13e6899d4f879b1d4e07a985b21e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.166873 11661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e545c9f9fb747e9a3067b9d8690f951. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:29.180298 11720 tablet_bootstrap.cc:492] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.191234 11719 tablet_bootstrap.cc:654] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.237071 11721 tablet_bootstrap.cc:492] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.255416 11719 tablet_bootstrap.cc:492] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.255932 11719 ts_tablet_manager.cc:1403] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.238s	user 0.015s	sys 0.010s
I20260709 12:22:29.260102 11719 raft_consensus.cc:359] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.260870 11719 raft_consensus.cc:385] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.261186 11719 raft_consensus.cc:740] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.262260 11719 consensus_queue.cc:260] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.279189 11720 tablet_bootstrap.cc:654] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.284375 11719 ts_tablet_manager.cc:1434] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.028s	user 0.015s	sys 0.011s
I20260709 12:22:29.285585 11701 heartbeater.cc:499] Master 127.11.32.62:42741 was elected leader, sending a full tablet report...
I20260709 12:22:29.286015 11719 tablet_bootstrap.cc:492] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.286624 11721 tablet_bootstrap.cc:654] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.290050 11720 tablet_bootstrap.cc:492] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.290505 11720 ts_tablet_manager.cc:1403] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.125s	user 0.007s	sys 0.010s
I20260709 12:22:29.293609 11720 raft_consensus.cc:359] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.294363 11720 raft_consensus.cc:385] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.294668 11720 raft_consensus.cc:740] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.294694 11719 tablet_bootstrap.cc:654] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.295511 11720 consensus_queue.cc:260] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.304381 11721 tablet_bootstrap.cc:492] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.304891 11721 ts_tablet_manager.cc:1403] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.100s	user 0.020s	sys 0.004s
I20260709 12:22:29.307883 11720 ts_tablet_manager.cc:1434] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.007s
I20260709 12:22:29.308132 11719 tablet_bootstrap.cc:492] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.308544 11719 ts_tablet_manager.cc:1403] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.003s
I20260709 12:22:29.308668 11627 heartbeater.cc:499] Master 127.11.32.62:42741 was elected leader, sending a full tablet report...
I20260709 12:22:29.308755 11721 raft_consensus.cc:359] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.309587 11721 raft_consensus.cc:385] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.309964 11721 raft_consensus.cc:740] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.310854 11721 consensus_queue.cc:260] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.311488 11719 raft_consensus.cc:359] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.312644 11720 tablet_bootstrap.cc:492] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.312739 11719 raft_consensus.cc:385] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.313098 11719 raft_consensus.cc:740] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.313864 11719 consensus_queue.cc:260] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.316208 11719 ts_tablet_manager.cc:1434] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:29.317137 11719 tablet_bootstrap.cc:492] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.319689 11720 tablet_bootstrap.cc:654] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.324182 11719 tablet_bootstrap.cc:654] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:29.325425 11628 tablet.cc:2406] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:29.347383 11721 ts_tablet_manager.cc:1434] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.042s	user 0.012s	sys 0.029s
I20260709 12:22:29.351702 11552 heartbeater.cc:499] Master 127.11.32.62:42741 was elected leader, sending a full tablet report...
I20260709 12:22:29.355960 11720 tablet_bootstrap.cc:492] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.356619 11720 ts_tablet_manager.cc:1403] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.044s	user 0.016s	sys 0.020s
I20260709 12:22:29.359550 11721 tablet_bootstrap.cc:492] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.360538 11720 raft_consensus.cc:359] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.361549 11720 raft_consensus.cc:385] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.361924 11720 raft_consensus.cc:740] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.362890 11720 consensus_queue.cc:260] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.365211 11720 ts_tablet_manager.cc:1434] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.001s
I20260709 12:22:29.366248 11720 tablet_bootstrap.cc:492] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.366429 11719 tablet_bootstrap.cc:492] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.366886 11719 ts_tablet_manager.cc:1403] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.050s	user 0.034s	sys 0.012s
I20260709 12:22:29.369869 11719 raft_consensus.cc:359] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.370658 11719 raft_consensus.cc:385] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.370995 11719 raft_consensus.cc:740] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.371799 11719 consensus_queue.cc:260] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.373062 11720 tablet_bootstrap.cc:654] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.374245 11719 ts_tablet_manager.cc:1434] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:22:29.375245 11719 tablet_bootstrap.cc:492] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.377708 11721 tablet_bootstrap.cc:654] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.382664 11719 tablet_bootstrap.cc:654] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.395530 11719 tablet_bootstrap.cc:492] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.396005 11719 ts_tablet_manager.cc:1403] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.009s
I20260709 12:22:29.397437 11721 tablet_bootstrap.cc:492] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.397904 11721 ts_tablet_manager.cc:1403] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.017s
I20260709 12:22:29.399004 11719 raft_consensus.cc:359] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.399624 11720 tablet_bootstrap.cc:492] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.399731 11719 raft_consensus.cc:385] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.400187 11719 raft_consensus.cc:740] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.400339 11720 ts_tablet_manager.cc:1403] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.000s
I20260709 12:22:29.400729 11721 raft_consensus.cc:359] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.401010 11719 consensus_queue.cc:260] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.401471 11721 raft_consensus.cc:385] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.402145 11721 raft_consensus.cc:740] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.402902 11721 consensus_queue.cc:260] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.403805 11719 ts_tablet_manager.cc:1434] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260709 12:22:29.404742 11719 tablet_bootstrap.cc:492] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.405252 11721 ts_tablet_manager.cc:1434] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:29.406136 11721 tablet_bootstrap.cc:492] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.411314 11726 raft_consensus.cc:493] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.411859 11726 raft_consensus.cc:515] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.412704 11721 tablet_bootstrap.cc:654] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.419514 11726 leader_election.cc:290] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.420122 11726 raft_consensus.cc:493] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.420641 11726 raft_consensus.cc:515] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.423266 11719 tablet_bootstrap.cc:654] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.424235 11726 leader_election.cc:290] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.436810 11719 tablet_bootstrap.cc:492] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.437493 11719 ts_tablet_manager.cc:1403] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.003s
I20260709 12:22:29.440567 11719 raft_consensus.cc:359] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.441267 11719 raft_consensus.cc:385] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.441638 11719 raft_consensus.cc:740] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.442396 11719 consensus_queue.cc:260] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.444851 11719 ts_tablet_manager.cc:1434] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:22:29.447741 11719 tablet_bootstrap.cc:492] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.450667 11720 raft_consensus.cc:359] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.451411 11720 raft_consensus.cc:385] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.451710 11720 raft_consensus.cc:740] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.452392 11720 consensus_queue.cc:260] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.456573 11719 tablet_bootstrap.cc:654] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.456852 11720 ts_tablet_manager.cc:1434] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 12:22:29.462008 11720 tablet_bootstrap.cc:492] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.474777 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:29.475433 11721 tablet_bootstrap.cc:492] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.475553 11719 tablet_bootstrap.cc:492] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.475975 11721 ts_tablet_manager.cc:1403] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.070s	user 0.005s	sys 0.018s
I20260709 12:22:29.478438 11721 raft_consensus.cc:359] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.479164 11721 raft_consensus.cc:385] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.479476 11721 raft_consensus.cc:740] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.480242 11721 consensus_queue.cc:260] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.475980 11719 ts_tablet_manager.cc:1403] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.001s
I20260709 12:22:29.482487 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
W20260709 12:22:29.482796 11567 leader_election.cc:343] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.483196 11527 raft_consensus.cc:2468] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 0.
I20260709 12:22:29.484411 11720 tablet_bootstrap.cc:654] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.484292 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:29.484449 11719 raft_consensus.cc:359] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.485028 11676 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 0.
I20260709 12:22:29.485255 11719 raft_consensus.cc:385] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.485579 11719 raft_consensus.cc:740] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.486362 11719 consensus_queue.cc:260] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.487084 11567 leader_election.cc:304] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:29.487003 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:29.488013 11721 ts_tablet_manager.cc:1434] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:22:29.488160 11734 raft_consensus.cc:2804] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.488687 11734 raft_consensus.cc:493] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.489110 11721 tablet_bootstrap.cc:492] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.489029 11734 raft_consensus.cc:3060] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.496464 11734 raft_consensus.cc:515] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.497761 11567 leader_election.cc:304] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:29.498601 11726 raft_consensus.cc:2804] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.498965 11726 raft_consensus.cc:493] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:22:29.499039 11567 leader_election.cc:343] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.499383 11726 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.515911 11719 ts_tablet_manager.cc:1434] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:22:29.517073 11719 tablet_bootstrap.cc:492] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.519097 11726 raft_consensus.cc:515] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.521445 11734 leader_election.cc:290] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.522927 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:29.523584 11721 tablet_bootstrap.cc:654] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.523553 11527 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.524730 11719 tablet_bootstrap.cc:654] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.532708 11527 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:29.535101 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:29.538708 11526 raft_consensus.cc:3060] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.539192 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:29.539853 11675 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.544701 11720 tablet_bootstrap.cc:492] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.545230 11720 ts_tablet_manager.cc:1403] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.084s	user 0.008s	sys 0.021s
I20260709 12:22:29.521546 11726 leader_election.cc:290] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.536770 11719 tablet_bootstrap.cc:492] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.537250 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:29.548173 11719 ts_tablet_manager.cc:1403] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.009s
I20260709 12:22:29.548700 11720 raft_consensus.cc:359] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.547310 11675 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:29.549511 11720 raft_consensus.cc:385] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.549834 11720 raft_consensus.cc:740] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.550549 11720 consensus_queue.cc:260] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.551205 11719 raft_consensus.cc:359] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.551918 11719 raft_consensus.cc:385] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.552206 11719 raft_consensus.cc:740] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.552785 11720 ts_tablet_manager.cc:1434] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:22:29.553674 11526 raft_consensus.cc:2468] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:29.552807 11567 leader_election.cc:304] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
W20260709 12:22:29.555962 11567 leader_election.cc:343] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.557732 11567 leader_election.cc:304] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:29.558827 11734 raft_consensus.cc:2804] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.561264 11734 raft_consensus.cc:697] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:29.561873 11720 tablet_bootstrap.cc:492] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.561828 11744 raft_consensus.cc:2804] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.562193 11734 consensus_queue.cc:237] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.553057 11719 consensus_queue.cc:260] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.567417 11719 ts_tablet_manager.cc:1434] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 12:22:29.570190 11721 tablet_bootstrap.cc:492] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.570779 11721 ts_tablet_manager.cc:1403] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.020s
I20260709 12:22:29.571105 11744 raft_consensus.cc:697] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:29.572607 11719 tablet_bootstrap.cc:492] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.572603 11744 consensus_queue.cc:237] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.576187 11720 tablet_bootstrap.cc:654] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.581619 11723 raft_consensus.cc:493] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.582162 11723 raft_consensus.cc:515] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.584194 11721 raft_consensus.cc:359] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.584933 11721 raft_consensus.cc:385] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.585237 11721 raft_consensus.cc:740] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.586349 11723 leader_election.cc:290] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:29.594533 11719 tablet_bootstrap.cc:654] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.591033 11721 consensus_queue.cc:260] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.599460 11721 ts_tablet_manager.cc:1434] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.028s	user 0.010s	sys 0.000s
I20260709 12:22:29.601058 11721 tablet_bootstrap.cc:492] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.617661 11723 raft_consensus.cc:493] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.618233 11723 raft_consensus.cc:515] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.622211 11723 leader_election.cc:290] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:29.623446 11721 tablet_bootstrap.cc:654] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.625763 11734 raft_consensus.cc:493] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.626308 11734 raft_consensus.cc:515] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.629117 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:29.629768 11526 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 0.
I20260709 12:22:29.631112 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:29.631961 11675 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 0.
I20260709 12:22:29.633322 11567 leader_election.cc:304] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:29.634639 11745 raft_consensus.cc:2804] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.635048 11745 raft_consensus.cc:493] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.635383 11745 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.637310 11424 catalog_manager.cc:5697] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.639422 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:29.639662 11424 catalog_manager.cc:5697] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.640640 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:29.641239 11526 raft_consensus.cc:2468] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 0.
I20260709 12:22:29.642341 11721 tablet_bootstrap.cc:492] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.642794 11721 ts_tablet_manager.cc:1403] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.000s
I20260709 12:22:29.642985 11720 tablet_bootstrap.cc:492] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.643520 11720 ts_tablet_manager.cc:1403] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.082s	user 0.010s	sys 0.004s
W20260709 12:22:29.645283 11641 leader_election.cc:343] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.646296 11641 leader_election.cc:304] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:29.647770 11723 raft_consensus.cc:2804] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.648356 11723 raft_consensus.cc:493] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.648741 11723 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.629792 11734 leader_election.cc:290] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.650919 11721 raft_consensus.cc:359] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.651692 11721 raft_consensus.cc:385] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.651417 11745 raft_consensus.cc:515] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.649174 11720 raft_consensus.cc:359] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.653105 11720 raft_consensus.cc:385] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.653467 11720 raft_consensus.cc:740] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.655998 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:29.656734 11526 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.657430 11723 raft_consensus.cc:515] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.660153 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:29.660689 11527 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.663522 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:29.664234 11675 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.664067 11720 consensus_queue.cc:260] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.652009 11721 raft_consensus.cc:740] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.667564 11720 ts_tablet_manager.cc:1434] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:22:29.669845 11720 tablet_bootstrap.cc:492] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.671854 11719 tablet_bootstrap.cc:492] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.672446 11719 ts_tablet_manager.cc:1403] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.100s	user 0.008s	sys 0.008s
I20260709 12:22:29.666224 11745 leader_election.cc:290] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.673983 11721 consensus_queue.cc:260] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.676599 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:29.677928 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:29.683105 11601 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 0.
I20260709 12:22:29.684850 11719 raft_consensus.cc:359] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.685585 11719 raft_consensus.cc:385] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.685915 11719 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.686630 11719 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
W20260709 12:22:29.689391 11640 leader_election.cc:343] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.690714 11640 leader_election.cc:304] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:29.692427 11527 raft_consensus.cc:2468] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 1.
I20260709 12:22:29.693619 11641 leader_election.cc:304] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:29.698864 11720 tablet_bootstrap.cc:654] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.695434 11723 leader_election.cc:290] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:29.709223 11721 ts_tablet_manager.cc:1434] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.003s
I20260709 12:22:29.708542 11723 raft_consensus.cc:2804] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.712888 11723 raft_consensus.cc:493] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.713239 11723 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.714140 11526 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:29.714462 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:29.715246 11567 leader_election.cc:304] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:29.716068 11745 raft_consensus.cc:2804] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.716539 11745 raft_consensus.cc:697] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:29.712595 11721 tablet_bootstrap.cc:492] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.717344 11745 consensus_queue.cc:237] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
W20260709 12:22:29.724304 11640 leader_election.cc:343] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.726589 11719 ts_tablet_manager.cc:1434] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.054s	user 0.000s	sys 0.013s
I20260709 12:22:29.728535 11719 tablet_bootstrap.cc:492] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c: Bootstrap starting.
I20260709 12:22:29.731222 11675 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:29.735773 11756 raft_consensus.cc:2804] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.736505 11756 raft_consensus.cc:697] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
W20260709 12:22:29.742937 11641 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:37399, user_credentials={real_user=slave}} blocked reactor thread for 49219.4us
I20260709 12:22:29.738456 11756 consensus_queue.cc:237] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.748912 11757 raft_consensus.cc:493] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.749423 11757 raft_consensus.cc:515] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.751494 11755 raft_consensus.cc:493] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.754124 11755 raft_consensus.cc:515] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.754972 11721 tablet_bootstrap.cc:654] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.758308 11723 raft_consensus.cc:515] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.773250 11719 tablet_bootstrap.cc:654] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.759936 11720 tablet_bootstrap.cc:492] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.775713 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:29.773728 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:29.786144 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
W20260709 12:22:29.787137 11641 leader_election.cc:343] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.759831 11755 leader_election.cc:290] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
W20260709 12:22:29.787948 11641 leader_election.cc:343] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.787038 11602 raft_consensus.cc:2468] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 0.
I20260709 12:22:29.758072 11757 leader_election.cc:290] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:29.769336 11728 raft_consensus.cc:493] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:29.790093 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:29.791733 11720 ts_tablet_manager.cc:1403] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.122s	user 0.023s	sys 0.024s
W20260709 12:22:29.793921 11640 leader_election.cc:343] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.795346 11640 leader_election.cc:304] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 64ff38ca6bdc4065a7417acbc241824c; no voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:29.800101 11640 leader_election.cc:304] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:29.802366 11757 raft_consensus.cc:2804] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.790722 11728 raft_consensus.cc:515] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.802757 11757 raft_consensus.cc:493] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.800571 11723 leader_election.cc:290] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:29.804075 11757 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.806514 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:29.801116 11756 raft_consensus.cc:2749] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:29.810139 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:29.810937 11601 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.811146 11720 raft_consensus.cc:359] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
W20260709 12:22:29.812460 11641 leader_election.cc:343] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.813530 11720 raft_consensus.cc:385] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.815928 11720 raft_consensus.cc:740] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.812367 11421 catalog_manager.cc:5697] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 0 to 1, leader changed from <none> to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 1 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.827521 11757 raft_consensus.cc:515] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.825753 11728 leader_election.cc:290] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.834554 11602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:29.837265 11602 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.825583 11720 consensus_queue.cc:260] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:29.845086 11721 tablet_bootstrap.cc:492] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.833990 11757 leader_election.cc:290] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:29.860705 11721 ts_tablet_manager.cc:1403] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.148s	user 0.021s	sys 0.029s
I20260709 12:22:29.861881 11719 tablet_bootstrap.cc:492] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c: No bootstrap required, opened a new log
I20260709 12:22:29.862488 11719 ts_tablet_manager.cc:1403] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.007s
I20260709 12:22:29.864657 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:29.866770 11719 raft_consensus.cc:359] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.867449 11719 raft_consensus.cc:385] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.866662 11602 raft_consensus.cc:2468] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 1.
I20260709 12:22:29.867776 11719 raft_consensus.cc:740] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.868259 11720 ts_tablet_manager.cc:1434] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.075s	user 0.015s	sys 0.006s
I20260709 12:22:29.868515 11719 consensus_queue.cc:260] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.871003 11719 ts_tablet_manager.cc:1434] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:29.870865 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:29.871627 11720 tablet_bootstrap.cc:492] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.873802 11640 leader_election.cc:304] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:29.874662 11757 raft_consensus.cc:2804] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:22:29.875080 11491 leader_election.cc:343] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.874835 11721 raft_consensus.cc:359] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.869361 11601 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 1.
I20260709 12:22:29.875635 11721 raft_consensus.cc:385] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.875993 11721 raft_consensus.cc:740] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.877041 11640 leader_election.cc:304] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 1d3a219803ca4b708e71d76aec975169
W20260709 12:22:29.877974 11641 leader_election.cc:343] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.878235 11756 raft_consensus.cc:2804] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.878800 11756 raft_consensus.cc:697] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:29.875187 11757 raft_consensus.cc:697] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:29.879689 11756 consensus_queue.cc:237] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.880846 11757 consensus_queue.cc:237] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.882069 11720 tablet_bootstrap.cc:654] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.886201 11721 consensus_queue.cc:260] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.887750 11424 catalog_manager.cc:5697] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.889457 11721 ts_tablet_manager.cc:1434] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.002s
I20260709 12:22:29.890540 11721 tablet_bootstrap.cc:492] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.897099 11721 tablet_bootstrap.cc:654] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.905754 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:29.906492 11675 raft_consensus.cc:2468] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 0.
I20260709 12:22:29.908088 11492 leader_election.cc:304] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:29.909121 11728 raft_consensus.cc:2804] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:29.909546 11728 raft_consensus.cc:493] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:29.909927 11728 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:29.917264 11728 raft_consensus.cc:515] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.919456 11728 leader_election.cc:290] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:29.920250 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:29.920696 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:29.921276 11675 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:29.921697 11491 leader_election.cc:343] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:29.922025 11720 tablet_bootstrap.cc:492] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.922410 11720 ts_tablet_manager.cc:1403] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.000s
I20260709 12:22:29.924196 11424 catalog_manager.cc:5697] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 0 to 1, leader changed from <none> to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 1 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.925161 11720 raft_consensus.cc:359] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.926429 11720 raft_consensus.cc:385] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.926793 11720 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.926486 11424 catalog_manager.cc:5697] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 0 to 1, leader changed from <none> to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 1 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:29.927835 11675 raft_consensus.cc:2468] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 1.
I20260709 12:22:29.929065 11492 leader_election.cc:304] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:29.930795 11721 tablet_bootstrap.cc:492] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.931277 11721 ts_tablet_manager.cc:1403] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.003s
I20260709 12:22:29.933841 11721 raft_consensus.cc:359] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.934345 11721 raft_consensus.cc:385] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.934522 11721 raft_consensus.cc:740] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.935086 11721 consensus_queue.cc:260] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.936343 11728 raft_consensus.cc:2804] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:29.927512 11720 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.938585 11720 ts_tablet_manager.cc:1434] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260709 12:22:29.940179 11721 ts_tablet_manager.cc:1434] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:29.941180 11721 tablet_bootstrap.cc:492] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.943423 11720 tablet_bootstrap.cc:492] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.948942 11728 raft_consensus.cc:697] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:29.949966 11728 consensus_queue.cc:237] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.954959 11721 tablet_bootstrap.cc:654] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.950529 11720 tablet_bootstrap.cc:654] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.959789 11424 catalog_manager.cc:5697] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:29.962937 11721 tablet_bootstrap.cc:492] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:29.963533 11721 ts_tablet_manager.cc:1403] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.000s
I20260709 12:22:29.967519 11721 raft_consensus.cc:359] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.968223 11721 raft_consensus.cc:385] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.968608 11721 raft_consensus.cc:740] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.969902 11720 tablet_bootstrap.cc:492] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.969677 11721 consensus_queue.cc:260] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.970317 11720 ts_tablet_manager.cc:1403] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:22:29.971627 11721 ts_tablet_manager.cc:1434] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:29.972448 11721 tablet_bootstrap.cc:492] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169: Bootstrap starting.
I20260709 12:22:29.972787 11720 raft_consensus.cc:359] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.973438 11720 raft_consensus.cc:385] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:29.973767 11720 raft_consensus.cc:740] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:29.974447 11720 consensus_queue.cc:260] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:29.976971 11720 ts_tablet_manager.cc:1434] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:22:29.978332 11720 tablet_bootstrap.cc:492] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: Bootstrap starting.
I20260709 12:22:29.979597 11721 tablet_bootstrap.cc:654] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.984203 11720 tablet_bootstrap.cc:654] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:29.985023 11745 consensus_queue.cc:1048] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:29.996099 11720 tablet_bootstrap.cc:492] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: No bootstrap required, opened a new log
I20260709 12:22:29.996760 11720 ts_tablet_manager.cc:1403] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.006s
I20260709 12:22:29.999504 11720 raft_consensus.cc:359] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.000197 11720 raft_consensus.cc:385] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.000481 11720 raft_consensus.cc:740] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.001155 11720 consensus_queue.cc:260] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.007189 11745 consensus_queue.cc:1048] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.014039 11757 raft_consensus.cc:493] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.014578 11721 tablet_bootstrap.cc:492] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169: No bootstrap required, opened a new log
I20260709 12:22:30.015027 11721 ts_tablet_manager.cc:1403] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169: Time spent bootstrapping tablet: real 0.043s	user 0.020s	sys 0.017s
I20260709 12:22:30.014700 11757 raft_consensus.cc:515] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.018522 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:30.018390 11721 raft_consensus.cc:359] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.019044 11721 raft_consensus.cc:385] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:30.019116 11601 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 0.
I20260709 12:22:30.018921 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:30.019464 11721 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Initialized, Role: FOLLOWER
I20260709 12:22:30.017379 11757 leader_election.cc:290] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:30.020596 11640 leader_election.cc:304] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:30.020311 11721 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.021421 11526 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 0.
I20260709 12:22:30.023169 11721 ts_tablet_manager.cc:1434] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:30.024355 11720 ts_tablet_manager.cc:1434] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:22:30.025241 11757 raft_consensus.cc:2804] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.025705 11757 raft_consensus.cc:493] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.026136 11757 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.032859 11757 raft_consensus.cc:515] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.044127 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:30.044332 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:30.044585 11757 leader_election.cc:290] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:30.044765 11526 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.044940 11601 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.046046 11675 raft_consensus.cc:3060] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.050670 11726 consensus_queue.cc:1048] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.051684 11526 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 1.
I20260709 12:22:30.052865 11641 leader_election.cc:304] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:30.053613 11601 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 1.
I20260709 12:22:30.053805 11757 raft_consensus.cc:2804] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.054658 11757 raft_consensus.cc:697] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:30.055543 11757 consensus_queue.cc:237] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.061462 11726 consensus_queue.cc:1048] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:30.075446 11421 catalog_manager.cc:5697] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 0 to 1, leader changed from <none> to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 1 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.090631 11726 raft_consensus.cc:493] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.091122 11726 raft_consensus.cc:515] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:30.093050 11726 leader_election.cc:290] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283), 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399)
I20260709 12:22:30.094174 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:30.094410 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:30.095160 11526 raft_consensus.cc:2393] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 548873a7c3ac4adf871cb74234767f99 in current term 1: Already voted for candidate 64ff38ca6bdc4065a7417acbc241824c in this term.
I20260709 12:22:30.096076 11567 leader_election.cc:304] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99; no voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:30.096729 11726 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.103252 11726 raft_consensus.cc:2749] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:22:30.138751 11471 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:30.144893 11726 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.158768 11744 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.162139 11744 raft_consensus.cc:493] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.162603 11744 raft_consensus.cc:515] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.166756 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:30.167649 11527 raft_consensus.cc:2468] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 0.
I20260709 12:22:30.165154 11744 leader_election.cc:290] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.170222 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:30.170836 11675 raft_consensus.cc:2468] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 0.
I20260709 12:22:30.170603 11567 leader_election.cc:304] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:30.172148 11744 raft_consensus.cc:2804] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:30.172580 11744 raft_consensus.cc:493] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:30.172972 11744 raft_consensus.cc:3060] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.179605 11744 raft_consensus.cc:515] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.181813 11744 leader_election.cc:290] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.182451 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:30.182940 11526 raft_consensus.cc:3060] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.187124 11526 raft_consensus.cc:2468] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:30.188181 11567 leader_election.cc:304] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:30.188678 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.189038 11744 raft_consensus.cc:2804] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:30.189260 11675 raft_consensus.cc:3060] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.189565 11744 raft_consensus.cc:697] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.190397 11744 consensus_queue.cc:237] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.196390 11675 raft_consensus.cc:2468] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 1.
I20260709 12:22:30.198455 11421 catalog_manager.cc:5697] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 0 to 1, leader changed from <none> to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.271421 11728 raft_consensus.cc:493] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.271989 11728 raft_consensus.cc:515] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.274289 11728 leader_election.cc:290] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.275002 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:30.275898 11601 raft_consensus.cc:2393] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d3a219803ca4b708e71d76aec975169 in current term 1: Already voted for candidate 64ff38ca6bdc4065a7417acbc241824c in this term.
I20260709 12:22:30.275890 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:30.277642 11492 leader_election.cc:304] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169; no voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:30.278575 11728 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.285588 11728 raft_consensus.cc:2749] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.294358 11744 raft_consensus.cc:493] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.294838 11744 raft_consensus.cc:515] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.296970 11675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:59116
I20260709 12:22:30.297772 11675 raft_consensus.cc:606] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:30.298410 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1d3a219803ca4b708e71d76aec975169" is_pre_election: true
I20260709 12:22:30.299425 11757 consensus_queue.cc:1048] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.301441 11744 leader_election.cc:290] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.302182 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:30.302906 11675 raft_consensus.cc:2393] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 548873a7c3ac4adf871cb74234767f99 in current term 1: Already voted for candidate 1d3a219803ca4b708e71d76aec975169 in this term.
I20260709 12:22:30.304155 11567 leader_election.cc:304] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99; no voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:30.306392 11744 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.311424 11757 raft_consensus.cc:993] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.311875 11757 raft_consensus.cc:1081] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.312987 11756 consensus_queue.cc:1048] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.313918 11526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40580
I20260709 12:22:30.322080 11744 raft_consensus.cc:2749] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.324445 11526 raft_consensus.cc:493] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.324882 11526 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.327797 11602 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:22:30.328397 11602 raft_consensus.cc:606] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:30.332211 11728 consensus_queue.cc:1048] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.335484 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:22:30.336125 11601 raft_consensus.cc:606] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:30.340943 11526 raft_consensus.cc:515] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:30.343340 11675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:59116
I20260709 12:22:30.343948 11675 raft_consensus.cc:606] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:30.352708 11676 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbac668d555142ba867757f2060e8d32"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:59116
I20260709 12:22:30.353329 11676 raft_consensus.cc:606] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:30.353725 11772 consensus_queue.cc:1048] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.360495 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:30.361095 11601 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.363292 11772 raft_consensus.cc:493] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:30.363772 11772 raft_consensus.cc:515] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.366717 11600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "548873a7c3ac4adf871cb74234767f99" is_pre_election: true
I20260709 12:22:30.367518 11600 raft_consensus.cc:2393] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1d3a219803ca4b708e71d76aec975169 in current term 1: Already voted for candidate 64ff38ca6bdc4065a7417acbc241824c in this term.
I20260709 12:22:30.368417 11601 raft_consensus.cc:2468] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.368911 11526 leader_election.cc:290] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Requested vote from peers 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:30.370229 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.370838 11675 raft_consensus.cc:3055] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.371223 11675 raft_consensus.cc:740] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:30.372208 11675 consensus_queue.cc:260] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:30.374372 11675 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.375921 11491 leader_election.cc:304] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:30.377767 11771 raft_consensus.cc:2804] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.378397 11771 raft_consensus.cc:697] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:30.379479 11771 consensus_queue.cc:237] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:30.384091 11772 leader_election.cc:290] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.386459 11674 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "64ff38ca6bdc4065a7417acbc241824c" is_pre_election: true
I20260709 12:22:30.389190 11757 consensus_queue.cc:1048] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.390789 11492 leader_election.cc:304] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169; no voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:30.392334 11772 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:30.397152 11526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:40594
I20260709 12:22:30.398025 11526 raft_consensus.cc:606] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:30.400381 11675 raft_consensus.cc:2468] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.403993 11772 raft_consensus.cc:2749] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:30.407593 11423 catalog_manager.cc:5697] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 1 to 2, leader changed from 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.406347 11675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:59116
I20260709 12:22:30.409507 11675 raft_consensus.cc:606] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:30.415942 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:37064
I20260709 12:22:30.416565 11601 raft_consensus.cc:606] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Received request to transfer leadership to TS 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:30.423132 11723 raft_consensus.cc:993] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:30.423694 11723 raft_consensus.cc:1081] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:30.426026 11601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbac668d555142ba867757f2060e8d32"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37044
I20260709 12:22:30.426611 11601 raft_consensus.cc:493] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.426996 11601 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.432075 11756 consensus_queue.cc:1048] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.439003 11601 raft_consensus.cc:515] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.442431 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:30.448029 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.449738 11676 raft_consensus.cc:3055] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.452037 11676 raft_consensus.cc:740] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:30.452859 11676 consensus_queue.cc:260] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.453884 11676 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.458741 11601 leader_election.cc:290] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 2 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.464145 11676 raft_consensus.cc:2468] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 2.
I20260709 12:22:30.465382 11567 leader_election.cc:304] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:30.466502 11745 raft_consensus.cc:2804] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.467038 11745 raft_consensus.cc:697] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.467892 11745 consensus_queue.cc:237] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.472222 11756 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.477066 11421 catalog_manager.cc:5697] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 1 to 2, leader changed from 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.486766 11757 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.499090 11757 raft_consensus.cc:993] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.499532 11756 raft_consensus.cc:1081] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.501521 11526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40580
I20260709 12:22:30.502846 11526 raft_consensus.cc:493] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.503257 11526 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.508908 11726 raft_consensus.cc:993] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.509440 11745 raft_consensus.cc:1081] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.511125 11527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:30.511258 11526 raft_consensus.cc:515] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.511931 11527 raft_consensus.cc:493] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.512354 11527 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.514618 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.515200 11676 raft_consensus.cc:3055] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.515578 11676 raft_consensus.cc:740] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:30.516214 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:30.519996 11601 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.517088 11526 leader_election.cc:290] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.516336 11676 consensus_queue.cc:260] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.521162 11676 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.521855 11756 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.527499 11601 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.528218 11676 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.530526 11491 leader_election.cc:304] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:30.531575 11772 raft_consensus.cc:2804] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.532060 11772 raft_consensus.cc:697] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:30.532454 11756 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.532902 11772 consensus_queue.cc:237] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.533176 11527 raft_consensus.cc:515] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.542622 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:30.543426 11601 raft_consensus.cc:3055] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.542822 11424 catalog_manager.cc:5697] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 1 to 2, leader changed from 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.543774 11601 raft_consensus.cc:740] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.544816 11601 consensus_queue.cc:260] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.545997 11601 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.548159 11527 leader_election.cc:290] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.549718 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.550496 11676 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.555354 11757 raft_consensus.cc:993] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:30.555791 11757 raft_consensus.cc:1081] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:30.558290 11599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37044
I20260709 12:22:30.559751 11599 raft_consensus.cc:493] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.560117 11599 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.565951 11601 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.567276 11491 leader_election.cc:304] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:30.568475 11772 raft_consensus.cc:2804] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.568930 11772 raft_consensus.cc:697] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:30.568737 11599 raft_consensus.cc:515] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.569794 11772 consensus_queue.cc:237] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.570477 11676 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.572710 11599 leader_election.cc:290] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 2 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.574266 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.574863 11676 raft_consensus.cc:3055] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.575191 11676 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:30.575911 11745 consensus_queue.cc:1048] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.575999 11676 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.577203 11676 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.577947 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:30.579622 11526 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.584137 11676 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 2.
I20260709 12:22:30.585507 11567 leader_election.cc:304] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:30.586457 11726 raft_consensus.cc:2804] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.594125 11526 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 2.
I20260709 12:22:30.598644 11726 raft_consensus.cc:697] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.599586 11726 consensus_queue.cc:237] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.599924 11744 consensus_queue.cc:1048] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:30.602389 11424 catalog_manager.cc:5697] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 1 to 2, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.608433 11726 raft_consensus.cc:993] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:30.608903 11726 raft_consensus.cc:1081] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Signalling peer 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:30.610565 11675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:59104
I20260709 12:22:30.610975 11675 raft_consensus.cc:493] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.611254 11675 raft_consensus.cc:3060] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.616887 11675 raft_consensus.cc:515] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.617447 11421 catalog_manager.cc:5697] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 1 to 2, leader changed from 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.620239 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:30.620318 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d907483bc3c14a97bbcd20f76852e42b" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:30.620864 11599 raft_consensus.cc:3055] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.621088 11526 raft_consensus.cc:3060] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.621224 11599 raft_consensus.cc:740] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.621685 11675 leader_election.cc:290] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 2 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:30.622187 11599 consensus_queue.cc:260] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.623266 11599 raft_consensus.cc:3060] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.631616 11599 raft_consensus.cc:2468] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 2.
I20260709 12:22:30.631767 11526 raft_consensus.cc:2468] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 2.
I20260709 12:22:30.633199 11641 leader_election.cc:304] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:30.634122 11756 raft_consensus.cc:2804] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.634591 11756 raft_consensus.cc:697] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 2 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:30.635380 11756 consensus_queue.cc:237] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.643957 11421 catalog_manager.cc:5697] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 1 to 2, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 2 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:30.730700 11772 raft_consensus.cc:993] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:30.731182 11771 raft_consensus.cc:1081] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:30.732837 11599 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37048
I20260709 12:22:30.733357 11599 raft_consensus.cc:493] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.733719 11599 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.738236 11599 raft_consensus.cc:515] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.739820 11599 leader_election.cc:290] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 2 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.740859 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:30.741127 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.741603 11526 raft_consensus.cc:3055] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.741663 11675 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.742012 11526 raft_consensus.cc:740] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:30.743074 11526 consensus_queue.cc:260] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.744436 11526 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.746081 11803 raft_consensus.cc:993] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.746505 11726 raft_consensus.cc:1081] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:30.748489 11527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:30.749028 11527 raft_consensus.cc:493] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:30.749363 11527 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.750344 11675 raft_consensus.cc:2468] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 2.
I20260709 12:22:30.751713 11526 raft_consensus.cc:2468] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 2.
I20260709 12:22:30.752817 11567 leader_election.cc:304] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:30.754016 11803 raft_consensus.cc:2804] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.754470 11803 raft_consensus.cc:697] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.755291 11803 consensus_queue.cc:237] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.756258 11527 raft_consensus.cc:515] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.759560 11527 leader_election.cc:290] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:30.759804 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:30.760424 11599 raft_consensus.cc:3055] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:30.760759 11599 raft_consensus.cc:740] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:30.761072 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:30.761701 11675 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.761560 11599 consensus_queue.cc:260] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.762826 11599 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.768836 11675 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.768744 11421 catalog_manager.cc:5697] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 1 to 2, leader changed from 1d3a219803ca4b708e71d76aec975169 (127.11.32.1) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.770365 11492 leader_election.cc:304] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:30.770443 11599 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:30.771229 11771 raft_consensus.cc:2804] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:30.771713 11771 raft_consensus.cc:697] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:30.772527 11771 consensus_queue.cc:237] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:30.780684 11421 catalog_manager.cc:5697] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 1 to 2, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:30.868729 11675 raft_consensus.cc:1275] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:30.870079 11803 consensus_queue.cc:1048] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:30.877542 11527 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:30.888751 11527 raft_consensus.cc:1275] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:30.890137 11803 consensus_queue.cc:1048] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:30.963225 11675 raft_consensus.cc:1275] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:30.964579 11771 consensus_queue.cc:1048] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:30.967521 11599 raft_consensus.cc:1275] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:30.969102 11772 consensus_queue.cc:1048] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:30.986303 11599 raft_consensus.cc:1275] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:30.987818 11771 consensus_queue.cc:1048] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:30.992173 11675 raft_consensus.cc:1275] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:30.993970 11771 consensus_queue.cc:1048] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.044812 11527 raft_consensus.cc:1275] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.046245 11756 consensus_queue.cc:1048] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.053447 11599 raft_consensus.cc:1275] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.054031 11601 raft_consensus.cc:1275] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.055158 11805 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.056217 11756 consensus_queue.cc:1048] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.063395 11676 raft_consensus.cc:1275] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.065655 11805 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.196463 11527 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.197810 11526 raft_consensus.cc:1275] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.198030 11803 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:31.200060 11803 consensus_queue.cc:1048] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:31.202314 11676 raft_consensus.cc:1275] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.204041 11803 consensus_queue.cc:1048] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.216827 11676 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.220045 11745 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.305737 11676 raft_consensus.cc:1275] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.307068 11805 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:31.316888 11599 raft_consensus.cc:1275] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:31.318574 11772 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:33.447105 11392 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:22:33.447889 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:33.464123 11526 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
mode: GRACEFUL
new_leader_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:40602
I20260709 12:22:33.464665 11526 raft_consensus.cc:606] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Received request to transfer leadership to TS 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:33.475354 11599 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:22:33.475888 11599 raft_consensus.cc:606] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Received request to transfer leadership to TS 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:33.476980 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:33.477388 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:33.843061 11771 raft_consensus.cc:993] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: : Instructing follower 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:33.843559 11813 raft_consensus.cc:1081] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Signalling peer 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:33.845084 11676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:59108
I20260709 12:22:33.845686 11676 raft_consensus.cc:493] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.845992 11676 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.850500 11676 raft_consensus.cc:515] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:33.852200 11676 leader_election.cc:290] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 3 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:33.853024 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:33.853247 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:33.853544 11526 raft_consensus.cc:3055] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.853863 11599 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.853899 11526 raft_consensus.cc:740] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:33.854681 11526 consensus_queue.cc:260] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:33.855549 11526 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.858534 11599 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 3.
I20260709 12:22:33.859616 11640 leader_election.cc:304] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:33.860198 11526 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 3.
I20260709 12:22:33.860455 11809 raft_consensus.cc:2804] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.861732 11809 raft_consensus.cc:697] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:33.862408 11809 consensus_queue.cc:237] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:33.870427 11421 catalog_manager.cc:5697] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 2 to 3, leader changed from 1d3a219803ca4b708e71d76aec975169 (127.11.32.1) to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 3 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:33.891534 11820 raft_consensus.cc:993] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:33.892066 11745 raft_consensus.cc:1081] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Signalling peer 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:33.893774 11676 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:59104
I20260709 12:22:33.894335 11676 raft_consensus.cc:493] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:33.894644 11676 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.899878 11676 raft_consensus.cc:515] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:33.901927 11676 leader_election.cc:290] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 3 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:33.902941 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:33.903191 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:33.903654 11526 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.903867 11599 raft_consensus.cc:3055] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:33.904284 11599 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:33.905158 11599 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:33.906514 11599 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:33.910718 11526 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 3.
I20260709 12:22:33.912066 11641 leader_election.cc:304] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:33.912947 11809 raft_consensus.cc:2804] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:33.913447 11809 raft_consensus.cc:697] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:33.914184 11809 consensus_queue.cc:237] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:33.914553 11599 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 3.
I20260709 12:22:33.922130 11421 catalog_manager.cc:5697] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 2 to 3, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 3 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:34.333974 11526 raft_consensus.cc:1275] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.335142 11809 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.345208 11599 raft_consensus.cc:1275] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.346777 11809 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.351271 11601 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.352674 11809 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.361697 11526 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:34.363291 11814 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:34.478446 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:34.484650 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:34.485225 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:35.486218 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:35.491135 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:35.491516 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:36.492343 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:36.497138 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:36.497566 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:37.498657 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:37.503619 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:37.503990 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:38.504849 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:38.509974 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:38.510310 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:39.511133 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:39.515914 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:39.516258 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:40.517273 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:40.522567 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:40.522938 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:41.523725 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:41.528527 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:41.528887 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:42.529754 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:42.535148 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:42.535913 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:43.564602 11392 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:43.568987 11527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:40594
I20260709 12:22:43.569661 11527 raft_consensus.cc:606] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:43.573954 11527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:40594
I20260709 12:22:43.574376 11527 raft_consensus.cc:606] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:43.578788 11675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:59116
I20260709 12:22:43.579208 11675 raft_consensus.cc:606] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:43.583432 11527 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:40594
I20260709 12:22:43.583847 11527 raft_consensus.cc:606] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:43.595147 11675 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
mode: GRACEFUL
new_leader_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:59116
I20260709 12:22:43.595618 11675 raft_consensus.cc:606] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Received request to transfer leadership to TS 548873a7c3ac4adf871cb74234767f99
I20260709 12:22:43.603137 11813 raft_consensus.cc:993] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.603615 11838 raft_consensus.cc:1081] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.605052 11601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37048
I20260709 12:22:43.605536 11601 raft_consensus.cc:493] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.605870 11601 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.610886 11601 raft_consensus.cc:515] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.612816 11601 leader_election.cc:290] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 3 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:43.613564 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:43.613818 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a7ad18e0b24a4a9858b0d433c6e908" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:43.614226 11527 raft_consensus.cc:3055] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:43.614297 11675 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.614537 11527 raft_consensus.cc:740] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:43.615219 11527 consensus_queue.cc:260] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.616063 11527 raft_consensus.cc:3060] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.618593 11675 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 3.
I20260709 12:22:43.619726 11567 leader_election.cc:304] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:43.620529 11837 raft_consensus.cc:2804] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:43.620736 11527 raft_consensus.cc:2468] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 3.
I20260709 12:22:43.621546 11837 raft_consensus.cc:697] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:43.622503 11837 consensus_queue.cc:237] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.634176 11421 catalog_manager.cc:5697] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 2 to 3, leader changed from 1d3a219803ca4b708e71d76aec975169 (127.11.32.1) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 3 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.686932 11846 raft_consensus.cc:993] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.687435 11831 raft_consensus.cc:1081] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.688822 11601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37044
I20260709 12:22:43.689263 11601 raft_consensus.cc:493] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.689558 11601 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.693454 11601 raft_consensus.cc:515] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.694761 11601 leader_election.cc:290] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 4 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:43.695545 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:43.695729 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "14b83a8436774f8ba98d318ad112f103" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:43.696094 11527 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.696200 11675 raft_consensus.cc:3055] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:43.696504 11675 raft_consensus.cc:740] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:43.697121 11675 consensus_queue.cc:260] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.697961 11675 raft_consensus.cc:3060] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.700074 11527 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 4.
I20260709 12:22:43.700922 11567 leader_election.cc:304] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:43.701706 11839 raft_consensus.cc:2804] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:43.702044 11675 raft_consensus.cc:2468] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 4.
I20260709 12:22:43.702193 11839 raft_consensus.cc:697] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:43.703122 11839 consensus_queue.cc:237] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.709841 11421 catalog_manager.cc:5697] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 3 to 4, leader changed from 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 4 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.782142 11848 raft_consensus.cc:993] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.782644 11846 raft_consensus.cc:1081] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.784238 11601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37044
I20260709 12:22:43.784682 11601 raft_consensus.cc:493] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.784972 11601 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.788956 11601 raft_consensus.cc:515] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.790405 11601 leader_election.cc:290] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 4 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:43.791184 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:43.791813 11527 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.791796 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:43.792502 11676 raft_consensus.cc:3055] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:43.792829 11676 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:43.793591 11676 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.794430 11676 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:43.796218 11527 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 4.
I20260709 12:22:43.797063 11567 leader_election.cc:304] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:43.797818 11839 raft_consensus.cc:2804] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:43.798233 11839 raft_consensus.cc:697] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:43.799423 11813 raft_consensus.cc:993] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.799057 11839 consensus_queue.cc:237] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.799847 11813 raft_consensus.cc:1081] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:43.800051 11676 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 4.
I20260709 12:22:43.801383 11601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37048
I20260709 12:22:43.801962 11601 raft_consensus.cc:493] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.802342 11601 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.806200 11601 raft_consensus.cc:515] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.806438 11421 catalog_manager.cc:5697] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 3 to 4, leader changed from 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 4 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.807541 11601 leader_election.cc:290] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 3 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:43.808228 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:43.808473 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:43.808815 11527 raft_consensus.cc:3055] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:43.808990 11676 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.809226 11527 raft_consensus.cc:740] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:43.809949 11527 consensus_queue.cc:260] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.811041 11527 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:43.814751 11676 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 3.
I20260709 12:22:43.815676 11567 leader_election.cc:304] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 548873a7c3ac4adf871cb74234767f99, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:43.816283 11839 raft_consensus.cc:2804] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:43.816540 11527 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 3.
I20260709 12:22:43.816773 11839 raft_consensus.cc:697] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:43.817619 11839 consensus_queue.cc:237] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:43.823891 11421 catalog_manager.cc:5697] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 2 to 3, leader changed from 1d3a219803ca4b708e71d76aec975169 (127.11.32.1) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 3 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:44.026309 11813 raft_consensus.cc:993] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: : Instructing follower 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:44.026690 11676 raft_consensus.cc:1275] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:44.026773 11838 raft_consensus.cc:1081] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Signalling peer 548873a7c3ac4adf871cb74234767f99 to start an election
I20260709 12:22:44.028151 11839 consensus_queue.cc:1048] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:44.028798 11601 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
 from {username='slave'} at 127.0.0.1:37048
I20260709 12:22:44.029361 11601 raft_consensus.cc:493] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:44.029723 11601 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.040241 11527 raft_consensus.cc:1275] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:44.042448 11841 consensus_queue.cc:1048] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:44.042639 11601 raft_consensus.cc:515] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:44.045832 11601 leader_election.cc:290] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 3 election: Requested vote from peers 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283), 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399)
I20260709 12:22:44.046998 11526 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:44.047585 11526 raft_consensus.cc:3055] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:44.047901 11526 raft_consensus.cc:740] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:44.048669 11526 consensus_queue.cc:260] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:44.049750 11526 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.051404 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3a106b8133b403c9bf018314ffc2efa" candidate_uuid: "548873a7c3ac4adf871cb74234767f99" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:44.051977 11676 raft_consensus.cc:3060] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:44.057760 11526 raft_consensus.cc:2468] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 3.
I20260709 12:22:44.058964 11676 raft_consensus.cc:2468] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 548873a7c3ac4adf871cb74234767f99 in term 3.
I20260709 12:22:44.059612 11567 leader_election.cc:304] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 548873a7c3ac4adf871cb74234767f99; no voters: 
I20260709 12:22:44.061005 11839 raft_consensus.cc:2804] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:44.061496 11839 raft_consensus.cc:697] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Becoming Leader. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:44.062338 11839 consensus_queue.cc:237] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } }
I20260709 12:22:44.073213 11421 catalog_manager.cc:5697] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 reported cstate change: term changed from 2 to 3, leader changed from 1d3a219803ca4b708e71d76aec975169 (127.11.32.1) to 548873a7c3ac4adf871cb74234767f99 (127.11.32.2). New cstate: current_term: 3 leader_uuid: "548873a7c3ac4adf871cb74234767f99" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:44.172986 11676 raft_consensus.cc:1275] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:44.174376 11839 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:44.183595 11527 raft_consensus.cc:1275] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:44.184873 11858 consensus_queue.cc:1048] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:44.243628 11527 raft_consensus.cc:1275] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:44.244720 11839 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:44.256402 11676 raft_consensus.cc:1275] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:44.260414 11837 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:44.291929 11676 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:44.293051 11841 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:44.300778 11527 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:44.302551 11839 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:44.474728 11676 raft_consensus.cc:1275] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:44.475873 11839 consensus_queue.cc:1048] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:44.484635 11527 raft_consensus.cc:1275] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Refusing update from remote peer 548873a7c3ac4adf871cb74234767f99: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:44.485925 11865 consensus_queue.cc:1048] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.624040 11392 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:46.624737 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.631140 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:22:46.631578 11601 raft_consensus.cc:606] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:46.633834 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:22:46.634268 11601 raft_consensus.cc:606] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Received request to transfer leadership to TS 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:46.636439 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:22:46.636855 11601 raft_consensus.cc:606] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Received request to transfer leadership to TS 64ff38ca6bdc4065a7417acbc241824c
I20260709 12:22:46.638767 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bbac668d555142ba867757f2060e8d32"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:22:46.639158 11601 raft_consensus.cc:606] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:46.641067 11601 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d"
dest_uuid: "548873a7c3ac4adf871cb74234767f99"
mode: GRACEFUL
new_leader_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:37076
I20260709 12:22:46.641475 11601 raft_consensus.cc:606] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Received request to transfer leadership to TS 1d3a219803ca4b708e71d76aec975169
I20260709 12:22:46.642453 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:46.642894 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:46.697793 11839 raft_consensus.cc:993] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:46.698844 11867 raft_consensus.cc:1081] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:46.700924 11527 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:46.701753 11527 raft_consensus.cc:493] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.702073 11527 raft_consensus.cc:3060] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.707018 11527 raft_consensus.cc:515] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.709487 11527 leader_election.cc:290] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:46.711275 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:46.711174 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "501d13e6899d4f879b1d4e07a985b21e" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:46.712004 11601 raft_consensus.cc:3055] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:46.712191 11675 raft_consensus.cc:3060] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.712371 11601 raft_consensus.cc:740] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:46.713249 11601 consensus_queue.cc:260] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.714730 11601 raft_consensus.cc:3060] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:46.721256 11675 raft_consensus.cc:2468] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:46.722626 11492 leader_election.cc:304] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:46.722766 11601 raft_consensus.cc:2468] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 2.
I20260709 12:22:46.722815 11839 raft_consensus.cc:993] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:46.723913 11867 raft_consensus.cc:1081] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Signalling peer 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:46.725059 11870 raft_consensus.cc:2804] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:46.725756 11675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:59104
I20260709 12:22:46.726154 11870 raft_consensus.cc:697] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:46.726318 11675 raft_consensus.cc:493] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.726827 11675 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.727211 11870 consensus_queue.cc:237] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.732115 11675 raft_consensus.cc:515] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.735702 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:46.735939 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "61216f18721f4d5c8b3bafbb92da8b10" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:46.736478 11527 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.736552 11601 raft_consensus.cc:3055] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:46.737006 11601 raft_consensus.cc:740] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:46.737882 11601 consensus_queue.cc:260] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.735267 11675 leader_election.cc:290] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 4 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:46.737809 11423 catalog_manager.cc:5697] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 1 to 2, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.739184 11601 raft_consensus.cc:3060] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:46.743534 11527 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 4.
I20260709 12:22:46.744819 11641 leader_election.cc:304] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:46.744890 11601 raft_consensus.cc:2468] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 4.
I20260709 12:22:46.745769 11848 raft_consensus.cc:2804] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:46.747402 11848 raft_consensus.cc:697] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 4 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:46.748502 11848 consensus_queue.cc:237] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.759511 11421 catalog_manager.cc:5697] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 3 to 4, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 4 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.925436 11839 raft_consensus.cc:993] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:46.925951 11867 raft_consensus.cc:1081] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Signalling peer 64ff38ca6bdc4065a7417acbc241824c to start an election
I20260709 12:22:46.927349 11675 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951"
dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
 from {username='slave'} at 127.0.0.1:59104
I20260709 12:22:46.927752 11675 raft_consensus.cc:493] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.927973 11675 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.932098 11675 raft_consensus.cc:515] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.933506 11675 leader_election.cc:290] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 5 election: Requested vote from peers 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399), 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087)
I20260709 12:22:46.934396 11527 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1d3a219803ca4b708e71d76aec975169"
I20260709 12:22:46.934501 11601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e545c9f9fb747e9a3067b9d8690f951" candidate_uuid: "64ff38ca6bdc4065a7417acbc241824c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:46.935001 11527 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.935043 11601 raft_consensus.cc:3055] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:46.935405 11601 raft_consensus.cc:740] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:46.936071 11601 consensus_queue.cc:260] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.936951 11601 raft_consensus.cc:3060] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:46.939911 11839 raft_consensus.cc:993] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:46.940399 11867 raft_consensus.cc:1081] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:46.940969 11527 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 5.
I20260709 12:22:46.941931 11641 leader_election.cc:304] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:46.942198 11526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:46.942516 11601 raft_consensus.cc:2468] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 64ff38ca6bdc4065a7417acbc241824c in term 5.
I20260709 12:22:46.942698 11526 raft_consensus.cc:493] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:46.942755 11848 raft_consensus.cc:2804] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:46.943130 11526 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.943368 11848 raft_consensus.cc:697] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 5 LEADER]: Becoming Leader. State: Replica: 64ff38ca6bdc4065a7417acbc241824c, State: Running, Role: LEADER
I20260709 12:22:46.944283 11848 consensus_queue.cc:237] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.948554 11526 raft_consensus.cc:515] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.951076 11526 leader_election.cc:290] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 3 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:46.951485 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:46.952059 11599 raft_consensus.cc:3055] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:46.952386 11599 raft_consensus.cc:740] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:46.952616 11675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c98b840c096a42abaeac652ea30b0b0d" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:46.953146 11675 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.952718 11421 catalog_manager.cc:5697] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c reported cstate change: term changed from 4 to 5, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3). New cstate: current_term: 5 leader_uuid: "64ff38ca6bdc4065a7417acbc241824c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:46.953123 11599 consensus_queue.cc:260] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.954371 11599 raft_consensus.cc:3060] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:46.958563 11675 raft_consensus.cc:2468] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 3.
I20260709 12:22:46.959633 11599 raft_consensus.cc:2468] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 3.
I20260709 12:22:46.959793 11492 leader_election.cc:304] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:46.960631 11870 raft_consensus.cc:2804] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:46.961107 11870 raft_consensus.cc:697] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 3 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:46.961999 11870 consensus_queue.cc:237] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:46.968829 11421 catalog_manager.cc:5697] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 2 to 3, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.162789 11526 raft_consensus.cc:1275] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:47.163965 11848 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:47.175467 11599 raft_consensus.cc:1275] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:47.177795 11874 consensus_queue.cc:1048] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:47.249953 11675 raft_consensus.cc:1275] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:47.251327 11870 consensus_queue.cc:1048] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:47.252368 11839 raft_consensus.cc:993] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: : Instructing follower 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:47.252853 11867 raft_consensus.cc:1081] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Signalling peer 1d3a219803ca4b708e71d76aec975169 to start an election
I20260709 12:22:47.254249 11526 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bbac668d555142ba867757f2060e8d32"
dest_uuid: "1d3a219803ca4b708e71d76aec975169"
 from {username='slave'} at 127.0.0.1:40578
I20260709 12:22:47.254741 11526 raft_consensus.cc:493] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:47.255054 11526 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.261157 11526 raft_consensus.cc:515] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:47.262070 11599 raft_consensus.cc:1275] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:47.263463 11870 consensus_queue.cc:1048] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:47.263737 11599 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "548873a7c3ac4adf871cb74234767f99"
I20260709 12:22:47.264338 11599 raft_consensus.cc:3055] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:47.264537 11599 raft_consensus.cc:740] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 548873a7c3ac4adf871cb74234767f99, State: Running, Role: LEADER
I20260709 12:22:47.267062 11676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bbac668d555142ba867757f2060e8d32" candidate_uuid: "1d3a219803ca4b708e71d76aec975169" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "64ff38ca6bdc4065a7417acbc241824c"
I20260709 12:22:47.266785 11526 leader_election.cc:290] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 3 election: Requested vote from peers 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087), 64ff38ca6bdc4065a7417acbc241824c (127.11.32.3:40283)
I20260709 12:22:47.267606 11676 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.265177 11599 consensus_queue.cc:260] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:47.269687 11599 raft_consensus.cc:3060] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:47.272673 11676 raft_consensus.cc:2468] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 3.
I20260709 12:22:47.273672 11492 leader_election.cc:304] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1d3a219803ca4b708e71d76aec975169, 64ff38ca6bdc4065a7417acbc241824c; no voters: 
I20260709 12:22:47.274585 11887 raft_consensus.cc:2804] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:47.275691 11887 raft_consensus.cc:697] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 3 LEADER]: Becoming Leader. State: Replica: 1d3a219803ca4b708e71d76aec975169, State: Running, Role: LEADER
I20260709 12:22:47.276906 11887 consensus_queue.cc:237] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } }
I20260709 12:22:47.275550 11599 raft_consensus.cc:2468] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1d3a219803ca4b708e71d76aec975169 in term 3.
I20260709 12:22:47.292480 11423 catalog_manager.cc:5697] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 reported cstate change: term changed from 2 to 3, leader changed from 548873a7c3ac4adf871cb74234767f99 (127.11.32.2) to 1d3a219803ca4b708e71d76aec975169 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "1d3a219803ca4b708e71d76aec975169" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:47.438956 11526 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 5 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:47.440120 11874 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "1d3a219803ca4b708e71d76aec975169" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 37399 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:47.443020 11601 raft_consensus.cc:1275] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 5 FOLLOWER]: Refusing update from remote peer 64ff38ca6bdc4065a7417acbc241824c: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:47.444134 11848 consensus_queue.cc:1048] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:47.452070 11599 raft_consensus.cc:1275] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.454787 11887 consensus_queue.cc:1048] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.472311 11676 raft_consensus.cc:1275] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.473789 11887 consensus_queue.cc:1048] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.644196 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.649247 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:47.649621 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.881691 11676 raft_consensus.cc:1275] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.882699 11887 consensus_queue.cc:1048] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "64ff38ca6bdc4065a7417acbc241824c" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 40283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:47.896687 11601 raft_consensus.cc:1275] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Refusing update from remote peer 1d3a219803ca4b708e71d76aec975169: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:47.898615 11893 consensus_queue.cc:1048] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [LEADER]: Connected to new peer: Peer: permanent_uuid: "548873a7c3ac4adf871cb74234767f99" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 45087 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:48.650607 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.655845 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:48.656224 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:49.657150 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.662063 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:49.662416 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.663424 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.668301 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.668656 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.669587 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.675495 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:51.675973 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.677168 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.682628 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:52.683046 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:53.684037 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.689265 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:53.689723 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:54.690730 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.695508 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.695932 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:55.697000 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:55.703121 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:55.703619 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:56.759248 11392 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:22:56.759992 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
W20260709 12:22:56.772586 11641 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:22:56.778108 11641 consensus_peers.cc:597] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c -> Peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Couldn't send request to peer 1d3a219803ca4b708e71d76aec975169. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.790537 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:56.791512 11392 tablet_replica.cc:333] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.792418 11392 raft_consensus.cc:2243] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.793340 11392 raft_consensus.cc:2272] T 9e545c9f9fb747e9a3067b9d8690f951 P 1d3a219803ca4b708e71d76aec975169 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.795799 11392 tablet_replica.cc:333] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.796366 11392 raft_consensus.cc:2243] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.796907 11392 raft_consensus.cc:2272] T 61216f18721f4d5c8b3bafbb92da8b10 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.798755 11392 tablet_replica.cc:333] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.799335 11392 raft_consensus.cc:2243] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.799846 11392 raft_consensus.cc:2272] T 14b83a8436774f8ba98d318ad112f103 P 1d3a219803ca4b708e71d76aec975169 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.801812 11392 tablet_replica.cc:333] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.802390 11392 raft_consensus.cc:2243] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.802878 11392 raft_consensus.cc:2272] T d907483bc3c14a97bbcd20f76852e42b P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.804592 11392 tablet_replica.cc:333] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.805074 11392 raft_consensus.cc:2243] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.806087 11392 raft_consensus.cc:2272] T c98b840c096a42abaeac652ea30b0b0d P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.808550 11392 tablet_replica.cc:333] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.809065 11392 raft_consensus.cc:2243] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.810200 11392 raft_consensus.cc:2272] T bbac668d555142ba867757f2060e8d32 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:56.810336 11641 consensus_peers.cc:597] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c -> Peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Couldn't send request to peer 1d3a219803ca4b708e71d76aec975169. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.812036 11392 tablet_replica.cc:333] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.812794 11392 raft_consensus.cc:2243] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.813637 11392 raft_consensus.cc:2272] T c6a7ad18e0b24a4a9858b0d433c6e908 P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.816282 11392 tablet_replica.cc:333] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.816704 11392 raft_consensus.cc:2243] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.817157 11392 raft_consensus.cc:2272] T e3a106b8133b403c9bf018314ffc2efa P 1d3a219803ca4b708e71d76aec975169 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.818881 11392 tablet_replica.cc:333] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169: stopping tablet replica
I20260709 12:22:56.819291 11392 raft_consensus.cc:2243] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.820012 11392 raft_consensus.cc:2272] T 501d13e6899d4f879b1d4e07a985b21e P 1d3a219803ca4b708e71d76aec975169 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:22:56.827682 11567 consensus_peers.cc:597] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 -> Peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Couldn't send request to peer 1d3a219803ca4b708e71d76aec975169. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.907776 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
W20260709 12:22:56.927459 11567 consensus_peers.cc:597] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 -> Peer 1d3a219803ca4b708e71d76aec975169 (127.11.32.1:37399): Couldn't send request to peer 1d3a219803ca4b708e71d76aec975169. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:37399: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:56.931522 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
I20260709 12:22:56.961828 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:56.962584 11392 tablet_replica.cc:333] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.963152 11392 raft_consensus.cc:2243] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.963596 11392 raft_consensus.cc:2272] T d907483bc3c14a97bbcd20f76852e42b P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.965624 11392 tablet_replica.cc:333] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.966074 11392 raft_consensus.cc:2243] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.966436 11392 raft_consensus.cc:2272] T c98b840c096a42abaeac652ea30b0b0d P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.967955 11392 tablet_replica.cc:333] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.968387 11392 raft_consensus.cc:2243] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.968772 11392 raft_consensus.cc:2272] T 9e545c9f9fb747e9a3067b9d8690f951 P 548873a7c3ac4adf871cb74234767f99 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.970243 11392 tablet_replica.cc:333] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.970643 11392 raft_consensus.cc:2243] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.971343 11392 raft_consensus.cc:2272] T e3a106b8133b403c9bf018314ffc2efa P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.972929 11392 tablet_replica.cc:333] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.973361 11392 raft_consensus.cc:2243] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.974139 11392 raft_consensus.cc:2272] T c6a7ad18e0b24a4a9858b0d433c6e908 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.975910 11392 tablet_replica.cc:333] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.976330 11392 raft_consensus.cc:2243] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.976693 11392 raft_consensus.cc:2272] T bbac668d555142ba867757f2060e8d32 P 548873a7c3ac4adf871cb74234767f99 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.978379 11392 tablet_replica.cc:333] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.978806 11392 raft_consensus.cc:2243] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:56.979542 11392 raft_consensus.cc:2272] T 14b83a8436774f8ba98d318ad112f103 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.981009 11392 tablet_replica.cc:333] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.981398 11392 raft_consensus.cc:2243] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.981855 11392 raft_consensus.cc:2272] T 61216f18721f4d5c8b3bafbb92da8b10 P 548873a7c3ac4adf871cb74234767f99 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:56.983235 11392 tablet_replica.cc:333] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99: stopping tablet replica
I20260709 12:22:56.983599 11392 raft_consensus.cc:2243] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:56.983985 11392 raft_consensus.cc:2272] T 501d13e6899d4f879b1d4e07a985b21e P 548873a7c3ac4adf871cb74234767f99 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.011896 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
I20260709 12:22:57.030018 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
I20260709 12:22:57.055728 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:22:57.056602 11392 tablet_replica.cc:333] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.057315 11392 raft_consensus.cc:2243] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.057884 11392 raft_consensus.cc:2272] T 501d13e6899d4f879b1d4e07a985b21e P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.059926 11392 tablet_replica.cc:333] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
W20260709 12:22:57.060046 11640 consensus_peers.cc:597] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c -> Peer 548873a7c3ac4adf871cb74234767f99 (127.11.32.2:45087): Couldn't send request to peer 548873a7c3ac4adf871cb74234767f99. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:45087: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:22:57.060513 11392 raft_consensus.cc:2243] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:22:57.061400 11392 raft_consensus.cc:2272] T 9e545c9f9fb747e9a3067b9d8690f951 P 64ff38ca6bdc4065a7417acbc241824c [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.063123 11392 tablet_replica.cc:333] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.063630 11392 raft_consensus.cc:2243] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.064108 11392 raft_consensus.cc:2272] T c98b840c096a42abaeac652ea30b0b0d P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.065685 11392 tablet_replica.cc:333] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.066169 11392 raft_consensus.cc:2243] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:22:57.066874 11392 raft_consensus.cc:2272] T d907483bc3c14a97bbcd20f76852e42b P 64ff38ca6bdc4065a7417acbc241824c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.068363 11392 tablet_replica.cc:333] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.068827 11392 raft_consensus.cc:2243] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.069254 11392 raft_consensus.cc:2272] T 14b83a8436774f8ba98d318ad112f103 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.070770 11392 tablet_replica.cc:333] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.071235 11392 raft_consensus.cc:2243] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:22:57.071957 11392 raft_consensus.cc:2272] T 61216f18721f4d5c8b3bafbb92da8b10 P 64ff38ca6bdc4065a7417acbc241824c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.073581 11392 tablet_replica.cc:333] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.074033 11392 raft_consensus.cc:2243] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.074499 11392 raft_consensus.cc:2272] T bbac668d555142ba867757f2060e8d32 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.076097 11392 tablet_replica.cc:333] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.076540 11392 raft_consensus.cc:2243] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.076925 11392 raft_consensus.cc:2272] T c6a7ad18e0b24a4a9858b0d433c6e908 P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.078522 11392 tablet_replica.cc:333] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c: stopping tablet replica
I20260709 12:22:57.078954 11392 raft_consensus.cc:2243] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:22:57.079396 11392 raft_consensus.cc:2272] T e3a106b8133b403c9bf018314ffc2efa P 64ff38ca6bdc4065a7417acbc241824c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.106508 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
I20260709 12:22:57.124397 11392 master.cc:562] Master@127.11.32.62:42741 shutting down...
I20260709 12:22:57.327761 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:22:57.328482 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:22:57.328881 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 96b43011efe74dc690b12ec18793b4f7: stopping tablet replica
I20260709 12:22:57.349327 11392 master.cc:584] Master@127.11.32.62:42741 shutdown complete.
1d3a219803ca4b708e71d76aec975169  4
548873a7c3ac4adf871cb74234767f99  4
64ff38ca6bdc4065a7417acbc241824c  1
1d3a219803ca4b708e71d76aec975169  3
548873a7c3ac4adf871cb74234767f99  3
64ff38ca6bdc4065a7417acbc241824c  3
1d3a219803ca4b708e71d76aec975169  0
548873a7c3ac4adf871cb74234767f99  8
64ff38ca6bdc4065a7417acbc241824c  1
1d3a219803ca4b708e71d76aec975169  3
548873a7c3ac4adf871cb74234767f99  3
64ff38ca6bdc4065a7417acbc241824c  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (30774 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:22:57.392439 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:36425
I20260709 12:22:57.393626 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:57.399396 11916 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.399436 11915 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.401258 11918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.401487 11392 server_base.cc:1061] running on GCE node
I20260709 12:22:57.402673 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:57.402856 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:57.402971 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599777402955 us; error 0 us; skew 500 ppm
I20260709 12:22:57.403405 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:57.406158 11392 webserver.cc:533] Webserver started at http://127.11.32.62:34927/ using document root <none> and password file <none>
I20260709 12:22:57.406709 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:57.406906 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:57.407161 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:57.408751 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "3a7d5794662a4ed6b482d14b942ba6f8"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.413525 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.007s	sys 0.000s
I20260709 12:22:57.416730 11923 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.417552 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.002s
I20260709 12:22:57.417817 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "3a7d5794662a4ed6b482d14b942ba6f8"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.418061 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:57.432802 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:57.434088 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:57.471586 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:36425
I20260709 12:22:57.471683 11974 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:36425 every 8 connection(s)
I20260709 12:22:57.475417 11975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:57.484784 11975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8: Bootstrap starting.
I20260709 12:22:57.489323 11975 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:57.493633 11975 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8: No bootstrap required, opened a new log
I20260709 12:22:57.496367 11975 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" member_type: VOTER }
I20260709 12:22:57.496951 11975 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:57.497224 11975 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a7d5794662a4ed6b482d14b942ba6f8, State: Initialized, Role: FOLLOWER
I20260709 12:22:57.497855 11975 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" member_type: VOTER }
I20260709 12:22:57.498340 11975 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:57.498561 11975 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:57.498864 11975 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:57.502990 11975 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" member_type: VOTER }
I20260709 12:22:57.503580 11975 leader_election.cc:304] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a7d5794662a4ed6b482d14b942ba6f8; no voters: 
I20260709 12:22:57.504804 11975 leader_election.cc:290] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:57.505311 11978 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:57.506898 11978 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 1 LEADER]: Becoming Leader. State: Replica: 3a7d5794662a4ed6b482d14b942ba6f8, State: Running, Role: LEADER
I20260709 12:22:57.507817 11975 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:57.507690 11978 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" member_type: VOTER }
I20260709 12:22:57.513116 11979 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" member_type: VOTER } }
I20260709 12:22:57.513303 11980 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a7d5794662a4ed6b482d14b942ba6f8. Latest consensus state: current_term: 1 leader_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a7d5794662a4ed6b482d14b942ba6f8" member_type: VOTER } }
I20260709 12:22:57.513991 11979 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:57.514133 11980 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:57.519197 11986 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:57.525034 11986 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:57.526335 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:57.533711 11986 catalog_manager.cc:1383] Generated new cluster ID: 82220da89dd94240a5dee44a703b2e1e
I20260709 12:22:57.534052 11986 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:57.556584 11986 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:57.557909 11986 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:57.568701 11986 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8: Generated new TSK 0
I20260709 12:22:57.569311 11986 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:57.592805 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:57.598872 11996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.599887 11997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.602840 11392 server_base.cc:1061] running on GCE node
W20260709 12:22:57.602854 11999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.604048 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:57.604341 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:57.604524 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599777604498 us; error 0 us; skew 500 ppm
I20260709 12:22:57.605037 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:57.607424 11392 webserver.cc:533] Webserver started at http://127.11.32.1:40137/ using document root <none> and password file <none>
I20260709 12:22:57.607923 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:57.608129 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:57.608395 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:57.609570 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "065c054808064c2f8143eac1e1eb6079"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.613979 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:22:57.617112 12004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.618062 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:22:57.618304 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "065c054808064c2f8143eac1e1eb6079"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.618535 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:57.636571 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:57.637853 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:57.639360 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:57.641713 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:57.641902 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.642161 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:57.642380 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.681603 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:45037
I20260709 12:22:57.681713 12066 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:45037 every 8 connection(s)
I20260709 12:22:57.686514 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:57.693593 12071 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.695640 12072 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.698403 11392 server_base.cc:1061] running on GCE node
I20260709 12:22:57.699482 12067 heartbeater.cc:344] Connected to a master server at 127.11.32.62:36425
W20260709 12:22:57.699803 12074 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.699975 12067 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:57.700941 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:22:57.700946 12067 heartbeater.cc:507] Master 127.11.32.62:36425 requested a full tablet report, sending...
W20260709 12:22:57.701323 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:57.701557 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599777701537 us; error 0 us; skew 500 ppm
I20260709 12:22:57.702236 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:57.703572 11940 ts_manager.cc:194] Registered new tserver with Master: 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037)
I20260709 12:22:57.704849 11392 webserver.cc:533] Webserver started at http://127.11.32.2:40245/ using document root <none> and password file <none>
I20260709 12:22:57.705351 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:57.705586 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:57.705684 11940 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54760
I20260709 12:22:57.705876 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:57.707365 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "ff1196b70e374829b6614c678280d4c7"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.712065 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:22:57.715245 12079 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.716068 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:22:57.716363 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "ff1196b70e374829b6614c678280d4c7"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.716657 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:57.729235 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:57.730525 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:57.732308 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:57.734754 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:57.734980 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.735244 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:57.735415 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.776989 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:43119
I20260709 12:22:57.777191 12141 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:43119 every 8 connection(s)
I20260709 12:22:57.781812 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:57.788942 12145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.791514 12146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:57.792717 12148 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:57.794134 11392 server_base.cc:1061] running on GCE node
I20260709 12:22:57.794723 12142 heartbeater.cc:344] Connected to a master server at 127.11.32.62:36425
I20260709 12:22:57.795105 12142 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:57.795161 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:57.795462 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:57.795660 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599777795643 us; error 0 us; skew 500 ppm
I20260709 12:22:57.796028 12142 heartbeater.cc:507] Master 127.11.32.62:36425 requested a full tablet report, sending...
I20260709 12:22:57.796404 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:57.798446 11940 ts_manager.cc:194] Registered new tserver with Master: ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:57.799456 11392 webserver.cc:533] Webserver started at http://127.11.32.3:44101/ using document root <none> and password file <none>
I20260709 12:22:57.800100 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:57.800237 11940 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54772
I20260709 12:22:57.800350 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:57.800755 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:57.802281 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "3667b9430fe64f37856b80152c57d816"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.806840 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:22:57.810185 12153 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.810946 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:22:57.811242 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "3667b9430fe64f37856b80152c57d816"
format_stamp: "Formatted at 2026-07-09 12:22:57 on dist-test-slave-sckv"
I20260709 12:22:57.811489 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:57.832479 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:57.833786 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:57.835254 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:57.837582 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:57.837783 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.838069 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:57.838236 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:57.877668 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:42297
I20260709 12:22:57.877799 12215 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:42297 every 8 connection(s)
I20260709 12:22:57.891326 12216 heartbeater.cc:344] Connected to a master server at 127.11.32.62:36425
I20260709 12:22:57.891655 12216 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:57.892407 12216 heartbeater.cc:507] Master 127.11.32.62:36425 requested a full tablet report, sending...
I20260709 12:22:57.894383 11940 ts_manager.cc:194] Registered new tserver with Master: 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:57.895375 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014370991s
I20260709 12:22:57.895736 11940 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54782
I20260709 12:22:57.921204 11940 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54798:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:57.924063 11940 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:58.000212 12107 tablet_service.cc:1511] Processing CreateTablet for tablet 464a9698c4b04879a0efe521162f3573 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:58.001601 12105 tablet_service.cc:1511] Processing CreateTablet for tablet 96e3816520ad4e7eba6699e4ec2e1fb5 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:58.002630 12106 tablet_service.cc:1511] Processing CreateTablet for tablet 6278199a8b804b76b4e28acfd2647e63 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:58.004258 12107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464a9698c4b04879a0efe521162f3573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.009567 12105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e3816520ad4e7eba6699e4ec2e1fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.012939 12106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6278199a8b804b76b4e28acfd2647e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.014000 12104 tablet_service.cc:1511] Processing CreateTablet for tablet 190254bd2ecd4ede959ca5426be31600 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:58.014505 12103 tablet_service.cc:1511] Processing CreateTablet for tablet 21b175dff767436eabf366cd2f9f577e (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:58.015489 12104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190254bd2ecd4ede959ca5426be31600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.016114 12103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b175dff767436eabf366cd2f9f577e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.028973 12102 tablet_service.cc:1511] Processing CreateTablet for tablet b4bb496f155b4032b16f7f3da5fc9dd5 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:58.030382 12102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bb496f155b4032b16f7f3da5fc9dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.035816 12101 tablet_service.cc:1511] Processing CreateTablet for tablet 02ef01b8776b4d97a767df659f01cdb1 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:58.037148 12101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ef01b8776b4d97a767df659f01cdb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.041337 12175 tablet_service.cc:1511] Processing CreateTablet for tablet 02ef01b8776b4d97a767df659f01cdb1 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:58.042698 12180 tablet_service.cc:1511] Processing CreateTablet for tablet 6278199a8b804b76b4e28acfd2647e63 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:58.043210 12175 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ef01b8776b4d97a767df659f01cdb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.044232 12180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6278199a8b804b76b4e28acfd2647e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.044584 12032 tablet_service.cc:1511] Processing CreateTablet for tablet 464a9698c4b04879a0efe521162f3573 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:58.046121 12032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464a9698c4b04879a0efe521162f3573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.045876 12100 tablet_service.cc:1511] Processing CreateTablet for tablet 255b0a0f74454c46b86dbee4a7aae1ff (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:58.046453 12179 tablet_service.cc:1511] Processing CreateTablet for tablet 96e3816520ad4e7eba6699e4ec2e1fb5 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:58.047592 12100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255b0a0f74454c46b86dbee4a7aae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.048143 12179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e3816520ad4e7eba6699e4ec2e1fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.041363 12181 tablet_service.cc:1511] Processing CreateTablet for tablet 464a9698c4b04879a0efe521162f3573 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:22:58.050420 12181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 464a9698c4b04879a0efe521162f3573. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.051133 12178 tablet_service.cc:1511] Processing CreateTablet for tablet 190254bd2ecd4ede959ca5426be31600 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:58.051585 12031 tablet_service.cc:1511] Processing CreateTablet for tablet 6278199a8b804b76b4e28acfd2647e63 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:22:58.052587 12178 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190254bd2ecd4ede959ca5426be31600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.052951 12031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6278199a8b804b76b4e28acfd2647e63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.053905 12099 tablet_service.cc:1511] Processing CreateTablet for tablet af236469d1cb44e38f2c48a7a6453bca (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:58.055006 12177 tablet_service.cc:1511] Processing CreateTablet for tablet 21b175dff767436eabf366cd2f9f577e (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:58.055639 12099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af236469d1cb44e38f2c48a7a6453bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.056905 12177 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b175dff767436eabf366cd2f9f577e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.059147 12176 tablet_service.cc:1511] Processing CreateTablet for tablet b4bb496f155b4032b16f7f3da5fc9dd5 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:58.066088 12174 tablet_service.cc:1511] Processing CreateTablet for tablet 255b0a0f74454c46b86dbee4a7aae1ff (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:58.067168 12030 tablet_service.cc:1511] Processing CreateTablet for tablet 96e3816520ad4e7eba6699e4ec2e1fb5 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:22:58.067915 12174 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255b0a0f74454c46b86dbee4a7aae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.068684 12030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96e3816520ad4e7eba6699e4ec2e1fb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.069744 12176 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bb496f155b4032b16f7f3da5fc9dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.070998 12173 tablet_service.cc:1511] Processing CreateTablet for tablet af236469d1cb44e38f2c48a7a6453bca (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:58.075207 12172 tablet_service.cc:1511] Processing CreateTablet for tablet f0d45cfb4a154eb28b9c371c4dff60d8 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:58.078956 12029 tablet_service.cc:1511] Processing CreateTablet for tablet 190254bd2ecd4ede959ca5426be31600 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:22:58.080605 12029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 190254bd2ecd4ede959ca5426be31600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.072746 12173 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af236469d1cb44e38f2c48a7a6453bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.089900 12172 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d45cfb4a154eb28b9c371c4dff60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.111187 12028 tablet_service.cc:1511] Processing CreateTablet for tablet 21b175dff767436eabf366cd2f9f577e (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:22:58.112758 12028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21b175dff767436eabf366cd2f9f577e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.123160 12098 tablet_service.cc:1511] Processing CreateTablet for tablet f0d45cfb4a154eb28b9c371c4dff60d8 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:58.124605 12098 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d45cfb4a154eb28b9c371c4dff60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.127935 12027 tablet_service.cc:1511] Processing CreateTablet for tablet b4bb496f155b4032b16f7f3da5fc9dd5 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:22:58.129642 12027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4bb496f155b4032b16f7f3da5fc9dd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.143834 12026 tablet_service.cc:1511] Processing CreateTablet for tablet 02ef01b8776b4d97a767df659f01cdb1 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:22:58.123160 12231 tablet_bootstrap.cc:492] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.164804 12025 tablet_service.cc:1511] Processing CreateTablet for tablet 255b0a0f74454c46b86dbee4a7aae1ff (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:22:58.165144 12023 tablet_service.cc:1511] Processing CreateTablet for tablet f0d45cfb4a154eb28b9c371c4dff60d8 (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:22:58.166697 12026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02ef01b8776b4d97a767df659f01cdb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.167399 12024 tablet_service.cc:1511] Processing CreateTablet for tablet af236469d1cb44e38f2c48a7a6453bca (DEFAULT_TABLE table=test-workload [id=1c085fbdac3b46e5a3311bce05648f42]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:22:58.168711 12025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 255b0a0f74454c46b86dbee4a7aae1ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.168828 12233 tablet_bootstrap.cc:492] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.174170 12023 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f0d45cfb4a154eb28b9c371c4dff60d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.181798 12024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af236469d1cb44e38f2c48a7a6453bca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:58.231612 12232 tablet_bootstrap.cc:492] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.232496 12231 tablet_bootstrap.cc:654] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.246465 12233 tablet_bootstrap.cc:654] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.248229 12232 tablet_bootstrap.cc:654] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.251675 12231 tablet_bootstrap.cc:492] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.252194 12231 ts_tablet_manager.cc:1403] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.010s
I20260709 12:22:58.255468 12231 raft_consensus.cc:359] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.256274 12231 raft_consensus.cc:385] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.256609 12231 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.257449 12231 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.266348 12142 heartbeater.cc:499] Master 127.11.32.62:36425 was elected leader, sending a full tablet report...
I20260709 12:22:58.266844 12231 ts_tablet_manager.cc:1434] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.014s	user 0.011s	sys 0.004s
I20260709 12:22:58.267819 12231 tablet_bootstrap.cc:492] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.269924 12232 tablet_bootstrap.cc:492] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.270587 12232 ts_tablet_manager.cc:1403] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.039s	user 0.008s	sys 0.006s
I20260709 12:22:58.273507 12232 raft_consensus.cc:359] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.274044 12231 tablet_bootstrap.cc:654] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.274277 12232 raft_consensus.cc:385] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.274626 12232 raft_consensus.cc:740] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.275388 12232 consensus_queue.cc:260] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.281602 12231 tablet_bootstrap.cc:492] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.282119 12231 ts_tablet_manager.cc:1403] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.001s
I20260709 12:22:58.284047 12233 tablet_bootstrap.cc:492] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.284621 12233 ts_tablet_manager.cc:1403] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.012s
I20260709 12:22:58.284781 12231 raft_consensus.cc:359] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.285447 12231 raft_consensus.cc:385] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.285725 12231 raft_consensus.cc:740] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.286391 12231 consensus_queue.cc:260] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.288095 12231 ts_tablet_manager.cc:1434] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:22:58.288882 12231 tablet_bootstrap.cc:492] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.288378 12233 raft_consensus.cc:359] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.289498 12233 raft_consensus.cc:385] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.289871 12233 raft_consensus.cc:740] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.290832 12233 consensus_queue.cc:260] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.294886 12067 heartbeater.cc:499] Master 127.11.32.62:36425 was elected leader, sending a full tablet report...
I20260709 12:22:58.295854 12232 ts_tablet_manager.cc:1434] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.015s
I20260709 12:22:58.296873 12232 tablet_bootstrap.cc:492] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.302731 12216 heartbeater.cc:499] Master 127.11.32.62:36425 was elected leader, sending a full tablet report...
I20260709 12:22:58.303093 12233 ts_tablet_manager.cc:1434] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.008s
I20260709 12:22:58.304091 12232 tablet_bootstrap.cc:654] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.304101 12233 tablet_bootstrap.cc:492] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.310168 12231 tablet_bootstrap.cc:654] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.310983 12233 tablet_bootstrap.cc:654] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.317884 12231 tablet_bootstrap.cc:492] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.318293 12232 tablet_bootstrap.cc:492] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.318498 12231 ts_tablet_manager.cc:1403] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 12:22:58.318754 12232 ts_tablet_manager.cc:1403] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.006s
I20260709 12:22:58.321691 12232 raft_consensus.cc:359] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.321879 12231 raft_consensus.cc:359] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.322499 12232 raft_consensus.cc:385] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.322597 12231 raft_consensus.cc:385] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.322888 12232 raft_consensus.cc:740] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.322925 12231 raft_consensus.cc:740] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.323899 12231 consensus_queue.cc:260] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.323784 12232 consensus_queue.cc:260] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.326169 12231 ts_tablet_manager.cc:1434] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:58.326368 12232 ts_tablet_manager.cc:1434] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:22:58.326195 12238 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.327203 12231 tablet_bootstrap.cc:492] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.326860 12238 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.329366 12233 tablet_bootstrap.cc:492] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.329787 12238 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.327224 12232 tablet_bootstrap.cc:492] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.329909 12233 ts_tablet_manager.cc:1403] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.003s
I20260709 12:22:58.338431 12232 tablet_bootstrap.cc:654] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.339152 12231 tablet_bootstrap.cc:654] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.340955 12233 raft_consensus.cc:359] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.341744 12233 raft_consensus.cc:385] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.342046 12233 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.349618 12233 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.351913 12233 ts_tablet_manager.cc:1434] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:22:58.352924 12233 tablet_bootstrap.cc:492] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.353291 12232 tablet_bootstrap.cc:492] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.353871 12232 ts_tablet_manager.cc:1403] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.007s
I20260709 12:22:58.356705 12232 raft_consensus.cc:359] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.357702 12232 raft_consensus.cc:385] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.358104 12232 raft_consensus.cc:740] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.359412 12233 tablet_bootstrap.cc:654] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.359004 12232 consensus_queue.cc:260] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.361486 12232 ts_tablet_manager.cc:1434] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:22:58.363157 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
W20260709 12:22:58.364914 12008 leader_election.cc:343] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.363198 12232 tablet_bootstrap.cc:492] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.365631 12231 tablet_bootstrap.cc:492] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.366151 12231 ts_tablet_manager.cc:1403] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.002s
I20260709 12:22:58.370050 12231 raft_consensus.cc:359] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.370925 12231 raft_consensus.cc:385] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.371302 12231 raft_consensus.cc:740] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.371609 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.372488 12232 tablet_bootstrap.cc:654] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.372211 12231 consensus_queue.cc:260] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
W20260709 12:22:58.373292 12008 leader_election.cc:343] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.373775 12008 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079; no voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7
I20260709 12:22:58.374600 12238 raft_consensus.cc:2749] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:58.374886 12231 ts_tablet_manager.cc:1434] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:58.376320 12231 tablet_bootstrap.cc:492] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.384975 12231 tablet_bootstrap.cc:654] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.394395 12233 tablet_bootstrap.cc:492] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.394647 12231 tablet_bootstrap.cc:492] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.394891 12232 tablet_bootstrap.cc:492] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.394899 12233 ts_tablet_manager.cc:1403] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.008s
I20260709 12:22:58.395150 12231 ts_tablet_manager.cc:1403] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 12:22:58.395437 12232 ts_tablet_manager.cc:1403] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.008s
I20260709 12:22:58.397506 12233 raft_consensus.cc:359] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.398126 12233 raft_consensus.cc:385] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.398402 12233 raft_consensus.cc:740] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.398236 12231 raft_consensus.cc:359] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.398415 12232 raft_consensus.cc:359] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.399051 12231 raft_consensus.cc:385] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.399171 12232 raft_consensus.cc:385] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.399227 12233 consensus_queue.cc:260] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.399670 12232 raft_consensus.cc:740] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.399605 12231 raft_consensus.cc:740] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.400573 12231 consensus_queue.cc:260] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.400600 12232 consensus_queue.cc:260] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.401736 12233 ts_tablet_manager.cc:1434] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:58.402743 12233 tablet_bootstrap.cc:492] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.403048 12231 ts_tablet_manager.cc:1434] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:58.404313 12231 tablet_bootstrap.cc:492] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.405653 12232 ts_tablet_manager.cc:1434] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 12:22:58.406728 12232 tablet_bootstrap.cc:492] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.409334 12233 tablet_bootstrap.cc:654] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.410799 12231 tablet_bootstrap.cc:654] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.414191 12232 tablet_bootstrap.cc:654] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.417595 12237 raft_consensus.cc:493] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.418296 12237 raft_consensus.cc:515] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.423411 12238 raft_consensus.cc:493] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.424088 12238 raft_consensus.cc:515] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.425884 12233 tablet_bootstrap.cc:492] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.426383 12233 ts_tablet_manager.cc:1403] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:22:58.429262 12233 raft_consensus.cc:359] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.430048 12233 raft_consensus.cc:385] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.429917 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.430452 12233 raft_consensus.cc:740] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.431222 12233 consensus_queue.cc:260] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
W20260709 12:22:58.432188 12008 leader_election.cc:343] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.433650 12238 leader_election.cc:290] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.434653 12233 ts_tablet_manager.cc:1434] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:22:58.435210 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.435693 12233 tablet_bootstrap.cc:492] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.435864 12191 raft_consensus.cc:2468] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 0.
I20260709 12:22:58.437908 12008 leader_election.cc:304] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: ff1196b70e374829b6614c678280d4c7
I20260709 12:22:58.442195 12231 tablet_bootstrap.cc:492] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.442899 12231 ts_tablet_manager.cc:1403] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.018s
I20260709 12:22:58.443271 12233 tablet_bootstrap.cc:654] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.444154 12238 raft_consensus.cc:2804] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.444509 12237 leader_election.cc:290] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297), 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037)
I20260709 12:22:58.445274 12238 raft_consensus.cc:493] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.445752 12238 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.448437 12231 raft_consensus.cc:359] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.456239 12231 raft_consensus.cc:385] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.456640 12232 tablet_bootstrap.cc:492] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.456684 12231 raft_consensus.cc:740] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.457257 12232 ts_tablet_manager.cc:1403] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:22:58.453656 12238 raft_consensus.cc:515] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.463975 12233 tablet_bootstrap.cc:492] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.461499 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.464744 12233 ts_tablet_manager.cc:1403] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
W20260709 12:22:58.465687 12083 leader_election.cc:343] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.465826 12238 leader_election.cc:290] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.467346 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:58.467515 12233 raft_consensus.cc:359] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.467643 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.468376 12233 raft_consensus.cc:385] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.468737 12191 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.468828 12233 raft_consensus.cc:740] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
W20260709 12:22:58.468909 12008 leader_election.cc:343] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.464610 12231 consensus_queue.cc:260] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.469431 12232 raft_consensus.cc:359] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.470526 12232 raft_consensus.cc:385] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.470307 12233 consensus_queue.cc:260] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.470850 12232 raft_consensus.cc:740] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.458787 12256 raft_consensus.cc:493] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.471730 12256 raft_consensus.cc:515] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.474637 12233 ts_tablet_manager.cc:1434] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:22:58.474473 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.475744 12233 tablet_bootstrap.cc:492] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
W20260709 12:22:58.476080 12008 leader_election.cc:343] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.477349 12256 leader_election.cc:290] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.478524 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.474455 12232 consensus_queue.cc:260] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
W20260709 12:22:58.480005 12008 leader_election.cc:343] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.480427 12008 leader_election.cc:304] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079; no voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7
I20260709 12:22:58.482259 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.482901 12042 raft_consensus.cc:2468] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.484393 12256 raft_consensus.cc:2749] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:58.484230 12080 leader_election.cc:304] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 3667b9430fe64f37856b80152c57d816
I20260709 12:22:58.485451 12237 raft_consensus.cc:2804] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.485904 12233 tablet_bootstrap.cc:654] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.485898 12237 raft_consensus.cc:493] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.486547 12237 raft_consensus.cc:3060] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.493008 12191 raft_consensus.cc:2468] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 1.
I20260709 12:22:58.495764 12231 ts_tablet_manager.cc:1434] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.004s
I20260709 12:22:58.496675 12232 ts_tablet_manager.cc:1434] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:22:58.496548 12008 leader_election.cc:304] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: ff1196b70e374829b6614c678280d4c7
I20260709 12:22:58.497632 12256 raft_consensus.cc:2804] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.498240 12256 raft_consensus.cc:697] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:58.501269 12232 tablet_bootstrap.cc:492] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.502882 12258 raft_consensus.cc:493] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.503481 12258 raft_consensus.cc:515] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.505664 12237 raft_consensus.cc:515] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.506242 12231 tablet_bootstrap.cc:492] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.506554 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
W20260709 12:22:58.508033 12080 leader_election.cc:343] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.499321 12256 consensus_queue.cc:237] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.508865 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.509948 12237 leader_election.cc:290] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297), 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037)
I20260709 12:22:58.510993 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.511561 12042 raft_consensus.cc:3060] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:58.513516 12083 leader_election.cc:343] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.515251 12232 tablet_bootstrap.cc:654] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.515381 12231 tablet_bootstrap.cc:654] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:58.520107 11988 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:58.522712 12258 leader_election.cc:290] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.522972 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.523277 12233 tablet_bootstrap.cc:492] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.523619 12191 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.523785 12233 ts_tablet_manager.cc:1403] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.048s	user 0.028s	sys 0.012s
I20260709 12:22:58.524142 12232 tablet_bootstrap.cc:492] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.524607 12232 ts_tablet_manager.cc:1403] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.001s
I20260709 12:22:58.524775 12083 leader_election.cc:304] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:58.525957 12258 raft_consensus.cc:2804] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.526310 12258 raft_consensus.cc:493] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.526497 12231 tablet_bootstrap.cc:492] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.526690 12258 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.527117 12231 ts_tablet_manager.cc:1403] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.000s
I20260709 12:22:58.527302 12233 raft_consensus.cc:359] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.528283 12233 raft_consensus.cc:385] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.528340 12237 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.528671 12233 raft_consensus.cc:740] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.528913 12237 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.529891 12233 consensus_queue.cc:260] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.532581 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.532814 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.533237 12191 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.531478 12237 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.534511 12237 raft_consensus.cc:493] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:22:58.534793 12080 leader_election.cc:343] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.535028 12237 raft_consensus.cc:515] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.523284 12042 raft_consensus.cc:2468] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.535508 12083 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:58.536994 12080 leader_election.cc:304] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 3667b9430fe64f37856b80152c57d816
I20260709 12:22:58.538400 12237 leader_election.cc:290] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.541947 12237 raft_consensus.cc:2804] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.545646 12237 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.546103 12237 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.541026 12232 raft_consensus.cc:359] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.541131 12233 ts_tablet_manager.cc:1434] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:22:58.542097 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.549963 12232 raft_consensus.cc:385] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.550350 12232 raft_consensus.cc:740] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.550318 12191 raft_consensus.cc:2468] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.551038 12233 tablet_bootstrap.cc:492] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.551901 12083 leader_election.cc:304] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:58.552150 12232 consensus_queue.cc:260] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.556218 12264 raft_consensus.cc:2804] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.557564 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
W20260709 12:22:58.559161 12080 leader_election.cc:343] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.543040 12231 raft_consensus.cc:359] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.561084 12231 raft_consensus.cc:385] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.561451 12231 raft_consensus.cc:740] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.561908 12232 ts_tablet_manager.cc:1434] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.037s	user 0.010s	sys 0.000s
I20260709 12:22:58.562096 12233 tablet_bootstrap.cc:654] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.562356 12231 consensus_queue.cc:260] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.562956 12232 tablet_bootstrap.cc:492] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.564416 12263 raft_consensus.cc:2804] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.564774 12263 raft_consensus.cc:493] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.565052 12264 raft_consensus.cc:697] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:58.565099 12263 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.566123 12264 consensus_queue.cc:237] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.569861 11940 catalog_manager.cc:5697] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 0 to 1, leader changed from <none> to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.572337 12263 raft_consensus.cc:515] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.559549 12258 raft_consensus.cc:515] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.576879 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.577049 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.577639 12191 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.578756 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.579458 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
W20260709 12:22:58.578760 12080 leader_election.cc:343] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.580152 12042 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.580654 12258 leader_election.cc:290] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.579509 12190 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.581677 12263 leader_election.cc:290] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.583495 12237 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.586481 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.587829 12189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.588223 12237 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
W20260709 12:22:58.588153 12080 leader_election.cc:343] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:58.588719 12189 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.592202 12232 tablet_bootstrap.cc:654] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.597538 12237 raft_consensus.cc:493] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.598814 12231 ts_tablet_manager.cc:1434] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.008s
I20260709 12:22:58.598219 12237 raft_consensus.cc:515] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.600332 12042 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.602347 12231 tablet_bootstrap.cc:492] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.602380 12080 leader_election.cc:304] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:58.603358 12266 raft_consensus.cc:2804] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.603860 12266 raft_consensus.cc:697] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:58.609849 12231 tablet_bootstrap.cc:654] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.610903 12189 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.613095 12083 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:58.613298 12237 leader_election.cc:290] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.613611 12233 tablet_bootstrap.cc:492] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.613910 12237 raft_consensus.cc:2804] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.609822 12191 raft_consensus.cc:2468] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.613984 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.614063 12233 ts_tablet_manager.cc:1403] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.025s
I20260709 12:22:58.616717 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.617139 12233 raft_consensus.cc:359] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.617519 12191 raft_consensus.cc:2393] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ff1196b70e374829b6614c678280d4c7 in current term 1: Already voted for candidate 065c054808064c2f8143eac1e1eb6079 in this term.
I20260709 12:22:58.617480 12083 leader_election.cc:304] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:58.617865 12233 raft_consensus.cc:385] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.618227 12233 raft_consensus.cc:740] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.618956 12233 consensus_queue.cc:260] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.619174 12263 raft_consensus.cc:2804] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.619889 12263 raft_consensus.cc:697] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:58.621284 12233 ts_tablet_manager.cc:1434] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:58.620927 12263 consensus_queue.cc:237] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.622257 12233 tablet_bootstrap.cc:492] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.610798 12266 consensus_queue.cc:237] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.614408 12237 raft_consensus.cc:697] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:58.625546 12083 leader_election.cc:304] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ff1196b70e374829b6614c678280d4c7; no voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816
I20260709 12:22:58.626698 12258 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.627310 12237 consensus_queue.cc:237] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.623090 12190 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.637101 12258 raft_consensus.cc:2749] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:58.641995 12233 tablet_bootstrap.cc:654] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.648698 12232 tablet_bootstrap.cc:492] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.649389 12232 ts_tablet_manager.cc:1403] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.087s	user 0.013s	sys 0.012s
I20260709 12:22:58.653644 12232 raft_consensus.cc:359] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.654635 12232 raft_consensus.cc:385] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.655040 12232 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.658191 12231 tablet_bootstrap.cc:492] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.659149 12231 ts_tablet_manager.cc:1403] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.057s	user 0.006s	sys 0.017s
I20260709 12:22:58.662634 12231 raft_consensus.cc:359] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.663406 12231 raft_consensus.cc:385] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.663429 12240 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.663774 12231 raft_consensus.cc:740] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.663970 12240 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.666632 12231 consensus_queue.cc:260] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.665321 12232 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.670552 12232 ts_tablet_manager.cc:1434] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260709 12:22:58.672068 12240 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:58.674741 11937 catalog_manager.cc:5697] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.676946 12231 ts_tablet_manager.cc:1434] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:22:58.678155 12231 tablet_bootstrap.cc:492] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.678942 12233 tablet_bootstrap.cc:492] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.679419 12233 ts_tablet_manager.cc:1403] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.057s	user 0.009s	sys 0.004s
I20260709 12:22:58.682192 12233 raft_consensus.cc:359] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.682891 12233 raft_consensus.cc:385] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.683205 12233 raft_consensus.cc:740] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.676795 12232 tablet_bootstrap.cc:492] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.684346 12231 tablet_bootstrap.cc:654] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.683872 12233 consensus_queue.cc:260] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:58.692747 12233 ts_tablet_manager.cc:1434] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 12:22:58.693996 12233 tablet_bootstrap.cc:492] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.697866 12232 tablet_bootstrap.cc:654] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.703845 12240 raft_consensus.cc:493] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.704355 12240 raft_consensus.cc:515] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.706717 12240 leader_election.cc:290] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:58.711828 12237 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.712297 12237 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.714895 12237 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.716004 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.716312 12233 tablet_bootstrap.cc:654] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.716645 12042 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.714879 11939 catalog_manager.cc:5697] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.718145 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.718806 12190 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.718858 11939 catalog_manager.cc:5697] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.721728 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.722523 12041 raft_consensus.cc:2468] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 0.
I20260709 12:22:58.722078 11939 catalog_manager.cc:5697] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.724354 12080 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:58.725517 12237 raft_consensus.cc:2804] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.725997 12237 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.726413 12237 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.731793 12154 leader_election.cc:304] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:58.733335 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.733613 12266 raft_consensus.cc:493] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.734191 12042 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 0.
I20260709 12:22:58.734321 12266 raft_consensus.cc:515] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.735893 12154 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:58.738300 12240 raft_consensus.cc:2804] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.738782 12240 raft_consensus.cc:493] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.739653 12256 raft_consensus.cc:493] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.740260 12256 raft_consensus.cc:515] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.742997 12256 leader_election.cc:290] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.739192 12240 raft_consensus.cc:3060] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.744457 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.745352 12190 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.747211 12083 leader_election.cc:304] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:58.748441 12263 raft_consensus.cc:2804] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.748967 12263 raft_consensus.cc:493] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.749460 12263 raft_consensus.cc:3060] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.751507 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.753970 12266 leader_election.cc:290] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.742950 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.755802 12042 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:58.771696 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.773839 12115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.774789 12115 raft_consensus.cc:2468] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 0.
W20260709 12:22:58.782075 12154 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45037, user_credentials={real_user=slave}} blocked reactor thread for 46296us
I20260709 12:22:58.782706 12283 raft_consensus.cc:2804] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.763496 12263 raft_consensus.cc:515] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.784168 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.784986 12190 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 0.
I20260709 12:22:58.786161 12117 raft_consensus.cc:2393] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 065c054808064c2f8143eac1e1eb6079 in current term 1: Already voted for candidate ff1196b70e374829b6614c678280d4c7 in this term.
I20260709 12:22:58.786427 12263 leader_election.cc:290] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.762673 12237 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.789820 12116 raft_consensus.cc:2393] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3667b9430fe64f37856b80152c57d816 in current term 1: Already voted for candidate ff1196b70e374829b6614c678280d4c7 in this term.
I20260709 12:22:58.790417 12283 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.790613 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.790869 12283 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.792026 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:58.792722 12190 raft_consensus.cc:3060] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.795677 12240 raft_consensus.cc:515] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.797019 12231 tablet_bootstrap.cc:492] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.797508 12231 ts_tablet_manager.cc:1403] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.120s	user 0.049s	sys 0.055s
I20260709 12:22:58.797938 12240 leader_election.cc:290] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:58.798386 12237 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.800180 12042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.800442 12231 raft_consensus.cc:359] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.801460 12231 raft_consensus.cc:385] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.801822 12231 raft_consensus.cc:740] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.802009 12042 raft_consensus.cc:3060] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.807083 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.808313 12040 raft_consensus.cc:3060] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.808969 12232 tablet_bootstrap.cc:492] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.809525 12232 ts_tablet_manager.cc:1403] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.138s	user 0.013s	sys 0.003s
I20260709 12:22:58.811183 12190 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.801843 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.812140 12041 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.812526 12083 leader_election.cc:304] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:58.813292 12231 consensus_queue.cc:260] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.816730 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:58.817292 12117 raft_consensus.cc:3060] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.817649 12231 ts_tablet_manager.cc:1434] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:22:58.818848 12231 tablet_bootstrap.cc:492] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: Bootstrap starting.
I20260709 12:22:58.815927 12008 leader_election.cc:304] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:58.818486 12237 raft_consensus.cc:2804] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.815281 12283 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.827100 12191 raft_consensus.cc:2393] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate ff1196b70e374829b6614c678280d4c7 in current term 1: Already voted for candidate 3667b9430fe64f37856b80152c57d816 in this term.
I20260709 12:22:58.825377 12237 raft_consensus.cc:697] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:58.829898 12237 consensus_queue.cc:237] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.824985 12042 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.832216 12039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.832947 12231 tablet_bootstrap.cc:654] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.833593 12283 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:58.833184 12256 raft_consensus.cc:2764] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:58.836330 12117 raft_consensus.cc:2468] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 1.
I20260709 12:22:58.836658 12233 tablet_bootstrap.cc:492] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.837062 12233 ts_tablet_manager.cc:1403] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.143s	user 0.051s	sys 0.058s
I20260709 12:22:58.838693 12157 leader_election.cc:304] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:58.839963 12283 raft_consensus.cc:2804] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.840610 12283 raft_consensus.cc:697] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Becoming Leader. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:22:58.841378 12233 raft_consensus.cc:359] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.841746 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:58.842057 12233 raft_consensus.cc:385] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.842353 12233 raft_consensus.cc:740] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.842463 12117 raft_consensus.cc:2393] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 3667b9430fe64f37856b80152c57d816 in current term 1: Already voted for candidate ff1196b70e374829b6614c678280d4c7 in this term.
I20260709 12:22:58.842994 12041 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:58.841380 12283 consensus_queue.cc:237] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.843000 12233 consensus_queue.cc:260] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.844504 12080 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 3667b9430fe64f37856b80152c57d816
I20260709 12:22:58.838621 12232 raft_consensus.cc:359] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.845441 12232 raft_consensus.cc:385] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.845711 12233 ts_tablet_manager.cc:1434] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260709 12:22:58.845592 12263 raft_consensus.cc:2804] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.846362 12263 raft_consensus.cc:697] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:58.846712 12233 tablet_bootstrap.cc:492] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816: Bootstrap starting.
I20260709 12:22:58.845752 12232 raft_consensus.cc:740] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.847424 12263 consensus_queue.cc:237] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.848368 12232 consensus_queue.cc:260] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.852684 12157 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3667b9430fe64f37856b80152c57d816; no voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7
I20260709 12:22:58.854283 12240 raft_consensus.cc:2749] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:22:58.856055 12232 ts_tablet_manager.cc:1434] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.000s
I20260709 12:22:58.856954 12232 tablet_bootstrap.cc:492] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.857300 12040 raft_consensus.cc:2468] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 1.
I20260709 12:22:58.864326 11940 catalog_manager.cc:5697] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.870525 11939 catalog_manager.cc:5697] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3667b9430fe64f37856b80152c57d816 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "3667b9430fe64f37856b80152c57d816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.873673 12231 tablet_bootstrap.cc:492] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: No bootstrap required, opened a new log
I20260709 12:22:58.879853 12232 tablet_bootstrap.cc:654] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.881557 12233 tablet_bootstrap.cc:654] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.875516 12231 ts_tablet_manager.cc:1403] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: Time spent bootstrapping tablet: real 0.057s	user 0.024s	sys 0.014s
I20260709 12:22:58.886981 11937 catalog_manager.cc:5697] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:58.889199 12232 tablet_bootstrap.cc:492] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.889696 12232 ts_tablet_manager.cc:1403] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.007s
I20260709 12:22:58.893042 12232 raft_consensus.cc:359] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.893922 12232 raft_consensus.cc:385] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.894328 12232 raft_consensus.cc:740] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.895330 12232 consensus_queue.cc:260] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.898603 12232 ts_tablet_manager.cc:1434] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:22:58.899825 12232 tablet_bootstrap.cc:492] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: Bootstrap starting.
I20260709 12:22:58.900645 12283 raft_consensus.cc:493] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.901258 12283 raft_consensus.cc:515] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.884630 12231 raft_consensus.cc:359] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.904282 12231 raft_consensus.cc:385] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.904547 12231 raft_consensus.cc:740] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.905331 12231 consensus_queue.cc:260] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.906606 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d45cfb4a154eb28b9c371c4dff60d8" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.907457 12117 raft_consensus.cc:2468] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 0.
I20260709 12:22:58.908746 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d45cfb4a154eb28b9c371c4dff60d8" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:58.909614 12040 raft_consensus.cc:2468] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 0.
I20260709 12:22:58.910485 12231 ts_tablet_manager.cc:1434] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:22:58.911567 12154 leader_election.cc:304] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:58.912595 12240 raft_consensus.cc:2804] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:58.912966 12240 raft_consensus.cc:493] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:58.913306 12240 raft_consensus.cc:3060] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.910615 12256 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:58.914017 12256 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.918560 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:58.919525 12191 raft_consensus.cc:2393] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 065c054808064c2f8143eac1e1eb6079 in current term 1: Already voted for candidate ff1196b70e374829b6614c678280d4c7 in this term.
I20260709 12:22:58.920892 12240 raft_consensus.cc:515] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.921384 12283 leader_election.cc:290] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:58.922405 12256 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:58.923167 12240 leader_election.cc:290] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:22:58.924324 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:58.925302 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d45cfb4a154eb28b9c371c4dff60d8" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:58.925631 12008 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079; no voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7
I20260709 12:22:58.926076 12116 raft_consensus.cc:3060] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.929684 12256 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.929893 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f0d45cfb4a154eb28b9c371c4dff60d8" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:58.930642 12040 raft_consensus.cc:3060] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:58.935974 12256 raft_consensus.cc:2749] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:58.936502 12233 tablet_bootstrap.cc:492] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816: No bootstrap required, opened a new log
I20260709 12:22:58.936939 12233 ts_tablet_manager.cc:1403] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816: Time spent bootstrapping tablet: real 0.090s	user 0.025s	sys 0.028s
I20260709 12:22:58.938175 12040 raft_consensus.cc:2468] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 1.
I20260709 12:22:58.939324 12154 leader_election.cc:304] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:58.939445 12233 raft_consensus.cc:359] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.940062 12233 raft_consensus.cc:385] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.940169 12240 raft_consensus.cc:2804] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:58.940366 12233 raft_consensus.cc:740] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.941386 12232 tablet_bootstrap.cc:654] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:58.941337 12240 raft_consensus.cc:697] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Becoming Leader. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:22:58.942909 12116 raft_consensus.cc:2468] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 1.
I20260709 12:22:58.942469 12240 consensus_queue.cc:237] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.944258 12233 consensus_queue.cc:260] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.946287 12233 ts_tablet_manager.cc:1434] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:22:58.947464 12232 tablet_bootstrap.cc:492] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: No bootstrap required, opened a new log
I20260709 12:22:58.947912 12232 ts_tablet_manager.cc:1403] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: Time spent bootstrapping tablet: real 0.048s	user 0.010s	sys 0.001s
I20260709 12:22:58.950555 12232 raft_consensus.cc:359] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.951088 12232 raft_consensus.cc:385] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:58.951334 12232 raft_consensus.cc:740] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Initialized, Role: FOLLOWER
I20260709 12:22:58.951918 12232 consensus_queue.cc:260] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:58.951989 11939 catalog_manager.cc:5697] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3667b9430fe64f37856b80152c57d816 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "3667b9430fe64f37856b80152c57d816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:58.956175 12232 ts_tablet_manager.cc:1434] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:22:58.994460 12256 consensus_queue.cc:1048] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.008517 12293 consensus_queue.cc:1048] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:59.020545 12263 consensus_queue.cc:1048] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.027313 12263 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.031471 12240 raft_consensus.cc:493] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.032034 12240 raft_consensus.cc:515] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:59.036319 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ff1196b70e374829b6614c678280d4c7" is_pre_election: true
I20260709 12:22:59.038379 12190 raft_consensus.cc:3060] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:59.042426 12240 leader_election.cc:290] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037)
I20260709 12:22:59.045802 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:59.047418 12154 leader_election.cc:304] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3667b9430fe64f37856b80152c57d816; no voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7
I20260709 12:22:59.049316 12263 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.051391 12264 consensus_queue.cc:1048] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.053767 12240 raft_consensus.cc:2749] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:59.113662 12263 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.125878 12237 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:59.146224 12041 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:59.149488 12237 raft_consensus.cc:493] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:59.149924 12237 raft_consensus.cc:515] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.151860 12237 leader_election.cc:290] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.152130 12263 consensus_queue.cc:1048] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.152381 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079" is_pre_election: true
I20260709 12:22:59.152969 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816" is_pre_election: true
I20260709 12:22:59.153070 12041 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:59.153637 12190 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 0.
I20260709 12:22:59.154462 12080 leader_election.cc:304] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:59.155207 12263 raft_consensus.cc:2804] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:59.155526 12263 raft_consensus.cc:493] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:59.155843 12263 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:59.162482 12263 raft_consensus.cc:515] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.166364 12263 leader_election.cc:290] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.166285 12237 consensus_queue.cc:1048] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:59.167840 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.167902 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:59.168514 12191 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:59.168569 12041 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:59.174600 12041 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:59.174571 12191 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 1.
I20260709 12:22:59.175855 12083 leader_election.cc:304] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:59.176884 12237 raft_consensus.cc:2804] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:59.178162 12237 raft_consensus.cc:697] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.179039 12237 consensus_queue.cc:237] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.187139 11939 catalog_manager.cc:5697] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.288133 12237 consensus_queue.cc:1048] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.297096 12263 consensus_queue.cc:1048] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:59.303308 12266 consensus_queue.cc:1048] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.306944 12283 consensus_queue.cc:1048] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.315757 12258 consensus_queue.cc:1048] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:59.331338 12283 consensus_queue.cc:1048] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.425019 12116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "464a9698c4b04879a0efe521162f3573"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:22:59.425637 12116 raft_consensus.cc:606] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:59.430583 12116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:22:59.431088 12116 raft_consensus.cc:606] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:59.435739 12116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:22:59.436218 12116 raft_consensus.cc:606] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:59.440820 12116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:22:59.441324 12116 raft_consensus.cc:606] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:59.445927 12116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:22:59.446507 12116 raft_consensus.cc:606] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:22:59.461941 12041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:53530
I20260709 12:22:59.462473 12041 raft_consensus.cc:606] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 LEADER]: Received request to transfer leadership to TS ff1196b70e374829b6614c678280d4c7
I20260709 12:22:59.477540 12190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
mode: GRACEFUL
new_leader_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:53536
I20260709 12:22:59.478070 12190 raft_consensus.cc:606] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Received request to transfer leadership to TS ff1196b70e374829b6614c678280d4c7
I20260709 12:22:59.483201 12264 raft_consensus.cc:993] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.483673 12258 raft_consensus.cc:1081] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.484653 12240 consensus_queue.cc:1048] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.485538 12041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:22:59.486137 12041 raft_consensus.cc:493] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.486491 12041 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.488044 12240 consensus_queue.cc:1048] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.497345 12041 raft_consensus.cc:515] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.500706 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:59.500923 12041 leader_election.cc:290] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.501461 12116 raft_consensus.cc:3055] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.502409 12116 raft_consensus.cc:740] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.501468 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.504626 12190 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.503371 12116 consensus_queue.cc:260] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.507705 12116 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.512982 12190 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.513622 12116 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.514345 12008 leader_election.cc:304] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:59.515174 12256 raft_consensus.cc:2804] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.515661 12256 raft_consensus.cc:697] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:59.516436 12256 consensus_queue.cc:237] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.524405 11937 catalog_manager.cc:5697] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.542551 12264 raft_consensus.cc:993] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.543004 12258 raft_consensus.cc:1081] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.544351 12041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:22:59.544826 12041 raft_consensus.cc:493] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.545116 12041 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.550942 12041 raft_consensus.cc:515] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.552477 12041 leader_election.cc:290] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.553292 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:59.553694 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.553942 12116 raft_consensus.cc:3055] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.554251 12190 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.554266 12116 raft_consensus.cc:740] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.555210 12116 consensus_queue.cc:260] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.556442 12116 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.561563 12190 raft_consensus.cc:2468] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.562798 12008 leader_election.cc:304] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:59.563277 12116 raft_consensus.cc:2468] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.563336 12258 consensus_queue.cc:1048] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.563740 12256 raft_consensus.cc:2804] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.564350 12256 raft_consensus.cc:697] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:59.565222 12256 consensus_queue.cc:237] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.573891 11940 catalog_manager.cc:5697] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.576758 12258 consensus_queue.cc:1048] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:59.586934 12293 raft_consensus.cc:993] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: : Instructing follower ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:22:59.587396 12256 raft_consensus.cc:1081] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 LEADER]: Signalling peer ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:22:59.589157 12116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:47772
I20260709 12:22:59.589910 12116 raft_consensus.cc:493] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.590288 12116 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.596101 12116 raft_consensus.cc:515] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.597812 12116 leader_election.cc:290] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 2 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.598541 12041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:59.598801 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.599162 12041 raft_consensus.cc:3055] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.599386 12190 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.599548 12041 raft_consensus.cc:740] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:59.600383 12041 consensus_queue.cc:260] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.601635 12041 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.602679 12266 raft_consensus.cc:993] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.603119 12258 raft_consensus.cc:1081] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.604473 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "464a9698c4b04879a0efe521162f3573"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:22:59.604933 12040 raft_consensus.cc:493] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.605252 12040 raft_consensus.cc:3060] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.606237 12190 raft_consensus.cc:2468] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 2.
I20260709 12:22:59.607324 12083 leader_election.cc:304] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:59.608131 12258 raft_consensus.cc:2804] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.608378 12041 raft_consensus.cc:2468] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 2.
I20260709 12:22:59.608629 12258 raft_consensus.cc:697] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.609808 12258 consensus_queue.cc:237] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.611124 12040 raft_consensus.cc:515] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:59.613323 12040 leader_election.cc:290] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.615150 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.615214 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "464a9698c4b04879a0efe521162f3573" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:59.615732 12190 raft_consensus.cc:3060] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.615916 12116 raft_consensus.cc:3055] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.616354 12116 raft_consensus.cc:740] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.617090 12116 consensus_queue.cc:260] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:59.618286 12116 raft_consensus.cc:3060] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.617468 11940 catalog_manager.cc:5697] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 1 to 2, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.621997 12190 raft_consensus.cc:2468] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.623780 12008 leader_election.cc:304] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:59.624605 12256 raft_consensus.cc:2804] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.625070 12256 raft_consensus.cc:697] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:59.625870 12116 raft_consensus.cc:2468] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.625882 12256 consensus_queue.cc:237] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } }
I20260709 12:22:59.632274 11940 catalog_manager.cc:5697] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.707399 12266 raft_consensus.cc:993] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.707867 12258 raft_consensus.cc:1081] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.709510 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:22:59.710035 12040 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.710289 12040 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.714697 12040 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.716655 12040 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.717303 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:59.717694 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.717958 12116 raft_consensus.cc:3055] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.718246 12190 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.718353 12116 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.719235 12116 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.720204 12116 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.723189 12190 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.724146 12008 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:59.724882 12116 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.724900 12256 raft_consensus.cc:2804] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.725574 12256 raft_consensus.cc:697] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:59.726331 12256 consensus_queue.cc:237] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.732290 11940 catalog_manager.cc:5697] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.790043 12258 raft_consensus.cc:993] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.790459 12264 raft_consensus.cc:1081] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:22:59.791725 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:22:59.792151 12040 raft_consensus.cc:493] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.792587 12040 raft_consensus.cc:3060] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.797165 12040 raft_consensus.cc:515] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.798651 12040 leader_election.cc:290] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.799431 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:22:59.799825 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6278199a8b804b76b4e28acfd2647e63" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.800088 12116 raft_consensus.cc:3055] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.800396 12190 raft_consensus.cc:3060] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.800489 12116 raft_consensus.cc:740] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.801365 12116 consensus_queue.cc:260] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.802580 12116 raft_consensus.cc:3060] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.807134 12190 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.808243 12008 leader_election.cc:304] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:22:59.809026 12256 raft_consensus.cc:2804] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.809314 12116 raft_consensus.cc:2468] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:22:59.809485 12256 raft_consensus.cc:697] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:22:59.810380 12256 consensus_queue.cc:237] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.817453 11940 catalog_manager.cc:5697] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.945730 12240 raft_consensus.cc:993] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: : Instructing follower ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:22:59.946192 12283 raft_consensus.cc:1081] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Signalling peer ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:22:59.947607 12116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:47774
I20260709 12:22:59.948150 12116 raft_consensus.cc:493] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.948545 12116 raft_consensus.cc:3060] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.950606 12117 raft_consensus.cc:1275] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:59.951902 12256 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.955193 12116 raft_consensus.cc:515] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.957340 12116 leader_election.cc:290] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 2 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:22:59.958571 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:22:59.959616 12190 raft_consensus.cc:3055] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.959993 12190 raft_consensus.cc:740] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:22:59.961758 12191 raft_consensus.cc:1275] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:59.962873 12190 consensus_queue.cc:260] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.963635 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af236469d1cb44e38f2c48a7a6453bca" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:22:59.964129 12040 raft_consensus.cc:3060] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.964149 12190 raft_consensus.cc:3060] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.968935 12040 raft_consensus.cc:2468] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 2.
I20260709 12:22:59.969604 12190 raft_consensus.cc:2468] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 2.
I20260709 12:22:59.969787 12293 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.970145 12080 leader_election.cc:304] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:22:59.971002 12264 raft_consensus.cc:2804] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.971449 12264 raft_consensus.cc:697] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:22:59.972215 12264 consensus_queue.cc:237] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:22:59.982600 11937 catalog_manager.cc:5697] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 1 to 2, leader changed from 3667b9430fe64f37856b80152c57d816 (127.11.32.3) to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:00.023650 12040 raft_consensus.cc:1275] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.025020 12264 consensus_queue.cc:1048] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.035602 12190 raft_consensus.cc:1275] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.037250 12266 consensus_queue.cc:1048] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.058144 12190 raft_consensus.cc:1275] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.059351 12293 consensus_queue.cc:1048] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.068074 12116 raft_consensus.cc:1275] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.069933 12256 consensus_queue.cc:1048] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.118472 12116 raft_consensus.cc:1275] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.120144 12323 consensus_queue.cc:1048] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.128995 12190 raft_consensus.cc:1275] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.130900 12323 consensus_queue.cc:1048] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.154590 12116 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.155827 12323 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.164450 12190 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.165738 12256 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.238349 12116 raft_consensus.cc:1275] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.239612 12256 consensus_queue.cc:1048] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.248150 12190 raft_consensus.cc:1275] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.250169 12256 consensus_queue.cc:1048] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.418583 12190 raft_consensus.cc:1275] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.419819 12325 consensus_queue.cc:1048] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:00.427927 12040 raft_consensus.cc:1275] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:00.429538 12264 consensus_queue.cc:1048] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:02.514415 11392 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:23:02.515013 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.531105 12040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53538
I20260709 12:23:02.531631 12040 raft_consensus.cc:606] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Received request to transfer leadership to TS 3667b9430fe64f37856b80152c57d816
I20260709 12:23:02.534001 12040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53538
I20260709 12:23:02.534781 12040 raft_consensus.cc:606] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Received request to transfer leadership to TS 3667b9430fe64f37856b80152c57d816
I20260709 12:23:02.536381 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:02.536931 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:02.648583 12323 raft_consensus.cc:993] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: : Instructing follower 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:02.649066 12337 raft_consensus.cc:1081] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Signalling peer 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:02.650418 12190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53520
I20260709 12:23:02.650856 12190 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:02.651134 12190 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:02.655086 12190 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:02.656373 12190 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:23:02.657199 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:23:02.657399 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:02.657858 12040 raft_consensus.cc:3055] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:02.657917 12116 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:02.658322 12040 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:02.659091 12040 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:02.660266 12040 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:02.664176 12116 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:02.665325 12157 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:02.666096 12283 raft_consensus.cc:2804] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:02.666599 12040 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:02.667032 12283 raft_consensus.cc:697] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Becoming Leader. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:23:02.667901 12283 consensus_queue.cc:237] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:02.674288 11940 catalog_manager.cc:5697] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 reported cstate change: term changed from 2 to 3, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to 3667b9430fe64f37856b80152c57d816 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3667b9430fe64f37856b80152c57d816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:02.686743 12323 raft_consensus.cc:993] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: : Instructing follower 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:02.687172 12337 raft_consensus.cc:1081] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Signalling peer 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:02.688513 12190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53520
I20260709 12:23:02.688941 12190 raft_consensus.cc:493] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:02.689219 12190 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:02.693199 12190 raft_consensus.cc:515] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:02.694599 12190 leader_election.cc:290] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:23:02.695412 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:23:02.695596 12116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:02.696024 12116 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:02.696017 12040 raft_consensus.cc:3055] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:02.696544 12040 raft_consensus.cc:740] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:02.697331 12040 consensus_queue.cc:260] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:02.698488 12040 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:02.702292 12116 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:02.703305 12157 leader_election.cc:304] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:02.703975 12283 raft_consensus.cc:2804] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:02.704448 12283 raft_consensus.cc:697] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Becoming Leader. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:23:02.704655 12040 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:02.705314 12283 consensus_queue.cc:237] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:02.711802 11940 catalog_manager.cc:5697] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 reported cstate change: term changed from 2 to 3, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to 3667b9430fe64f37856b80152c57d816 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3667b9430fe64f37856b80152c57d816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:03.137219 12040 raft_consensus.cc:1275] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:03.138633 12338 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:03.139818 12116 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:03.141068 12338 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:03.151355 12116 raft_consensus.cc:1275] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:03.154415 12041 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:03.155563 12283 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:03.156126 12338 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:03.537818 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.543110 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.543540 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.544536 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.551177 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.551692 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.552665 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.559437 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.559945 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.561076 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.566659 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:06.567131 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.568338 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.574473 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:07.574960 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:08.576102 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:08.581367 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:08.581853 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:09.582854 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:09.588886 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:09.589459 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:10.590430 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:10.595980 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:10.596513 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:11.597550 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:11.604696 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:11.605211 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:12.639302 11392 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:23:12.651754 12190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53536
I20260709 12:23:12.652426 12190 raft_consensus.cc:606] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:23:12.657094 12190 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53536
I20260709 12:23:12.657608 12190 raft_consensus.cc:606] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:23:12.661963 12117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:23:12.662428 12117 raft_consensus.cc:606] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:23:12.666854 12117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:23:12.667282 12117 raft_consensus.cc:606] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:23:12.671418 12117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
mode: GRACEFUL
new_leader_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:47776
I20260709 12:23:12.671841 12117 raft_consensus.cc:606] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Received request to transfer leadership to TS 065c054808064c2f8143eac1e1eb6079
I20260709 12:23:12.681063 12360 raft_consensus.cc:993] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.681619 12364 raft_consensus.cc:1081] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.683321 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:23:12.683882 12040 raft_consensus.cc:493] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.684298 12040 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.690351 12040 raft_consensus.cc:515] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.691875 12040 leader_election.cc:290] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:12.692926 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:12.693279 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:12.693806 12190 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.693804 12117 raft_consensus.cc:3055] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:12.694430 12117 raft_consensus.cc:740] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:23:12.695483 12117 consensus_queue.cc:260] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.696981 12117 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.700030 12190 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:23:12.701289 12008 leader_election.cc:304] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:23:12.702174 12337 raft_consensus.cc:2804] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.702658 12117 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:23:12.703097 12337 raft_consensus.cc:697] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:12.704329 12337 consensus_queue.cc:237] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.711158 11940 catalog_manager.cc:5697] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.730562 12365 raft_consensus.cc:993] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.731176 12362 raft_consensus.cc:1081] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.732730 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53514
I20260709 12:23:12.733129 12040 raft_consensus.cc:493] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.733373 12040 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.737947 12040 raft_consensus.cc:515] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.739482 12040 leader_election.cc:290] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 4 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:12.740332 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:12.740511 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "190254bd2ecd4ede959ca5426be31600" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:12.740876 12117 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.741006 12190 raft_consensus.cc:3055] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:12.741343 12190 raft_consensus.cc:740] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:23:12.742010 12190 consensus_queue.cc:260] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.742959 12190 raft_consensus.cc:3060] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.745260 12117 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 4.
I20260709 12:23:12.746378 12008 leader_election.cc:304] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:12.747014 12337 raft_consensus.cc:2804] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:12.747437 12337 raft_consensus.cc:697] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:12.747740 12190 raft_consensus.cc:2468] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 4.
I20260709 12:23:12.748325 12337 consensus_queue.cc:237] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.754432 11940 catalog_manager.cc:5697] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 3 to 4, leader changed from 3667b9430fe64f37856b80152c57d816 (127.11.32.3) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 4 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.772936 12365 raft_consensus.cc:993] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.773346 12362 raft_consensus.cc:1081] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.774766 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53514
I20260709 12:23:12.775204 12040 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.775486 12040 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.779739 12040 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.781113 12040 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 4 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:12.781965 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:12.782087 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:12.782435 12117 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.782608 12190 raft_consensus.cc:3055] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:12.782970 12190 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:23:12.783731 12190 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.784857 12190 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:12.787281 12117 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 4.
I20260709 12:23:12.788187 12008 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:12.788825 12337 raft_consensus.cc:2804] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:12.789258 12337 raft_consensus.cc:697] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:12.789321 12190 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 4.
I20260709 12:23:12.790093 12337 consensus_queue.cc:237] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.796965 11940 catalog_manager.cc:5697] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 3 to 4, leader changed from 3667b9430fe64f37856b80152c57d816 (127.11.32.3) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 4 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.886524 12360 raft_consensus.cc:993] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.886991 12364 raft_consensus.cc:1081] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.888325 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:23:12.888787 12040 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.889034 12040 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.893762 12040 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.895382 12040 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:12.896363 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:12.896458 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:12.896955 12117 raft_consensus.cc:3055] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:12.897024 12190 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.897219 12117 raft_consensus.cc:740] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:23:12.898074 12117 consensus_queue.cc:260] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.898948 12117 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:12.901186 12360 raft_consensus.cc:993] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: : Instructing follower 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.901680 12364 raft_consensus.cc:1081] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Signalling peer 065c054808064c2f8143eac1e1eb6079 to start an election
I20260709 12:23:12.903234 12040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
 from {username='slave'} at 127.0.0.1:53506
I20260709 12:23:12.903496 12190 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:23:12.903760 12040 raft_consensus.cc:493] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:12.904124 12040 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.904465 12008 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:23:12.905103 12337 raft_consensus.cc:2804] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:12.905392 12117 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 2.
I20260709 12:23:12.905521 12337 raft_consensus.cc:697] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:12.906401 12337 consensus_queue.cc:237] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.909757 12040 raft_consensus.cc:515] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.911805 12040 leader_election.cc:290] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 3 election: Requested vote from peers ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:12.912362 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:12.912818 12117 raft_consensus.cc:3055] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:12.913057 12117 raft_consensus.cc:740] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:23:12.913558 12190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02ef01b8776b4d97a767df659f01cdb1" candidate_uuid: "065c054808064c2f8143eac1e1eb6079" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:12.913818 12117 consensus_queue.cc:260] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.914080 12190 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.914728 12117 raft_consensus.cc:3060] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:12.914096 11940 catalog_manager.cc:5697] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 1 to 2, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:12.919870 12117 raft_consensus.cc:2468] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 3.
I20260709 12:23:12.920092 12190 raft_consensus.cc:2468] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 065c054808064c2f8143eac1e1eb6079 in term 3.
I20260709 12:23:12.921131 12008 leader_election.cc:304] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:23:12.921810 12337 raft_consensus.cc:2804] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:12.922245 12337 raft_consensus.cc:697] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 3 LEADER]: Becoming Leader. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:12.923062 12337 consensus_queue.cc:237] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:12.929488 11940 catalog_manager.cc:5697] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 reported cstate change: term changed from 2 to 3, leader changed from ff1196b70e374829b6614c678280d4c7 (127.11.32.2) to 065c054808064c2f8143eac1e1eb6079 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "065c054808064c2f8143eac1e1eb6079" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:13.110313 12117 raft_consensus.cc:1275] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.111436 12337 consensus_queue.cc:1048] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.124478 12190 raft_consensus.cc:1275] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.128556 12337 consensus_queue.cc:1048] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.164485 12190 raft_consensus.cc:1275] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:13.165812 12378 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.174219 12117 raft_consensus.cc:1275] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:13.175503 12378 consensus_queue.cc:1048] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.187011 12117 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:13.188294 12366 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.196868 12190 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:13.198827 12366 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:13.384089 12190 raft_consensus.cc:1275] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.385620 12366 consensus_queue.cc:1048] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.396090 12117 raft_consensus.cc:1275] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:13.398280 12337 consensus_queue.cc:1048] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:13.482949 12117 raft_consensus.cc:1275] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:13.484364 12337 consensus_queue.cc:1048] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:13.492707 12190 raft_consensus.cc:1275] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Refusing update from remote peer 065c054808064c2f8143eac1e1eb6079: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:13.494390 12337 consensus_queue.cc:1048] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.705508 11392 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:23:15.706148 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.715008 12040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:53538
I20260709 12:23:15.715538 12040 raft_consensus.cc:606] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Received request to transfer leadership to TS ff1196b70e374829b6614c678280d4c7
I20260709 12:23:15.718118 12040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:53538
I20260709 12:23:15.718606 12040 raft_consensus.cc:606] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Received request to transfer leadership to TS ff1196b70e374829b6614c678280d4c7
I20260709 12:23:15.721263 12040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53538
I20260709 12:23:15.721740 12040 raft_consensus.cc:606] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Received request to transfer leadership to TS 3667b9430fe64f37856b80152c57d816
I20260709 12:23:15.724184 12040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5"
dest_uuid: "065c054808064c2f8143eac1e1eb6079"
mode: GRACEFUL
new_leader_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53538
I20260709 12:23:15.724604 12040 raft_consensus.cc:606] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Received request to transfer leadership to TS 3667b9430fe64f37856b80152c57d816
I20260709 12:23:15.725576 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:15.726042 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:15.770015 12366 raft_consensus.cc:993] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: : Instructing follower ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:23:15.770483 12392 raft_consensus.cc:1081] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Signalling peer ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:23:15.771795 12117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:47772
I20260709 12:23:15.772188 12117 raft_consensus.cc:493] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.772413 12117 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:15.776443 12117 raft_consensus.cc:515] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.778455 12117 leader_election.cc:290] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 5 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:15.779255 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:23:15.779862 12040 raft_consensus.cc:3055] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:15.780081 12040 raft_consensus.cc:740] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:15.779963 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21b175dff767436eabf366cd2f9f577e" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:15.780735 12191 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:15.780830 12040 consensus_queue.cc:260] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.781772 12040 raft_consensus.cc:3060] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:15.785652 12040 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 5.
I20260709 12:23:15.785681 12191 raft_consensus.cc:2468] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 5.
I20260709 12:23:15.786880 12080 leader_election.cc:304] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:15.787519 12364 raft_consensus.cc:2804] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:15.788352 12364 raft_consensus.cc:697] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 5 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:23:15.789047 12364 consensus_queue.cc:237] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.795324 11939 catalog_manager.cc:5697] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 4 to 5, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 5 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.915172 12366 raft_consensus.cc:993] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: : Instructing follower ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:23:15.915648 12399 raft_consensus.cc:1081] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Signalling peer ff1196b70e374829b6614c678280d4c7 to start an election
I20260709 12:23:15.917124 12117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff"
dest_uuid: "ff1196b70e374829b6614c678280d4c7"
 from {username='slave'} at 127.0.0.1:47772
I20260709 12:23:15.917591 12117 raft_consensus.cc:493] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.917887 12117 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:15.922457 12117 raft_consensus.cc:515] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.923807 12117 leader_election.cc:290] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 3 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), 3667b9430fe64f37856b80152c57d816 (127.11.32.3:42297)
I20260709 12:23:15.924611 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:23:15.924773 12191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "255b0a0f74454c46b86dbee4a7aae1ff" candidate_uuid: "ff1196b70e374829b6614c678280d4c7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3667b9430fe64f37856b80152c57d816"
I20260709 12:23:15.925067 12040 raft_consensus.cc:3055] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:15.925307 12191 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:15.925398 12040 raft_consensus.cc:740] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:15.926170 12040 consensus_queue.cc:260] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.926976 12040 raft_consensus.cc:3060] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:15.930145 12191 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 3.
I20260709 12:23:15.931113 12083 leader_election.cc:304] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:15.931133 12040 raft_consensus.cc:2468] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ff1196b70e374829b6614c678280d4c7 in term 3.
I20260709 12:23:15.931941 12364 raft_consensus.cc:2804] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:15.932426 12364 raft_consensus.cc:697] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 3 LEADER]: Becoming Leader. State: Replica: ff1196b70e374829b6614c678280d4c7, State: Running, Role: LEADER
I20260709 12:23:15.933100 12364 consensus_queue.cc:237] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.939332 11939 catalog_manager.cc:5697] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 reported cstate change: term changed from 2 to 3, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to ff1196b70e374829b6614c678280d4c7 (127.11.32.2). New cstate: current_term: 3 leader_uuid: "ff1196b70e374829b6614c678280d4c7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:15.946882 12366 raft_consensus.cc:993] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: : Instructing follower 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:15.947356 12366 raft_consensus.cc:1081] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Signalling peer 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:15.949005 12191 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53520
I20260709 12:23:15.949584 12191 raft_consensus.cc:493] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:15.949949 12191 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:15.955111 12191 raft_consensus.cc:515] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.957356 12191 leader_election.cc:290] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:23:15.958299 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:23:15.958392 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96e3816520ad4e7eba6699e4ec2e1fb5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:15.958983 12040 raft_consensus.cc:3055] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:15.959098 12117 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:15.959283 12040 raft_consensus.cc:740] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:15.959962 12040 consensus_queue.cc:260] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.960791 12040 raft_consensus.cc:3060] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:15.965035 12117 raft_consensus.cc:2468] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:15.965027 12040 raft_consensus.cc:2468] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:15.966269 12154 leader_election.cc:304] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 065c054808064c2f8143eac1e1eb6079, 3667b9430fe64f37856b80152c57d816; no voters: 
I20260709 12:23:15.966925 12362 raft_consensus.cc:2804] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:15.968101 12362 raft_consensus.cc:697] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Becoming Leader. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:23:15.969002 12362 consensus_queue.cc:237] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:15.976912 11939 catalog_manager.cc:5697] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 reported cstate change: term changed from 2 to 3, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to 3667b9430fe64f37856b80152c57d816 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3667b9430fe64f37856b80152c57d816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.232872 12399 raft_consensus.cc:993] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: : Instructing follower 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:16.233385 12366 raft_consensus.cc:1081] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Signalling peer 3667b9430fe64f37856b80152c57d816 to start an election
I20260709 12:23:16.234766 12190 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5"
dest_uuid: "3667b9430fe64f37856b80152c57d816"
 from {username='slave'} at 127.0.0.1:53520
I20260709 12:23:16.235208 12190 raft_consensus.cc:493] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:16.235483 12190 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.239485 12190 raft_consensus.cc:515] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:16.240957 12190 leader_election.cc:290] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Requested vote from peers 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037), ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119)
I20260709 12:23:16.241755 12040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "065c054808064c2f8143eac1e1eb6079"
I20260709 12:23:16.242031 12117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4bb496f155b4032b16f7f3da5fc9dd5" candidate_uuid: "3667b9430fe64f37856b80152c57d816" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ff1196b70e374829b6614c678280d4c7"
I20260709 12:23:16.242251 12040 raft_consensus.cc:3055] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:16.242556 12040 raft_consensus.cc:740] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 065c054808064c2f8143eac1e1eb6079, State: Running, Role: LEADER
I20260709 12:23:16.242568 12117 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.243163 12040 consensus_queue.cc:260] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:16.243988 12040 raft_consensus.cc:3060] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:16.246933 12117 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:16.247941 12157 leader_election.cc:304] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3667b9430fe64f37856b80152c57d816, ff1196b70e374829b6614c678280d4c7; no voters: 
I20260709 12:23:16.248337 12040 raft_consensus.cc:2468] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3667b9430fe64f37856b80152c57d816 in term 3.
I20260709 12:23:16.248628 12362 raft_consensus.cc:2804] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:16.249099 12362 raft_consensus.cc:697] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Becoming Leader. State: Replica: 3667b9430fe64f37856b80152c57d816, State: Running, Role: LEADER
I20260709 12:23:16.250193 12362 consensus_queue.cc:237] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } }
I20260709 12:23:16.258970 11939 catalog_manager.cc:5697] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 reported cstate change: term changed from 2 to 3, leader changed from 065c054808064c2f8143eac1e1eb6079 (127.11.32.1) to 3667b9430fe64f37856b80152c57d816 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3667b9430fe64f37856b80152c57d816" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:16.284658 12040 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 5 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:16.285797 12364 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:16.298825 12190 raft_consensus.cc:1275] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 5 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:16.300215 12406 consensus_queue.cc:1048] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:16.325326 12040 raft_consensus.cc:1275] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:16.326488 12406 consensus_queue.cc:1048] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.334568 12190 raft_consensus.cc:1275] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Refusing update from remote peer ff1196b70e374829b6614c678280d4c7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:16.336279 12393 consensus_queue.cc:1048] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3667b9430fe64f37856b80152c57d816" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 42297 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.348021 12117 raft_consensus.cc:1275] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:16.349104 12362 consensus_queue.cc:1048] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.358167 12040 raft_consensus.cc:1275] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:16.359977 12362 consensus_queue.cc:1048] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.726045 12117 raft_consensus.cc:1275] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:16.727005 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.728399 12401 consensus_queue.cc:1048] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ff1196b70e374829b6614c678280d4c7" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 43119 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:16.735749 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:16.736450 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.745157 12040 raft_consensus.cc:1275] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Refusing update from remote peer 3667b9430fe64f37856b80152c57d816: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:16.746394 12362 consensus_queue.cc:1048] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [LEADER]: Connected to new peer: Peer: permanent_uuid: "065c054808064c2f8143eac1e1eb6079" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45037 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:17.737823 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.748281 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:17.748787 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.749951 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.755791 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.756294 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.757287 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.762601 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:19.763103 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.764047 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:20.770169 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:20.770625 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.771656 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.777506 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:21.778008 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.779075 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.785280 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:22.785754 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.786715 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.793911 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:23.794370 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:24.795583 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:24.801891 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:24.802436 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:25.832409 11392 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:23:25.832873 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
I20260709 12:23:25.859278 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:25.859948 11392 tablet_replica.cc:333] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.860605 11392 raft_consensus.cc:2243] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.861258 11392 raft_consensus.cc:2272] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.863308 11392 tablet_replica.cc:333] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.863842 11392 raft_consensus.cc:2243] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.864296 11392 raft_consensus.cc:2272] T 255b0a0f74454c46b86dbee4a7aae1ff P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.866170 11392 tablet_replica.cc:333] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.866708 11392 raft_consensus.cc:2243] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.867098 11392 raft_consensus.cc:2272] T f0d45cfb4a154eb28b9c371c4dff60d8 P 065c054808064c2f8143eac1e1eb6079 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.868815 11392 tablet_replica.cc:333] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.869314 11392 raft_consensus.cc:2243] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:25.870165 11392 raft_consensus.cc:2272] T 464a9698c4b04879a0efe521162f3573 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.871996 11392 tablet_replica.cc:333] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.872510 11392 raft_consensus.cc:2243] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.872938 11392 raft_consensus.cc:2272] T 21b175dff767436eabf366cd2f9f577e P 065c054808064c2f8143eac1e1eb6079 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.874670 11392 tablet_replica.cc:333] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.875222 11392 raft_consensus.cc:2243] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.875631 11392 raft_consensus.cc:2272] T af236469d1cb44e38f2c48a7a6453bca P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.877317 11392 tablet_replica.cc:333] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.878321 11392 raft_consensus.cc:2243] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:25.879208 11392 raft_consensus.cc:2272] T 02ef01b8776b4d97a767df659f01cdb1 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.881279 11392 tablet_replica.cc:333] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.881801 11392 raft_consensus.cc:2243] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:25.882532 11392 raft_consensus.cc:2272] T 190254bd2ecd4ede959ca5426be31600 P 065c054808064c2f8143eac1e1eb6079 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.884086 11392 tablet_replica.cc:333] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.884552 11392 raft_consensus.cc:2243] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.884984 11392 raft_consensus.cc:2272] T b4bb496f155b4032b16f7f3da5fc9dd5 P 065c054808064c2f8143eac1e1eb6079 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.886793 11392 tablet_replica.cc:333] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079: stopping tablet replica
I20260709 12:23:25.887233 11392 raft_consensus.cc:2243] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:25.888144 11392 raft_consensus.cc:2272] T 6278199a8b804b76b4e28acfd2647e63 P 065c054808064c2f8143eac1e1eb6079 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.920401 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
I20260709 12:23:25.939977 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
W20260709 12:23:25.953255 12157 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20260709 12:23:25.960048 12157 consensus_peers.cc:597] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 -> Peer ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119): Couldn't send request to peer ff1196b70e374829b6614c678280d4c7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.971053 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:25.971750 11392 tablet_replica.cc:333] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.972400 11392 raft_consensus.cc:2243] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:25.973237 11392 raft_consensus.cc:2272] T 255b0a0f74454c46b86dbee4a7aae1ff P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.975243 11392 tablet_replica.cc:333] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.975844 11392 raft_consensus.cc:2243] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.976292 11392 raft_consensus.cc:2272] T f0d45cfb4a154eb28b9c371c4dff60d8 P ff1196b70e374829b6614c678280d4c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.978332 11392 tablet_replica.cc:333] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.978914 11392 raft_consensus.cc:2243] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.979470 11392 raft_consensus.cc:2272] T 02ef01b8776b4d97a767df659f01cdb1 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.982758 11392 tablet_replica.cc:333] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.983579 11392 raft_consensus.cc:2243] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.984115 11392 raft_consensus.cc:2272] T 6278199a8b804b76b4e28acfd2647e63 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:25.984527 12154 consensus_peers.cc:597] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 -> Peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Couldn't send request to peer 065c054808064c2f8143eac1e1eb6079. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:25.986259 11392 tablet_replica.cc:333] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.986806 11392 raft_consensus.cc:2243] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.987208 11392 raft_consensus.cc:2272] T b4bb496f155b4032b16f7f3da5fc9dd5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.989030 11392 tablet_replica.cc:333] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.989629 11392 raft_consensus.cc:2243] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.990072 11392 raft_consensus.cc:2272] T 190254bd2ecd4ede959ca5426be31600 P ff1196b70e374829b6614c678280d4c7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.991850 11392 tablet_replica.cc:333] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.992421 11392 raft_consensus.cc:2243] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.992831 11392 raft_consensus.cc:2272] T 464a9698c4b04879a0efe521162f3573 P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.994710 11392 tablet_replica.cc:333] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.995167 11392 raft_consensus.cc:2243] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:25.995571 11392 raft_consensus.cc:2272] T 96e3816520ad4e7eba6699e4ec2e1fb5 P ff1196b70e374829b6614c678280d4c7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:25.997584 11392 tablet_replica.cc:333] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
I20260709 12:23:25.998268 11392 raft_consensus.cc:2243] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:25.999209 11392 raft_consensus.cc:2272] T af236469d1cb44e38f2c48a7a6453bca P ff1196b70e374829b6614c678280d4c7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.001703 11392 tablet_replica.cc:333] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7: stopping tablet replica
W20260709 12:23:26.001719 12154 consensus_peers.cc:597] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 -> Peer 065c054808064c2f8143eac1e1eb6079 (127.11.32.1:45037): Couldn't send request to peer 065c054808064c2f8143eac1e1eb6079. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45037: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.002480 11392 raft_consensus.cc:2243] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.003211 11392 raft_consensus.cc:2272] T 21b175dff767436eabf366cd2f9f577e P ff1196b70e374829b6614c678280d4c7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.034791 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
W20260709 12:23:26.050171 12157 consensus_peers.cc:597] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 -> Peer ff1196b70e374829b6614c678280d4c7 (127.11.32.2:43119): Couldn't send request to peer ff1196b70e374829b6614c678280d4c7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:43119: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:26.056915 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
I20260709 12:23:26.084452 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:26.085126 11392 tablet_replica.cc:333] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.085822 11392 raft_consensus.cc:2243] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.086293 11392 raft_consensus.cc:2272] T 255b0a0f74454c46b86dbee4a7aae1ff P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.088430 11392 tablet_replica.cc:333] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.088902 11392 raft_consensus.cc:2243] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.089747 11392 raft_consensus.cc:2272] T f0d45cfb4a154eb28b9c371c4dff60d8 P 3667b9430fe64f37856b80152c57d816 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.091405 11392 tablet_replica.cc:333] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.091842 11392 raft_consensus.cc:2243] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.092209 11392 raft_consensus.cc:2272] T 464a9698c4b04879a0efe521162f3573 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.093901 11392 tablet_replica.cc:333] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.094339 11392 raft_consensus.cc:2243] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.094694 11392 raft_consensus.cc:2272] T 6278199a8b804b76b4e28acfd2647e63 P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.096264 11392 tablet_replica.cc:333] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.096699 11392 raft_consensus.cc:2243] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.097460 11392 raft_consensus.cc:2272] T 96e3816520ad4e7eba6699e4ec2e1fb5 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.099079 11392 tablet_replica.cc:333] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.099834 11392 raft_consensus.cc:2243] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.100267 11392 raft_consensus.cc:2272] T af236469d1cb44e38f2c48a7a6453bca P 3667b9430fe64f37856b80152c57d816 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.102391 11392 tablet_replica.cc:333] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.102942 11392 raft_consensus.cc:2243] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.103322 11392 raft_consensus.cc:2272] T 21b175dff767436eabf366cd2f9f577e P 3667b9430fe64f37856b80152c57d816 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.104970 11392 tablet_replica.cc:333] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.105464 11392 raft_consensus.cc:2243] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.105870 11392 raft_consensus.cc:2272] T 190254bd2ecd4ede959ca5426be31600 P 3667b9430fe64f37856b80152c57d816 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.107368 11392 tablet_replica.cc:333] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.107872 11392 raft_consensus.cc:2243] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.108556 11392 raft_consensus.cc:2272] T b4bb496f155b4032b16f7f3da5fc9dd5 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.110183 11392 tablet_replica.cc:333] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816: stopping tablet replica
I20260709 12:23:26.110560 11392 raft_consensus.cc:2243] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:26.110908 11392 raft_consensus.cc:2272] T 02ef01b8776b4d97a767df659f01cdb1 P 3667b9430fe64f37856b80152c57d816 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.140442 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
I20260709 12:23:26.162276 11392 master.cc:562] Master@127.11.32.62:36425 shutting down...
I20260709 12:23:26.188207 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:26.188869 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:26.189313 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a7d5794662a4ed6b482d14b942ba6f8: stopping tablet replica
I20260709 12:23:26.209161 11392 master.cc:584] Master@127.11.32.62:36425 shutdown complete.
065c054808064c2f8143eac1e1eb6079  5
3667b9430fe64f37856b80152c57d816  1
ff1196b70e374829b6614c678280d4c7  4
065c054808064c2f8143eac1e1eb6079  3
3667b9430fe64f37856b80152c57d816  3
ff1196b70e374829b6614c678280d4c7  4
065c054808064c2f8143eac1e1eb6079  8
3667b9430fe64f37856b80152c57d816  1
ff1196b70e374829b6614c678280d4c7  1
065c054808064c2f8143eac1e1eb6079  4
3667b9430fe64f37856b80152c57d816  3
ff1196b70e374829b6614c678280d4c7  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28859 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:23:26.253952 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:45335
I20260709 12:23:26.255568 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:26.262674 12432 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.262837 12433 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.263388 12435 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:26.265138 11392 server_base.cc:1061] running on GCE node
I20260709 12:23:26.266078 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:26.266301 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:26.266417 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599806266405 us; error 0 us; skew 500 ppm
I20260709 12:23:26.266861 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:26.269240 11392 webserver.cc:533] Webserver started at http://127.11.32.62:46639/ using document root <none> and password file <none>
I20260709 12:23:26.269737 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:26.269892 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:26.270128 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:26.271214 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.275652 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:26.279130 12440 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.279927 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:26.280242 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.280515 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:26.301232 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:26.302582 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:26.343093 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:45335
I20260709 12:23:26.343182 12491 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:45335 every 8 connection(s)
I20260709 12:23:26.347054 12492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:26.357326 12492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Bootstrap starting.
I20260709 12:23:26.361986 12492 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:26.366215 12492 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: No bootstrap required, opened a new log
I20260709 12:23:26.368441 12492 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" member_type: VOTER }
I20260709 12:23:26.368916 12492 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:26.369143 12492 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3f1cbd60b6244caaa2ca6d4aafd3dea2, State: Initialized, Role: FOLLOWER
I20260709 12:23:26.369760 12492 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" member_type: VOTER }
I20260709 12:23:26.370260 12492 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:26.370467 12492 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:26.370790 12492 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:26.374941 12492 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" member_type: VOTER }
I20260709 12:23:26.375572 12492 leader_election.cc:304] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3f1cbd60b6244caaa2ca6d4aafd3dea2; no voters: 
I20260709 12:23:26.376772 12492 leader_election.cc:290] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:26.377214 12495 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:26.378661 12495 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 1 LEADER]: Becoming Leader. State: Replica: 3f1cbd60b6244caaa2ca6d4aafd3dea2, State: Running, Role: LEADER
I20260709 12:23:26.379297 12495 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" member_type: VOTER }
I20260709 12:23:26.379909 12492 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:26.384083 12497 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3f1cbd60b6244caaa2ca6d4aafd3dea2. Latest consensus state: current_term: 1 leader_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" member_type: VOTER } }
I20260709 12:23:26.384902 12497 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:26.384707 12496 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3f1cbd60b6244caaa2ca6d4aafd3dea2" member_type: VOTER } }
I20260709 12:23:26.386080 12496 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:26.387506 12502 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:26.394270 12502 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:26.395469 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:26.403174 12502 catalog_manager.cc:1383] Generated new cluster ID: e644cc224a1f419c9a1f46aa0de92d7c
I20260709 12:23:26.403463 12502 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:26.425976 12502 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:26.427206 12502 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:26.443101 12502 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Generated new TSK 0
I20260709 12:23:26.443694 12502 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:26.462499 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:26.468755 12513 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.470100 12514 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.472144 12516 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:26.472204 11392 server_base.cc:1061] running on GCE node
I20260709 12:23:26.473263 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:26.473497 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:26.473675 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599806473638 us; error 0 us; skew 500 ppm
I20260709 12:23:26.474220 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:26.476416 11392 webserver.cc:533] Webserver started at http://127.11.32.1:45263/ using document root <none> and password file <none>
I20260709 12:23:26.476897 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:26.477088 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:26.477383 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:26.478524 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "23740bafdb794232879a0bb6884f7a68"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.483063 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:26.486372 12521 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.487037 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:26.487362 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "23740bafdb794232879a0bb6884f7a68"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.487635 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:26.510866 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:26.512127 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:26.513700 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:26.516006 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:26.516242 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.516494 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:26.516686 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.556411 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:45107
I20260709 12:23:26.556504 12583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:45107 every 8 connection(s)
I20260709 12:23:26.561293 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:26.568516 12588 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.569453 12589 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.572144 12591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:26.572613 11392 server_base.cc:1061] running on GCE node
I20260709 12:23:26.574502 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:23:26.574728 12584 heartbeater.cc:344] Connected to a master server at 127.11.32.62:45335
W20260709 12:23:26.574744 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:26.575183 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599806575159 us; error 0 us; skew 500 ppm
I20260709 12:23:26.575249 12584 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:26.576030 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:26.576236 12584 heartbeater.cc:507] Master 127.11.32.62:45335 requested a full tablet report, sending...
I20260709 12:23:26.578912 11392 webserver.cc:533] Webserver started at http://127.11.32.2:43261/ using document root <none> and password file <none>
I20260709 12:23:26.578919 12457 ts_manager.cc:194] Registered new tserver with Master: 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:26.579564 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:26.579802 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:26.580104 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:26.580917 12457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36664
I20260709 12:23:26.581329 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "a2a8d71f644447218c1afc3e5f7716cd"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.586323 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:23:26.589941 12596 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.590893 11392 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:23:26.591291 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "a2a8d71f644447218c1afc3e5f7716cd"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.591634 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:26.603888 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:26.605217 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:26.606822 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:26.609231 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:26.609503 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:23:26.609781 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:26.609980 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.651758 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:34669
I20260709 12:23:26.651845 12658 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:34669 every 8 connection(s)
I20260709 12:23:26.656935 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:26.665303 12663 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:26.668201 12662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:26.671926 12659 heartbeater.cc:344] Connected to a master server at 127.11.32.62:45335
I20260709 12:23:26.672379 12659 heartbeater.cc:461] Registering TS with master...
W20260709 12:23:26.672428 12665 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:26.673470 12659 heartbeater.cc:507] Master 127.11.32.62:45335 requested a full tablet report, sending...
I20260709 12:23:26.673622 11392 server_base.cc:1061] running on GCE node
I20260709 12:23:26.674600 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:26.674885 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:26.675130 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599806675106 us; error 0 us; skew 500 ppm
I20260709 12:23:26.675748 12457 ts_manager.cc:194] Registered new tserver with Master: a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:26.675954 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:26.677865 12457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46184
I20260709 12:23:26.678988 11392 webserver.cc:533] Webserver started at http://127.11.32.3:34879/ using document root <none> and password file <none>
I20260709 12:23:26.679601 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:26.679771 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:26.679975 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:26.681213 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "c6795b140b3247279a2231c6b9360d24"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.686019 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:23:26.689292 12670 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.690223 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:23:26.690541 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "c6795b140b3247279a2231c6b9360d24"
format_stamp: "Formatted at 2026-07-09 12:23:26 on dist-test-slave-sckv"
I20260709 12:23:26.690850 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:26.699225 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:26.700434 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:26.701968 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:26.704252 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:26.704459 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.704738 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:26.704916 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:26.744288 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:43633
I20260709 12:23:26.744395 12732 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:43633 every 8 connection(s)
I20260709 12:23:26.758072 12733 heartbeater.cc:344] Connected to a master server at 127.11.32.62:45335
I20260709 12:23:26.758484 12733 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:26.759232 12733 heartbeater.cc:507] Master 127.11.32.62:45335 requested a full tablet report, sending...
I20260709 12:23:26.761152 12457 ts_manager.cc:194] Registered new tserver with Master: c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:26.761986 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014441763s
I20260709 12:23:26.762929 12457 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:46190
I20260709 12:23:26.788902 12457 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:46196:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:26.795181 12457 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:27.042122 12698 tablet_service.cc:1511] Processing CreateTablet for tablet 4719532adf46473495ced717a908a078 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:27.044567 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719532adf46473495ced717a908a078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.045140 12695 tablet_service.cc:1511] Processing CreateTablet for tablet 20e379fdd40947f39c461038e088ea1a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:27.046592 12695 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e379fdd40947f39c461038e088ea1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.046820 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:27.048341 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.049860 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 613ed3057bf74d02a48d823635fd0b6a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:27.051491 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613ed3057bf74d02a48d823635fd0b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.051793 12549 tablet_service.cc:1511] Processing CreateTablet for tablet 4719532adf46473495ced717a908a078 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:27.055472 12694 tablet_service.cc:1511] Processing CreateTablet for tablet 936a02b62f0d46168b0550920bd53ed3 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:27.056795 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936a02b62f0d46168b0550920bd53ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.058948 12544 tablet_service.cc:1511] Processing CreateTablet for tablet af0709be9e0d4bf39ce083c7af243837 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:27.062179 12543 tablet_service.cc:1511] Processing CreateTablet for tablet 0afb49cf962a46388bf387ad7b344c39 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:27.066533 12548 tablet_service.cc:1511] Processing CreateTablet for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:27.069337 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 3f9ecf42cca34c34954029c3568e54b2 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:27.069620 12693 tablet_service.cc:1511] Processing CreateTablet for tablet af0709be9e0d4bf39ce083c7af243837 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:27.071023 12693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0709be9e0d4bf39ce083c7af243837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.072089 12541 tablet_service.cc:1511] Processing CreateTablet for tablet 1a59b6927edd4e21a78fe14b7acdad1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:27.074738 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca7fa9a22ba4b0b8300a42169fced1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:27.064855 12546 tablet_service.cc:1511] Processing CreateTablet for tablet 20e379fdd40947f39c461038e088ea1a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:27.078095 12547 tablet_service.cc:1511] Processing CreateTablet for tablet 613ed3057bf74d02a48d823635fd0b6a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:27.076172 12692 tablet_service.cc:1511] Processing CreateTablet for tablet 0afb49cf962a46388bf387ad7b344c39 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:27.080482 12691 tablet_service.cc:1511] Processing CreateTablet for tablet 3f9ecf42cca34c34954029c3568e54b2 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:27.055617 12545 tablet_service.cc:1511] Processing CreateTablet for tablet 936a02b62f0d46168b0550920bd53ed3 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:27.081269 12692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb49cf962a46388bf387ad7b344c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.082059 12691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9ecf42cca34c34954029c3568e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.076962 12549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719532adf46473495ced717a908a078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.087512 12690 tablet_service.cc:1511] Processing CreateTablet for tablet 1a59b6927edd4e21a78fe14b7acdad1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:27.088901 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a59b6927edd4e21a78fe14b7acdad1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.090718 12546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e379fdd40947f39c461038e088ea1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.091406 12548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.093286 12543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb49cf962a46388bf387ad7b344c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.095532 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7fa9a22ba4b0b8300a42169fced1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.097771 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9ecf42cca34c34954029c3568e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.101747 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a59b6927edd4e21a78fe14b7acdad1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.106793 12623 tablet_service.cc:1511] Processing CreateTablet for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:27.108439 12623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.109751 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0709be9e0d4bf39ce083c7af243837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.111305 12622 tablet_service.cc:1511] Processing CreateTablet for tablet 613ed3057bf74d02a48d823635fd0b6a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:27.112769 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613ed3057bf74d02a48d823635fd0b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.115119 12621 tablet_service.cc:1511] Processing CreateTablet for tablet 20e379fdd40947f39c461038e088ea1a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:27.116633 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20e379fdd40947f39c461038e088ea1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.119719 12547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613ed3057bf74d02a48d823635fd0b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.119594 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 936a02b62f0d46168b0550920bd53ed3 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:27.120401 12545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936a02b62f0d46168b0550920bd53ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.121161 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936a02b62f0d46168b0550920bd53ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.122440 12624 tablet_service.cc:1511] Processing CreateTablet for tablet 4719532adf46473495ced717a908a078 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:27.125178 12619 tablet_service.cc:1511] Processing CreateTablet for tablet af0709be9e0d4bf39ce083c7af243837 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:27.111304 12689 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca7fa9a22ba4b0b8300a42169fced1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:27.128528 12689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7fa9a22ba4b0b8300a42169fced1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.130909 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 0afb49cf962a46388bf387ad7b344c39 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:27.134135 12617 tablet_service.cc:1511] Processing CreateTablet for tablet 3f9ecf42cca34c34954029c3568e54b2 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:27.137650 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af0709be9e0d4bf39ce083c7af243837. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.140131 12624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719532adf46473495ced717a908a078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.141750 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb49cf962a46388bf387ad7b344c39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.144008 12617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9ecf42cca34c34954029c3568e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.162411 12694 tablet_service.cc:1511] Processing CreateTablet for tablet e25848d0a4024deda42b246d049b5be0 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:27.163837 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25848d0a4024deda42b246d049b5be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.179968 12696 tablet_service.cc:1511] Processing CreateTablet for tablet a10e3ca41dda44bc9e0c04ad3cc65f57 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:27.180622 12542 tablet_service.cc:1511] Processing CreateTablet for tablet e25848d0a4024deda42b246d049b5be0 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:27.182073 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10e3ca41dda44bc9e0c04ad3cc65f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.187606 12690 tablet_service.cc:1511] Processing CreateTablet for tablet e072821343d84e57b593eb6bc58c585a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:27.200348 12691 tablet_service.cc:1511] Processing CreateTablet for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:27.203192 12616 tablet_service.cc:1511] Processing CreateTablet for tablet 1a59b6927edd4e21a78fe14b7acdad1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:27.204607 12616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a59b6927edd4e21a78fe14b7acdad1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.205976 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072821343d84e57b593eb6bc58c585a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.206763 12615 tablet_service.cc:1511] Processing CreateTablet for tablet 2ca7fa9a22ba4b0b8300a42169fced1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:27.208125 12615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7fa9a22ba4b0b8300a42169fced1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.207854 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:27.208016 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:27.209067 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.262511 12692 tablet_service.cc:1511] Processing CreateTablet for tablet 85949dbea3b742fea0cb31dfc53d5766 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:27.264343 12692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85949dbea3b742fea0cb31dfc53d5766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.268770 12545 tablet_service.cc:1511] Processing CreateTablet for tablet a10e3ca41dda44bc9e0c04ad3cc65f57 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:27.271863 12544 tablet_service.cc:1511] Processing CreateTablet for tablet e072821343d84e57b593eb6bc58c585a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:27.307436 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 47430c4494f1431f8fb577cd8838f972 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:27.308662 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47430c4494f1431f8fb577cd8838f972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.280454 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25848d0a4024deda42b246d049b5be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.313189 12618 tablet_service.cc:1511] Processing CreateTablet for tablet e25848d0a4024deda42b246d049b5be0 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:27.313848 12549 tablet_service.cc:1511] Processing CreateTablet for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:27.314543 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e25848d0a4024deda42b246d049b5be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.315032 12549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.284977 12543 tablet_service.cc:1511] Processing CreateTablet for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:27.326786 12691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.328887 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 85949dbea3b742fea0cb31dfc53d5766 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:27.353883 12545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10e3ca41dda44bc9e0c04ad3cc65f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.345294 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.360275 12749 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:27.360898 12444 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 84626.3us
I20260709 12:23:27.365291 12548 tablet_service.cc:1511] Processing CreateTablet for tablet 47430c4494f1431f8fb577cd8838f972 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:27.367754 12617 tablet_service.cc:1511] Processing CreateTablet for tablet a10e3ca41dda44bc9e0c04ad3cc65f57 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:27.371347 12546 tablet_service.cc:1511] Processing CreateTablet for tablet e18a3c206d6646e69fba42e3b74572a6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:27.372980 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072821343d84e57b593eb6bc58c585a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.374112 12548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47430c4494f1431f8fb577cd8838f972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.379119 12750 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:27.383214 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85949dbea3b742fea0cb31dfc53d5766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.388944 12751 tablet_bootstrap.cc:492] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
W20260709 12:23:27.392449 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:27.395509 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:27.396809 12692 tablet_service.cc:1511] Processing CreateTablet for tablet e18a3c206d6646e69fba42e3b74572a6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:27.398211 12692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18a3c206d6646e69fba42e3b74572a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.399209 12698 tablet_service.cc:1511] Processing CreateTablet for tablet 140159e481364d9e99f0f034c42b7fda (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:27.400410 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140159e481364d9e99f0f034c42b7fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.409874 12623 tablet_service.cc:1511] Processing CreateTablet for tablet 85949dbea3b742fea0cb31dfc53d5766 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:27.395411 12622 tablet_service.cc:1511] Processing CreateTablet for tablet e072821343d84e57b593eb6bc58c585a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
W20260709 12:23:27.415299 12444 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52049.4us
I20260709 12:23:27.417752 12546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18a3c206d6646e69fba42e3b74572a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.423023 12543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.425516 12617 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10e3ca41dda44bc9e0c04ad3cc65f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.426132 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072821343d84e57b593eb6bc58c585a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.428781 12624 tablet_service.cc:1511] Processing CreateTablet for tablet 47430c4494f1431f8fb577cd8838f972 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:27.429714 12623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85949dbea3b742fea0cb31dfc53d5766. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.465768 12624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47430c4494f1431f8fb577cd8838f972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.475040 12750 tablet_bootstrap.cc:654] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.479267 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.482151 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 7f25843830014b4c8c5707696cddc7f0 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:27.483035 12751 tablet_bootstrap.cc:654] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.483461 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25843830014b4c8c5707696cddc7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.431020 12749 tablet_bootstrap.cc:654] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.438602 12621 tablet_service.cc:1511] Processing CreateTablet for tablet e18a3c206d6646e69fba42e3b74572a6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:27.486244 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18a3c206d6646e69fba42e3b74572a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.441509 12541 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5ce7f361ff45268f58f04272a4a5ef (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:27.455298 12616 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5ce7f361ff45268f58f04272a4a5ef (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:27.455821 12622 tablet_service.cc:1511] Processing CreateTablet for tablet 140159e481364d9e99f0f034c42b7fda (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:27.487664 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140159e481364d9e99f0f034c42b7fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.488235 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5ce7f361ff45268f58f04272a4a5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.489692 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 7f25843830014b4c8c5707696cddc7f0 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:27.490072 12692 tablet_service.cc:1511] Processing CreateTablet for tablet 9e5ce7f361ff45268f58f04272a4a5ef (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:27.490983 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25843830014b4c8c5707696cddc7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.491362 12692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5ce7f361ff45268f58f04272a4a5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.498066 12616 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e5ce7f361ff45268f58f04272a4a5ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.499821 12694 tablet_service.cc:1511] Processing CreateTablet for tablet 7f25843830014b4c8c5707696cddc7f0 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:27.503108 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25843830014b4c8c5707696cddc7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.504158 12620 tablet_service.cc:1511] Processing CreateTablet for tablet d457e0ba678747fba0ac2a4c1b42649e (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:27.505321 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d457e0ba678747fba0ac2a4c1b42649e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.505164 12691 tablet_service.cc:1511] Processing CreateTablet for tablet d457e0ba678747fba0ac2a4c1b42649e (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:27.506345 12691 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d457e0ba678747fba0ac2a4c1b42649e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.534272 12547 tablet_service.cc:1511] Processing CreateTablet for tablet 140159e481364d9e99f0f034c42b7fda (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:27.535651 12547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140159e481364d9e99f0f034c42b7fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.535763 12615 tablet_service.cc:1511] Processing CreateTablet for tablet 91e9b98dfcc94a4f87b33617aa6df487 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:27.536984 12615 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e9b98dfcc94a4f87b33617aa6df487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.547250 12698 tablet_service.cc:1511] Processing CreateTablet for tablet 33554b5715244a96b9faa863336bdc3b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:27.548523 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33554b5715244a96b9faa863336bdc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.558679 12693 tablet_service.cc:1511] Processing CreateTablet for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:27.560256 12693 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.562023 12545 tablet_service.cc:1511] Processing CreateTablet for tablet d457e0ba678747fba0ac2a4c1b42649e (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:27.563416 12545 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d457e0ba678747fba0ac2a4c1b42649e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.565737 12696 tablet_service.cc:1511] Processing CreateTablet for tablet ef8bfbfb91b54571bed5f5d44534395a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:27.572546 12751 tablet_bootstrap.cc:492] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:27.573042 12751 ts_tablet_manager.cc:1403] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.184s	user 0.009s	sys 0.022s
I20260709 12:23:27.576032 12751 raft_consensus.cc:359] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.577610 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 91e9b98dfcc94a4f87b33617aa6df487 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:27.578964 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e9b98dfcc94a4f87b33617aa6df487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.587666 12584 heartbeater.cc:499] Master 127.11.32.62:45335 was elected leader, sending a full tablet report...
I20260709 12:23:27.597790 12750 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:27.598263 12750 ts_tablet_manager.cc:1403] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.245s	user 0.023s	sys 0.017s
I20260709 12:23:27.598762 12623 tablet_service.cc:1511] Processing CreateTablet for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:27.600528 12623 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.603369 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 33554b5715244a96b9faa863336bdc3b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:27.605072 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33554b5715244a96b9faa863336bdc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.606729 12546 tablet_service.cc:1511] Processing CreateTablet for tablet ef8bfbfb91b54571bed5f5d44534395a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:27.608335 12546 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8bfbfb91b54571bed5f5d44534395a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.588480 12624 tablet_service.cc:1511] Processing CreateTablet for tablet ef8bfbfb91b54571bed5f5d44534395a (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:27.610427 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8bfbfb91b54571bed5f5d44534395a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.611148 12549 tablet_service.cc:1511] Processing CreateTablet for tablet 33554b5715244a96b9faa863336bdc3b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:27.611198 12548 tablet_service.cc:1511] Processing CreateTablet for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:27.585747 12751 raft_consensus.cc:385] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.613579 12751 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.613950 12549 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33554b5715244a96b9faa863336bdc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.596889 12543 tablet_service.cc:1511] Processing CreateTablet for tablet 91e9b98dfcc94a4f87b33617aa6df487 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:27.615002 12543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e9b98dfcc94a4f87b33617aa6df487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.615103 12751 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.617784 12624 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef8bfbfb91b54571bed5f5d44534395a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.623759 12689 tablet_service.cc:1511] Processing CreateTablet for tablet 04a769018c454aa685eae73d74c89abb (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:27.625003 12689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a769018c454aa685eae73d74c89abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.629884 12548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.635049 12690 tablet_service.cc:1511] Processing CreateTablet for tablet 902b0c6b28a040c9902fea6547ffaa9f (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:27.636521 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b0c6b28a040c9902fea6547ffaa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.637657 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 04a769018c454aa685eae73d74c89abb (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:27.638916 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a769018c454aa685eae73d74c89abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.601197 12750 raft_consensus.cc:359] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.641752 12750 raft_consensus.cc:385] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.642082 12750 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.643096 12750 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.673169 12659 heartbeater.cc:499] Master 127.11.32.62:45335 was elected leader, sending a full tablet report...
I20260709 12:23:27.678015 12749 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:27.681068 12749 ts_tablet_manager.cc:1403] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.321s	user 0.025s	sys 0.023s
I20260709 12:23:27.688253 12749 raft_consensus.cc:359] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:27.707396 12749 raft_consensus.cc:385] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.707815 12749 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.711773 12749 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:27.721163 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 902b0c6b28a040c9902fea6547ffaa9f (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:27.692651 12544 tablet_service.cc:1511] Processing CreateTablet for tablet 04a769018c454aa685eae73d74c89abb (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:27.722740 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a769018c454aa685eae73d74c89abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.706651 12547 tablet_service.cc:1511] Processing CreateTablet for tablet 0116b2408a7241828256061551a36f1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:27.697467 12751 ts_tablet_manager.cc:1434] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.124s	user 0.014s	sys 0.017s
I20260709 12:23:27.730409 12751 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:27.734115 12621 tablet_service.cc:1511] Processing CreateTablet for tablet 902b0c6b28a040c9902fea6547ffaa9f (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:27.734553 12548 tablet_service.cc:1511] Processing CreateTablet for tablet cd26860ea4e84bd7851de4aaa5d02f01 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:27.735430 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b0c6b28a040c9902fea6547ffaa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.736032 12755 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.736578 12755 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.737058 12751 tablet_bootstrap.cc:654] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.734138 12547 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0116b2408a7241828256061551a36f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.738046 12548 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd26860ea4e84bd7851de4aaa5d02f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.738960 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b0c6b28a040c9902fea6547ffaa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.753756 12619 tablet_service.cc:1511] Processing CreateTablet for tablet cd26860ea4e84bd7851de4aaa5d02f01 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:27.766418 12733 heartbeater.cc:499] Master 127.11.32.62:45335 was elected leader, sending a full tablet report...
I20260709 12:23:27.777603 12749 ts_tablet_manager.cc:1434] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.092s	user 0.010s	sys 0.017s
I20260709 12:23:27.778683 12749 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:27.779532 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 700a61b9aeed45869b2d882368e99824 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:27.781831 12756 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:27.782369 12756 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:27.783262 12541 tablet_service.cc:1511] Processing CreateTablet for tablet 700a61b9aeed45869b2d882368e99824 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:27.784672 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700a61b9aeed45869b2d882368e99824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.784986 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700a61b9aeed45869b2d882368e99824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.796670 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 0116b2408a7241828256061551a36f1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:27.754700 12755 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:27.798122 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0116b2408a7241828256061551a36f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.793347 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd26860ea4e84bd7851de4aaa5d02f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.802350 12694 tablet_service.cc:1511] Processing CreateTablet for tablet cd26860ea4e84bd7851de4aaa5d02f01 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:27.803606 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd26860ea4e84bd7851de4aaa5d02f01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.807509 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 0e137b72ba4847d6ad89da17af64db7d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:27.808707 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e137b72ba4847d6ad89da17af64db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.810209 12622 tablet_service.cc:1511] Processing CreateTablet for tablet 0116b2408a7241828256061551a36f1c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:27.811405 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0116b2408a7241828256061551a36f1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.813335 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 0e137b72ba4847d6ad89da17af64db7d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:27.814661 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e137b72ba4847d6ad89da17af64db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.822081 12756 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:27.851128 12749 tablet_bootstrap.cc:654] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.855504 12543 tablet_service.cc:1511] Processing CreateTablet for tablet 39edb149903d45b5a17cbbc4dd12850b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:27.856992 12543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39edb149903d45b5a17cbbc4dd12850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.874339 12750 ts_tablet_manager.cc:1434] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.276s	user 0.008s	sys 0.019s
I20260709 12:23:27.880674 12750 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
W20260709 12:23:27.919974 12660 tablet.cc:2406] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:27.923717 12750 tablet_bootstrap.cc:654] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:27.929308 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 2514eba211b3456c96ca755c4c7c084b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:27.937096 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:27.938527 12751 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:27.939229 12751 ts_tablet_manager.cc:1403] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.209s	user 0.015s	sys 0.002s
W20260709 12:23:27.942268 12598 leader_election.cc:343] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.932974 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2514eba211b3456c96ca755c4c7c084b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.951931 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 2514eba211b3456c96ca755c4c7c084b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:27.952126 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 700a61b9aeed45869b2d882368e99824 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:27.954299 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700a61b9aeed45869b2d882368e99824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.955688 12690 tablet_service.cc:1511] Processing CreateTablet for tablet 0e137b72ba4847d6ad89da17af64db7d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:27.956928 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e137b72ba4847d6ad89da17af64db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.959043 12692 tablet_service.cc:1511] Processing CreateTablet for tablet 39edb149903d45b5a17cbbc4dd12850b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:27.960000 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2514eba211b3456c96ca755c4c7c084b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.960242 12692 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39edb149903d45b5a17cbbc4dd12850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.966199 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:27.968055 12749 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:27.968551 12749 ts_tablet_manager.cc:1403] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.014s
W20260709 12:23:27.970620 12671 leader_election.cc:343] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.972005 12749 raft_consensus.cc:359] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.972942 12749 raft_consensus.cc:385] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.973232 12749 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.976662 12750 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:27.977164 12750 ts_tablet_manager.cc:1403] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.000s
I20260709 12:23:27.980010 12750 raft_consensus.cc:359] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.980693 12750 raft_consensus.cc:385] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.980979 12750 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:27.981837 12750 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.983945 12750 ts_tablet_manager.cc:1434] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:27.984819 12750 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:27.990221 12698 tablet_service.cc:1511] Processing CreateTablet for tablet 2514eba211b3456c96ca755c4c7c084b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:27.991535 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2514eba211b3456c96ca755c4c7c084b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.994640 12622 tablet_service.cc:1511] Processing CreateTablet for tablet d5554b3483384c14898b46be0dbd5ae5 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:27.992942 12751 raft_consensus.cc:359] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:27.995718 12751 raft_consensus.cc:385] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:27.995930 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5554b3483384c14898b46be0dbd5ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.999547 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:27.998041 12757 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.001313 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.001739 12757 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:28.002628 12674 leader_election.cc:343] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.003099 12674 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:28.003185 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 606f6695c1e84da291559cacabfa82bc (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:28.004483 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606f6695c1e84da291559cacabfa82bc. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:28.004662 12600 leader_election.cc:343] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:27.998199 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 606f6695c1e84da291559cacabfa82bc (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:28.005132 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:28.006747 12751 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.007401 12756 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.007778 12755 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.006369 12757 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.020849 12749 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.026373 12694 tablet_service.cc:1511] Processing CreateTablet for tablet d5554b3483384c14898b46be0dbd5ae5 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:28.027160 12749 ts_tablet_manager.cc:1434] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.058s	user 0.010s	sys 0.003s
I20260709 12:23:28.028033 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5554b3483384c14898b46be0dbd5ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.028415 12749 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:28.030067 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606f6695c1e84da291559cacabfa82bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.051576 12750 tablet_bootstrap.cc:654] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.051190 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 606f6695c1e84da291559cacabfa82bc (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:28.052980 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606f6695c1e84da291559cacabfa82bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:27.949285 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 39edb149903d45b5a17cbbc4dd12850b (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:28.055034 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39edb149903d45b5a17cbbc4dd12850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.007624 12751 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.072506 12749 tablet_bootstrap.cc:654] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.074141 12541 tablet_service.cc:1511] Processing CreateTablet for tablet d5554b3483384c14898b46be0dbd5ae5 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:28.078564 12751 ts_tablet_manager.cc:1434] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.138s	user 0.008s	sys 0.002s
I20260709 12:23:28.079504 12751 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:28.081588 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5554b3483384c14898b46be0dbd5ae5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.101573 12542 tablet_service.cc:1511] Processing CreateTablet for tablet c6a602467dda4cb0bbfb59098cf973c9 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:28.103056 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a602467dda4cb0bbfb59098cf973c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.103387 12544 tablet_service.cc:1511] Processing CreateTablet for tablet a6ad0911475a422ab0936b28dc4c93f1 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:28.104856 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:28.106453 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ad0911475a422ab0936b28dc4c93f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.106818 12620 tablet_service.cc:1511] Processing CreateTablet for tablet c6a602467dda4cb0bbfb59098cf973c9 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
W20260709 12:23:28.107302 12522 leader_election.cc:343] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.109680 12755 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.110159 12755 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.109889 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a602467dda4cb0bbfb59098cf973c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.110996 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.108369 12697 tablet_service.cc:1511] Processing CreateTablet for tablet c6a602467dda4cb0bbfb59098cf973c9 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:28.112236 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6a602467dda4cb0bbfb59098cf973c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.112293 12755 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:23:28.112653 12523 leader_election.cc:343] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.120215 12523 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:28.114518 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.121214 12757 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:28.122540 12600 leader_election.cc:343] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.115254 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.123407 12622 tablet_service.cc:1511] Processing CreateTablet for tablet a6ad0911475a422ab0936b28dc4c93f1 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
W20260709 12:23:28.124274 12598 leader_election.cc:343] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.124776 12622 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ad0911475a422ab0936b28dc4c93f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.124909 12598 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:28.127866 12755 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.134719 12540 tablet_service.cc:1511] Processing CreateTablet for tablet e19c569fe6e34f969a722bd2495c3a89 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:28.135556 12749 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:28.136039 12749 ts_tablet_manager.cc:1403] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.108s	user 0.019s	sys 0.009s
I20260709 12:23:28.136130 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c569fe6e34f969a722bd2495c3a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.147353 12619 tablet_service.cc:1511] Processing CreateTablet for tablet e19c569fe6e34f969a722bd2495c3a89 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:28.147795 12690 tablet_service.cc:1511] Processing CreateTablet for tablet e19c569fe6e34f969a722bd2495c3a89 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:28.148835 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c569fe6e34f969a722bd2495c3a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.149051 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c569fe6e34f969a722bd2495c3a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.150419 12750 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:28.150910 12750 ts_tablet_manager.cc:1403] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.166s	user 0.023s	sys 0.019s
I20260709 12:23:28.154114 12750 raft_consensus.cc:359] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.154898 12750 raft_consensus.cc:385] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.154944 12749 raft_consensus.cc:359] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.163045 12751 tablet_bootstrap.cc:654] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.164163 12698 tablet_service.cc:1511] Processing CreateTablet for tablet a6ad0911475a422ab0936b28dc4c93f1 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:28.178221 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ad0911475a422ab0936b28dc4c93f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.155773 12749 raft_consensus.cc:385] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.178679 12749 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.179612 12749 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.155345 12750 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.180879 12621 tablet_service.cc:1511] Processing CreateTablet for tablet 793f816912494728bf76dd612942dc4c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:28.181967 12750 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.182473 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793f816912494728bf76dd612942dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.182621 12749 ts_tablet_manager.cc:1434] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 12:23:28.183761 12749 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:28.184194 12750 ts_tablet_manager.cc:1434] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 12:23:28.190266 12750 tablet_bootstrap.cc:492] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:28.203140 12750 tablet_bootstrap.cc:654] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.203554 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 793f816912494728bf76dd612942dc4c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:28.206422 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793f816912494728bf76dd612942dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.206755 12751 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:28.207229 12751 ts_tablet_manager.cc:1403] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.012s
I20260709 12:23:28.210028 12751 raft_consensus.cc:359] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.210708 12751 raft_consensus.cc:385] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.210981 12751 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.211664 12751 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.216063 12749 tablet_bootstrap.cc:654] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.203505 12543 tablet_service.cc:1511] Processing CreateTablet for tablet 793f816912494728bf76dd612942dc4c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:28.218569 12543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793f816912494728bf76dd612942dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.225047 12690 tablet_service.cc:1511] Processing CreateTablet for tablet 23f3709af552426ebb55ecf39265cc47 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:28.226532 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f3709af552426ebb55ecf39265cc47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.228905 12544 tablet_service.cc:1511] Processing CreateTablet for tablet 7d75a6f40c324994a517c98816b2afc4 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:28.230158 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d75a6f40c324994a517c98816b2afc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.231207 12751 ts_tablet_manager.cc:1434] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:23:28.232278 12751 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:28.238481 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 23f3709af552426ebb55ecf39265cc47 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:28.239746 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f3709af552426ebb55ecf39265cc47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.242455 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 23f3709af552426ebb55ecf39265cc47 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:28.243723 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 23f3709af552426ebb55ecf39265cc47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.247704 12621 tablet_service.cc:1511] Processing CreateTablet for tablet 7d75a6f40c324994a517c98816b2afc4 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:28.248973 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d75a6f40c324994a517c98816b2afc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.253724 12749 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:28.254251 12749 ts_tablet_manager.cc:1403] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.004s
I20260709 12:23:28.261888 12751 tablet_bootstrap.cc:654] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.257355 12749 raft_consensus.cc:359] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.264056 12749 raft_consensus.cc:385] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.263839 12543 tablet_service.cc:1511] Processing CreateTablet for tablet d9812250f15d4075a3c8831ca5f3ed41 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:28.264446 12749 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.265247 12543 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9812250f15d4075a3c8831ca5f3ed41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.261732 12697 tablet_service.cc:1511] Processing CreateTablet for tablet 7d75a6f40c324994a517c98816b2afc4 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:28.267577 12697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d75a6f40c324994a517c98816b2afc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.267128 12749 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.269596 12749 ts_tablet_manager.cc:1434] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:23:28.269918 12756 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.270980 12750 tablet_bootstrap.cc:492] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:28.270486 12756 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.271454 12750 ts_tablet_manager.cc:1403] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.081s	user 0.010s	sys 0.008s
I20260709 12:23:28.271715 12749 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:28.274341 12750 raft_consensus.cc:359] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.274556 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.275089 12750 raft_consensus.cc:385] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.275451 12750 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.279886 12621 tablet_service.cc:1511] Processing CreateTablet for tablet d9812250f15d4075a3c8831ca5f3ed41 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:28.281708 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9812250f15d4075a3c8831ca5f3ed41. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:28.281963 12674 leader_election.cc:343] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.284989 12757 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.285713 12757 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.289585 12690 tablet_service.cc:1511] Processing CreateTablet for tablet d9812250f15d4075a3c8831ca5f3ed41 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:28.290925 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9812250f15d4075a3c8831ca5f3ed41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.290702 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:28.292744 12522 leader_election.cc:343] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.294441 12757 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.295650 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.296347 12708 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:28.297850 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:28.298645 12749 tablet_bootstrap.cc:654] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.299010 12757 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.301666 12757 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.302073 12757 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.306082 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:28.308034 12671 leader_election.cc:343] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.308691 12671 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:28.301056 12750 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.311151 12777 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.312036 12757 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.314800 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:28.315546 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 94aed3506ab5437b8943521ce387d9e4 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:23:28.316287 12522 leader_election.cc:343] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.317010 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aed3506ab5437b8943521ce387d9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.321534 12756 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:28.322994 12757 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.323943 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:28.324600 12708 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.324292 12698 tablet_service.cc:1511] Processing CreateTablet for tablet 94aed3506ab5437b8943521ce387d9e4 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:28.325764 12698 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aed3506ab5437b8943521ce387d9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.327922 12541 tablet_service.cc:1511] Processing CreateTablet for tablet 52ac1951d6d64447869208058e8755b6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:28.328889 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 52ac1951d6d64447869208058e8755b6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:28.329370 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ac1951d6d64447869208058e8755b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.330148 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ac1951d6d64447869208058e8755b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.330397 12750 ts_tablet_manager.cc:1434] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.059s	user 0.001s	sys 0.008s
I20260709 12:23:28.334285 12750 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:28.338012 12708 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:28.339231 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:28.340093 12757 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.340566 12757 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:28.341463 12757 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.347153 12544 tablet_service.cc:1511] Processing CreateTablet for tablet 94aed3506ab5437b8943521ce387d9e4 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:28.348592 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aed3506ab5437b8943521ce387d9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.351815 12750 tablet_bootstrap.cc:654] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.356591 12690 tablet_service.cc:1511] Processing CreateTablet for tablet 52ac1951d6d64447869208058e8755b6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:28.356591 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 75aab4686614449489ce5c08d0860bd6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:28.362324 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75aab4686614449489ce5c08d0860bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.367658 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 75aab4686614449489ce5c08d0860bd6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:28.368961 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75aab4686614449489ce5c08d0860bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.359289 12620 tablet_service.cc:1511] Processing CreateTablet for tablet 75aab4686614449489ce5c08d0860bd6 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:28.374331 12755 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.374981 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ac1951d6d64447869208058e8755b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.374845 12755 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.377017 12755 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.378860 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.381080 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:23:28.383116 12598 leader_election.cc:343] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.383607 12751 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
W20260709 12:23:28.383893 12600 leader_election.cc:343] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.384066 12751 ts_tablet_manager.cc:1403] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.035s
I20260709 12:23:28.384356 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:28.385123 12620 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75aab4686614449489ce5c08d0860bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.386308 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 5548d773e7254d74bd88a9092bf7567d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:28.387253 12749 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:28.387053 12751 raft_consensus.cc:359] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.387720 12749 ts_tablet_manager.cc:1403] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.116s	user 0.007s	sys 0.012s
I20260709 12:23:28.387805 12751 raft_consensus.cc:385] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.388154 12751 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.390856 12749 raft_consensus.cc:359] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.387540 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5548d773e7254d74bd88a9092bf7567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.391607 12749 raft_consensus.cc:385] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.391911 12749 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.393190 12755 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.392819 12749 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.393756 12618 tablet_service.cc:1511] Processing CreateTablet for tablet 5548d773e7254d74bd88a9092bf7567d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:28.404796 12618 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5548d773e7254d74bd88a9092bf7567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.405720 12749 ts_tablet_manager.cc:1434] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.001s
I20260709 12:23:28.406868 12749 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:28.395182 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:28.411167 12619 tablet_service.cc:1511] Processing CreateTablet for tablet d472a3f71a5d430fafa4a535ed826f18 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:28.412441 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d472a3f71a5d430fafa4a535ed826f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.394819 12751 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.394670 12455 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.423821 12751 ts_tablet_manager.cc:1434] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.002s
I20260709 12:23:28.425097 12751 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:28.454339 12690 tablet_service.cc:1511] Processing CreateTablet for tablet d472a3f71a5d430fafa4a535ed826f18 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:28.455525 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d472a3f71a5d430fafa4a535ed826f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.455304 12544 tablet_service.cc:1511] Processing CreateTablet for tablet d472a3f71a5d430fafa4a535ed826f18 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:28.456046 12540 tablet_service.cc:1511] Processing CreateTablet for tablet 8acfb123196f471d9fa81328e89997cc (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:28.456463 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d472a3f71a5d430fafa4a535ed826f18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.457286 12540 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acfb123196f471d9fa81328e89997cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.450486 12755 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.458026 12755 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.460005 12755 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.462114 12694 tablet_service.cc:1511] Processing CreateTablet for tablet 8acfb123196f471d9fa81328e89997cc (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:28.463405 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acfb123196f471d9fa81328e89997cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.463213 12621 tablet_service.cc:1511] Processing CreateTablet for tablet c5facffc88a94bc58f10135f6686804c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:28.464342 12749 tablet_bootstrap.cc:654] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.464924 12751 tablet_bootstrap.cc:654] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.464398 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5facffc88a94bc58f10135f6686804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.468842 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.469455 12559 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:28.471601 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 8acfb123196f471d9fa81328e89997cc (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:28.476776 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8acfb123196f471d9fa81328e89997cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.476886 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:28.481149 12755 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.480949 12542 tablet_service.cc:1511] Processing CreateTablet for tablet c5facffc88a94bc58f10135f6686804c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:28.481539 12755 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.481943 12755 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.482280 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5facffc88a94bc58f10135f6686804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.482421 12750 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:28.482954 12750 ts_tablet_manager.cc:1403] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.149s	user 0.017s	sys 0.028s
I20260709 12:23:28.472550 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.485809 12708 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:28.485977 12750 raft_consensus.cc:359] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.494422 12755 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.496461 12755 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.497473 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:28.498075 12559 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.498322 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:28.498961 12708 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.499394 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 5548d773e7254d74bd88a9092bf7567d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:28.499850 12690 tablet_service.cc:1511] Processing CreateTablet for tablet c5facffc88a94bc58f10135f6686804c (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:28.500700 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5548d773e7254d74bd88a9092bf7567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.501278 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5facffc88a94bc58f10135f6686804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.505190 12559 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:28.506225 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:28.507042 12755 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.507300 12708 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:28.509476 12541 tablet_service.cc:1511] Processing CreateTablet for tablet 74acfff7189b45af8e177ff563645d9d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:28.511665 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74acfff7189b45af8e177ff563645d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.486791 12750 raft_consensus.cc:385] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.513556 12750 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.514497 12750 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.525633 12750 ts_tablet_manager.cc:1434] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 12:23:28.526880 12750 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:28.541138 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 74acfff7189b45af8e177ff563645d9d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:28.542493 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74acfff7189b45af8e177ff563645d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.552878 12750 tablet_bootstrap.cc:654] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.561015 12751 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:28.561599 12751 ts_tablet_manager.cc:1403] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.137s	user 0.011s	sys 0.005s
I20260709 12:23:28.550931 12755 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:28.563851 12755 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.564702 12749 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:28.565193 12749 ts_tablet_manager.cc:1403] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.159s	user 0.001s	sys 0.017s
I20260709 12:23:28.564788 12751 raft_consensus.cc:359] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.565644 12751 raft_consensus.cc:385] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.565995 12751 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.568400 12749 raft_consensus.cc:359] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.569074 12749 raft_consensus.cc:385] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.569372 12749 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.570132 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 28c65936613f4ee89e3dc89d06a91776 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:28.570942 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 74acfff7189b45af8e177ff563645d9d (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:28.571210 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c65936613f4ee89e3dc89d06a91776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.572046 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74acfff7189b45af8e177ff563645d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.573849 12749 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.576381 12749 ts_tablet_manager.cc:1434] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.011s	user 0.001s	sys 0.003s
I20260709 12:23:28.569384 12751 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.581869 12749 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:28.584306 12750 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:28.584791 12750 ts_tablet_manager.cc:1403] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.003s
I20260709 12:23:28.587749 12750 raft_consensus.cc:359] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.591389 12750 raft_consensus.cc:385] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.591708 12750 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.591413 12751 ts_tablet_manager.cc:1434] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 12:23:28.588819 12621 tablet_service.cc:1511] Processing CreateTablet for tablet 28c65936613f4ee89e3dc89d06a91776 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:28.594439 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c65936613f4ee89e3dc89d06a91776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.594475 12751 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:28.596724 12544 tablet_service.cc:1511] Processing CreateTablet for tablet c8dc26a51db24f54ad0e0272c06d9306 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:28.598115 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dc26a51db24f54ad0e0272c06d9306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.598776 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 28c65936613f4ee89e3dc89d06a91776 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:28.592423 12750 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.602399 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c65936613f4ee89e3dc89d06a91776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.603849 12750 ts_tablet_manager.cc:1434] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260709 12:23:28.589881 12749 tablet_bootstrap.cc:654] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.604842 12750 tablet_bootstrap.cc:492] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:28.614037 12619 tablet_service.cc:1511] Processing CreateTablet for tablet c8dc26a51db24f54ad0e0272c06d9306 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:28.615298 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dc26a51db24f54ad0e0272c06d9306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.616387 12756 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.617084 12756 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.621202 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.622251 12559 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:28.624125 12674 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:28.624773 12751 tablet_bootstrap.cc:654] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.625263 12777 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.625733 12777 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.626163 12777 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.627110 12757 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.627784 12757 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.631916 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:28.632539 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.633216 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:28.643488 12671 leader_election.cc:343] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.633946 12757 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.634943 12756 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:23:28.642360 12523 leader_election.cc:343] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.645745 12690 tablet_service.cc:1511] Processing CreateTablet for tablet c8dc26a51db24f54ad0e0272c06d9306 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:28.650594 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dc26a51db24f54ad0e0272c06d9306. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:28.654531 12522 leader_election.cc:343] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.655166 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:28.656555 12757 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.659600 12777 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.665553 12544 tablet_service.cc:1511] Processing CreateTablet for tablet c12120af627b4866b9f483d6cd9f30f5 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:28.667163 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12120af627b4866b9f483d6cd9f30f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.687155 12750 tablet_bootstrap.cc:654] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.687446 12757 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.688344 12621 tablet_service.cc:1511] Processing CreateTablet for tablet c12120af627b4866b9f483d6cd9f30f5 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:28.690095 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:28.751173 12544 tablet_service.cc:1511] Processing CreateTablet for tablet f768a2094f5744cfa0dec019647ccb13 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:28.749855 12455 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.758282 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f768a2094f5744cfa0dec019647ccb13. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:28.758162 12671 leader_election.cc:343] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.726565 12696 tablet_service.cc:1511] Processing CreateTablet for tablet c12120af627b4866b9f483d6cd9f30f5 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:28.761030 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12120af627b4866b9f483d6cd9f30f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.761701 12750 tablet_bootstrap.cc:492] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:28.762178 12750 ts_tablet_manager.cc:1403] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.158s	user 0.023s	sys 0.052s
I20260709 12:23:28.764927 12750 raft_consensus.cc:359] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.722878 12777 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:28.765674 12750 raft_consensus.cc:385] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.690035 12757 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.765980 12750 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.767006 12751 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:28.767259 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c12120af627b4866b9f483d6cd9f30f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.766868 12750 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.767722 12751 ts_tablet_manager.cc:1403] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.009s
I20260709 12:23:28.769107 12750 ts_tablet_manager.cc:1434] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:28.771786 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:28.771916 12751 raft_consensus.cc:359] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.772460 12633 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:28.772679 12751 raft_consensus.cc:385] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.773031 12751 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.773536 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.773870 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:28.774797 12778 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:28.775058 12523 leader_election.cc:343] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.775143 12778 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.775523 12778 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.747888 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:28.776144 12559 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.781193 12751 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.783916 12751 ts_tablet_manager.cc:1434] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:23:28.783542 12778 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.784991 12751 tablet_bootstrap.cc:492] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:28.786321 12750 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:28.786842 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:28.787377 12633 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.789944 12755 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.790444 12755 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.794523 12619 tablet_service.cc:1511] Processing CreateTablet for tablet f768a2094f5744cfa0dec019647ccb13 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:28.796033 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f768a2094f5744cfa0dec019647ccb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.797664 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.798511 12558 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:28.801043 12778 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.801250 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:28.801838 12778 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.802524 12784 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.802444 12778 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.803094 12784 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.803875 12784 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.804136 12757 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.827310 12750 tablet_bootstrap.cc:654] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.828799 12751 tablet_bootstrap.cc:654] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:28.831790 12633 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:28.832659 12749 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:28.837803 12749 ts_tablet_manager.cc:1403] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.257s	user 0.034s	sys 0.052s
I20260709 12:23:28.833066 12755 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.838476 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:28.834388 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.840866 12749 raft_consensus.cc:359] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.841854 12749 raft_consensus.cc:385] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.842259 12749 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.843379 12794 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.836460 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:28.835017 12778 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:23:28.846732 12598 leader_election.cc:343] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.847882 12749 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:28.849046 12522 leader_election.cc:343] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.850232 12749 ts_tablet_manager.cc:1434] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
W20260709 12:23:28.851842 12522 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:28.853370 12749 tablet_bootstrap.cc:492] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:28.862604 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:28.865638 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.867869 12794 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:28.868789 12794 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.869750 12696 tablet_service.cc:1511] Processing CreateTablet for tablet f768a2094f5744cfa0dec019647ccb13 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:28.871043 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f768a2094f5744cfa0dec019647ccb13. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.872164 12749 tablet_bootstrap.cc:654] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:28.873940 12523 leader_election.cc:343] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.874279 12755 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.875661 12755 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:28.877640 12523 leader_election.cc:343] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.877976 12755 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.883198 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:28.883203 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:28.884713 12708 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:28.887151 12598 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:23:28.888099 12600 leader_election.cc:343] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.888612 12542 tablet_service.cc:1511] Processing CreateTablet for tablet 9257ace92110474f9ba7f25a16b03161 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:28.889081 12755 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.889554 12755 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.889871 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9257ace92110474f9ba7f25a16b03161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.889957 12755 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.878147 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:28.897679 12751 tablet_bootstrap.cc:492] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:28.898259 12751 ts_tablet_manager.cc:1403] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.113s	user 0.026s	sys 0.029s
I20260709 12:23:28.898310 12797 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:28.898772 12755 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.900942 12755 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.902137 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:23:28.904035 12600 leader_election.cc:343] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.904945 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:28.905625 12708 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.905279 12619 tablet_service.cc:1511] Processing CreateTablet for tablet 9257ace92110474f9ba7f25a16b03161 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:28.906234 12797 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:28.906718 12619 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9257ace92110474f9ba7f25a16b03161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.912225 12696 tablet_service.cc:1511] Processing CreateTablet for tablet 9257ace92110474f9ba7f25a16b03161 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:28.913528 12784 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.916039 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9257ace92110474f9ba7f25a16b03161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.920470 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:28.921169 12558 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:28.920847 12621 tablet_service.cc:1511] Processing CreateTablet for tablet f8bd8b4df5594ab89b5028f708332757 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:28.922655 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bd8b4df5594ab89b5028f708332757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.930609 12751 raft_consensus.cc:359] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.931548 12751 raft_consensus.cc:385] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:28.931897 12751 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:28.935458 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:28.936643 12708 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:28.910303 12559 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
W20260709 12:23:28.938519 12598 leader_election.cc:343] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:28.939035 12542 tablet_service.cc:1511] Processing CreateTablet for tablet f8bd8b4df5594ab89b5028f708332757 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:28.939260 12598 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:28.940297 12542 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bd8b4df5594ab89b5028f708332757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.940177 12755 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.941247 12674 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:28.942469 12777 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:28.932832 12751 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.946487 12797 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:28.942989 12777 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:28.947124 12797 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.947741 12777 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:28.950778 12750 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:28.951272 12750 ts_tablet_manager.cc:1403] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.165s	user 0.035s	sys 0.030s
I20260709 12:23:28.945811 12784 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.982189 12749 tablet_bootstrap.cc:492] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:28.982846 12749 ts_tablet_manager.cc:1403] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.130s	user 0.006s	sys 0.023s
I20260709 12:23:28.987608 12797 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:28.987536 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:28.988343 12633 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:28.989852 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:28.990810 12778 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:28.991266 12778 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:28.991632 12778 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:28.993196 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52052.8us
I20260709 12:23:28.996659 12690 tablet_service.cc:1511] Processing CreateTablet for tablet f8bd8b4df5594ab89b5028f708332757 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:28.998113 12690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bd8b4df5594ab89b5028f708332757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:28.994952 12749 raft_consensus.cc:359] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.001464 12749 raft_consensus.cc:385] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.001051 12751 ts_tablet_manager.cc:1434] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.002s
I20260709 12:23:29.001799 12749 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.002558 12749 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.003717 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:29.004393 12708 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:29.004726 12544 tablet_service.cc:1511] Processing CreateTablet for tablet 08834ef951b049b39c60e46c2ed865e9 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:29.006170 12544 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08834ef951b049b39c60e46c2ed865e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.008855 12558 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:29.010497 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:29.012787 12801 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.013592 12784 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.013336 12801 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:29.015266 12749 ts_tablet_manager.cc:1434] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.001s
I20260709 12:23:29.015928 12801 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.016619 12749 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.017480 12755 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:29.018445 12755 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.022809 12750 raft_consensus.cc:359] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.023545 12750 raft_consensus.cc:385] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.023838 12750 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.024670 12750 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.025146 12749 tablet_bootstrap.cc:654] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.028568 12750 ts_tablet_manager.cc:1434] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.008s
I20260709 12:23:29.029927 12751 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.013077 12778 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.036526 12621 tablet_service.cc:1511] Processing CreateTablet for tablet 08834ef951b049b39c60e46c2ed865e9 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:29.037853 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08834ef951b049b39c60e46c2ed865e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.038686 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:29.039382 12633 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.046881 12633 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:29.048204 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:29.049830 12778 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.050436 12778 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.050930 12778 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:29.050815 12694 tablet_service.cc:1511] Processing CreateTablet for tablet 08834ef951b049b39c60e46c2ed865e9 (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:29.051896 12778 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.052752 12694 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08834ef951b049b39c60e46c2ed865e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.055160 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:29.056015 12708 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.056402 12757 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.057032 12757 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.063441 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:29.064165 12707 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:29.059336 12757 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.067371 12750 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:29.075837 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:29.079154 12794 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.079574 12794 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.079953 12794 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.080327 12541 tablet_service.cc:1511] Processing CreateTablet for tablet bc86699922844edbae89cb65c328e3ce (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:29.094668 12541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc86699922844edbae89cb65c328e3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.099215 12751 tablet_bootstrap.cc:654] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.102419 12457 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.103758 12801 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.081912 12777 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.106936 12777 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.105249 12621 tablet_service.cc:1511] Processing CreateTablet for tablet bc86699922844edbae89cb65c328e3ce (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:29.111295 12621 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc86699922844edbae89cb65c328e3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.111225 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:23:29.112854 12674 leader_election.cc:343] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.114812 12696 tablet_service.cc:1511] Processing CreateTablet for tablet bc86699922844edbae89cb65c328e3ce (DEFAULT_TABLE table=test-workload [id=7046dbd9643147cdb517cae3b4d0d344]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:29.116572 12696 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc86699922844edbae89cb65c328e3ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:29.123420 12777 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.124325 12455 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.091225 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.132484 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.135705 12708 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:29.135396 12794 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.139413 12456 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:29.142221 12522 leader_election.cc:343] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.143005 12749 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.143491 12749 ts_tablet_manager.cc:1403] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.127s	user 0.038s	sys 0.034s
W20260709 12:23:29.144985 12671 leader_election.cc:343] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.145645 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:29.146199 12749 raft_consensus.cc:359] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.146936 12749 raft_consensus.cc:385] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.147146 12777 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.152702 12750 tablet_bootstrap.cc:654] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.159737 12777 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.147228 12749 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.160285 12777 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.163698 12794 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.163805 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:29.164685 12708 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.164664 12749 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.167750 12749 ts_tablet_manager.cc:1434] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.024s	user 0.008s	sys 0.000s
I20260709 12:23:29.169032 12749 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.169817 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:23:29.173538 12522 leader_election.cc:343] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.218513 12708 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:29.220232 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:29.220703 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.221112 12778 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.221400 12559 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:29.221627 12778 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:29.222769 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:29.222565 12778 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.226009 12749 tablet_bootstrap.cc:654] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.227516 12756 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.227938 12756 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.228302 12756 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.228758 12751 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:29.229200 12751 ts_tablet_manager.cc:1403] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.200s	user 0.025s	sys 0.016s
I20260709 12:23:29.229799 12777 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.231913 12751 raft_consensus.cc:359] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.232589 12751 raft_consensus.cc:385] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.233727 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.232857 12751 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.234357 12634 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:29.235132 12751 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.238207 12751 ts_tablet_manager.cc:1434] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.001s
I20260709 12:23:29.239092 12751 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.240442 12456 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.243085 12750 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:29.243794 12750 ts_tablet_manager.cc:1403] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.177s	user 0.019s	sys 0.001s
I20260709 12:23:29.247349 12756 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.248124 12749 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.248618 12749 ts_tablet_manager.cc:1403] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.080s	user 0.014s	sys 0.002s
I20260709 12:23:29.249751 12751 tablet_bootstrap.cc:654] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.251860 12749 raft_consensus.cc:359] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.252133 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:29.252612 12749 raft_consensus.cc:385] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.253060 12749 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.254076 12749 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.256906 12749 ts_tablet_manager.cc:1434] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:29.258149 12749 tablet_bootstrap.cc:492] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.264246 12455 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:29.252767 12559 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.273659 12749 tablet_bootstrap.cc:654] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.279464 12749 tablet_bootstrap.cc:492] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.279939 12749 ts_tablet_manager.cc:1403] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.005s
I20260709 12:23:29.283010 12749 raft_consensus.cc:359] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.283131 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:29.283835 12749 raft_consensus.cc:385] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.284044 12634 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.284173 12749 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.284188 12456 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.285144 12749 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.287364 12749 ts_tablet_manager.cc:1434] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:29.293505 12756 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.294745 12749 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.298458 12559 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:29.300302 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:29.301574 12749 tablet_bootstrap.cc:654] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.301736 12756 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:29.280386 12750 raft_consensus.cc:359] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.302896 12750 raft_consensus.cc:385] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.303186 12750 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.304160 12756 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:29.305290 12756 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.307691 12750 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.313264 12750 ts_tablet_manager.cc:1434] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.069s	user 0.004s	sys 0.002s
I20260709 12:23:29.314469 12750 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:29.320639 12634 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:29.333017 12750 tablet_bootstrap.cc:654] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.333921 12751 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:29.334425 12751 ts_tablet_manager.cc:1403] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.096s	user 0.032s	sys 0.054s
I20260709 12:23:29.337582 12751 raft_consensus.cc:359] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.338486 12751 raft_consensus.cc:385] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.338832 12751 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.339886 12751 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.344172 12750 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:29.344612 12750 ts_tablet_manager.cc:1403] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.002s
I20260709 12:23:29.345929 12751 ts_tablet_manager.cc:1434] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:23:29.346813 12751 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.347131 12750 raft_consensus.cc:359] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.347766 12750 raft_consensus.cc:385] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.348017 12750 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.348826 12750 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.351229 12750 ts_tablet_manager.cc:1434] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:23:29.352731 12751 tablet_bootstrap.cc:654] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.354753 12456 catalog_manager.cc:5697] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:29.360620 12750 tablet_bootstrap.cc:492] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:29.368741 12749 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.369486 12749 ts_tablet_manager.cc:1403] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.075s	user 0.034s	sys 0.031s
I20260709 12:23:29.371788 12750 tablet_bootstrap.cc:654] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.372414 12749 raft_consensus.cc:359] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.374830 12749 raft_consensus.cc:385] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.375172 12749 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.376120 12749 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.377329 12751 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:29.377820 12751 ts_tablet_manager.cc:1403] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.017s
I20260709 12:23:29.378901 12749 ts_tablet_manager.cc:1434] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:23:29.380128 12750 tablet_bootstrap.cc:492] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:29.380190 12749 tablet_bootstrap.cc:492] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.380738 12750 ts_tablet_manager.cc:1403] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.000s
I20260709 12:23:29.380409 12751 raft_consensus.cc:359] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.381155 12751 raft_consensus.cc:385] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.381464 12751 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.382789 12751 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.384676 12750 raft_consensus.cc:359] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.385380 12750 raft_consensus.cc:385] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.385742 12750 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.386545 12750 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.387576 12749 tablet_bootstrap.cc:654] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.392660 12751 ts_tablet_manager.cc:1434] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:29.397185 12750 ts_tablet_manager.cc:1434] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260709 12:23:29.398188 12751 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.401584 12749 tablet_bootstrap.cc:492] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.402010 12749 ts_tablet_manager.cc:1403] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 12:23:29.403980 12749 raft_consensus.cc:359] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.404520 12749 raft_consensus.cc:385] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.404624 12751 tablet_bootstrap.cc:654] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.404842 12749 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.405632 12750 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:29.405714 12749 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.412266 12750 tablet_bootstrap.cc:654] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.412287 12749 ts_tablet_manager.cc:1434] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.001s
I20260709 12:23:29.413473 12749 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.421386 12749 tablet_bootstrap.cc:654] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:29.425079 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:29.428676 12751 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:29.429206 12751 ts_tablet_manager.cc:1403] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.008s
I20260709 12:23:29.431044 12750 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:29.431102 12749 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.431608 12750 ts_tablet_manager.cc:1403] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.016s
I20260709 12:23:29.431707 12749 ts_tablet_manager.cc:1403] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260709 12:23:29.432101 12751 raft_consensus.cc:359] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.432646 12755 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.432862 12751 raft_consensus.cc:385] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.433231 12751 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.433130 12755 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } }
I20260709 12:23:29.434064 12751 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.434486 12750 raft_consensus.cc:359] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.435271 12750 raft_consensus.cc:385] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.435304 12755 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:29.434805 12749 raft_consensus.cc:359] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.435702 12750 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.435868 12749 raft_consensus.cc:385] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.436214 12749 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.436311 12751 ts_tablet_manager.cc:1434] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:29.436470 12750 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.437089 12749 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.438273 12751 tablet_bootstrap.cc:492] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.439112 12750 ts_tablet_manager.cc:1434] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:29.440062 12749 ts_tablet_manager.cc:1434] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:29.440213 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:29.440977 12707 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:29.441254 12749 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:29.440071 12750 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:29.445325 12751 tablet_bootstrap.cc:654] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.447255 12749 tablet_bootstrap.cc:654] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.447189 12634 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.451051 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.453565 12600 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:29.455310 12755 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.455845 12707 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.469564 12756 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.478221 12755 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.481834 12751 tablet_bootstrap.cc:492] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:29.482411 12751 ts_tablet_manager.cc:1403] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.035s
I20260709 12:23:29.482326 12778 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.482949 12778 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.484643 12750 tablet_bootstrap.cc:654] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.486280 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.492362 12778 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.499920 12794 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.501746 12756 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.502390 12756 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.507767 12751 raft_consensus.cc:359] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.508808 12751 raft_consensus.cc:385] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.509266 12751 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.510722 12751 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.508615 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:29.513252 12707 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:29.514374 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.515347 12559 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:29.518062 12751 ts_tablet_manager.cc:1434] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.001s
I20260709 12:23:29.519387 12751 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.527141 12798 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.529210 12798 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.529906 12798 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.531613 12523 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:29.532706 12757 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.505045 12756 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.535328 12756 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.536516 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.540697 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.541628 12633 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:29.543390 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:29.545639 12778 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.546178 12778 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.546659 12778 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.551857 12749 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:29.552399 12749 ts_tablet_manager.cc:1403] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.111s	user 0.031s	sys 0.040s
I20260709 12:23:29.563365 12751 tablet_bootstrap.cc:654] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.564527 12794 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.557265 12755 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 12:23:29.568081 12757 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.569053 12757 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.577003 12757 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:29.574498 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62832.9us
I20260709 12:23:29.581620 12798 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.586311 12750 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:29.586782 12750 ts_tablet_manager.cc:1403] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.147s	user 0.024s	sys 0.046s
I20260709 12:23:29.590842 12750 raft_consensus.cc:359] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.591765 12750 raft_consensus.cc:385] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.592104 12750 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.583241 12794 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.593744 12750 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.598973 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:29.600663 12523 leader_election.cc:343] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.605810 12794 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.606604 12755 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:29.608652 12794 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.610502 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:29.611393 12706 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:29.613245 12523 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:29.613638 12835 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.614310 12835 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.619077 12835 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.621125 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.623023 12634 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:29.629936 12757 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.630045 12798 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.630395 12671 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:29.630712 12798 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.631121 12798 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.631907 12674 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:29.632931 12705 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.634009 12835 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:29.634440 12835 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:29.634828 12835 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:29.618719 12778 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.646641 12750 ts_tablet_manager.cc:1434] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.001s
I20260709 12:23:29.787814 12750 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:29.790074 12751 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:29.790604 12751 ts_tablet_manager.cc:1403] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.271s	user 0.024s	sys 0.029s
I20260709 12:23:29.793290 12751 raft_consensus.cc:359] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.794135 12751 raft_consensus.cc:385] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.794478 12751 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.796109 12751 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.796411 12777 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:29.796958 12750 tablet_bootstrap.cc:654] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.707604 12836 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.799594 12836 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.801656 12749 raft_consensus.cc:359] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.802577 12749 raft_consensus.cc:385] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:29.802917 12749 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:29.803848 12749 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.686245 12802 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.125s
I20260709 12:23:29.814803 12798 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:29.677486 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 77928.7us
I20260709 12:23:29.818648 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:29.819361 12706 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:29.647071 12756 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.678095 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.820218 12756 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.820842 12556 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:29.821925 12801 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.822228 12756 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.822703 12756 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.822427 12801 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.823119 12756 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.824383 12801 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.824944 12756 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.826622 12778 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.817132 12798 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.832795 12843 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.837976 12843 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.841399 12843 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:29.843065 12836 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:29.848907 12749 ts_tablet_manager.cc:1434] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.296s	user 0.016s	sys 0.003s
I20260709 12:23:29.850194 12749 tablet_bootstrap.cc:492] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:29.856551 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 119599us
I20260709 12:23:29.857389 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.857770 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.859210 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.859790 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.860471 12634 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:29.859874 12631 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:29.861295 12847 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:29.862362 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.867126 12750 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:29.851444 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.873745 12749 tablet_bootstrap.cc:654] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:29.876454 12751 ts_tablet_manager.cc:1434] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.086s	user 0.022s	sys 0.019s
I20260709 12:23:29.879629 12835 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.953094 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:29.883095 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:29.977725 12834 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:29.978448 12834 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:29.949100 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:29.956980 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:29.986227 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:29.988196 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 61590.7us
W20260709 12:23:29.999683 12522 leader_election.cc:343] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:29.996101 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.011235 12750 ts_tablet_manager.cc:1403] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.224s	user 0.031s	sys 0.039s
I20260709 12:23:30.011732 12751 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:29.985246 12632 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:30.018339 12739 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.IsCreateTableDone -> {remote=127.11.32.62:45335, user_credentials={real_user=slave}} blocked reactor thread for 56461.4us
I20260709 12:23:30.018492 12844 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
W20260709 12:23:29.996953 12674 leader_election.cc:343] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.013226 12629 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:30.024497 12674 leader_election.cc:343] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.025283 12777 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.025942 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.012190 12628 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:30.026439 12522 leader_election.cc:343] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.026549 12707 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
W20260709 12:23:30.033457 12674 leader_election.cc:343] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.038451 12671 leader_election.cc:343] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.033558 12600 leader_election.cc:343] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.043883 12671 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.045349 12756 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.047621 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:30.048704 12707 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:30.048893 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:23:30.050056 12671 leader_election.cc:343] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.037269 12834 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.052560 12844 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.058316 12751 tablet_bootstrap.cc:654] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.061305 12629 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:30.083725 12628 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:30.059155 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.087371 12834 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.077055 12835 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.090190 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:30.091250 12755 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.091733 12755 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.091615 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.092250 12755 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.091243 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.100670 12557 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:30.100387 12750 raft_consensus.cc:359] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.104102 12750 raft_consensus.cc:385] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.104787 12750 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.109213 12750 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.110680 12559 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.099426 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.112078 12630 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.113963 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:23:30.114728 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 64700us
I20260709 12:23:30.115454 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:30.126233 12845 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.118559 12834 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.126674 12847 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:23:30.126958 12834 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.127094 12750 ts_tablet_manager.cc:1434] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.115s	user 0.022s	sys 0.010s
I20260709 12:23:30.127383 12834 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.127285 12847 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.127990 12750 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.133034 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:30.134666 12757 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.135165 12757 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:30.137478 12757 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.119225 12835 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20260709 12:23:30.138271 12755 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.141597 12845 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:30.142524 12845 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.142865 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.125109 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:23:30.147212 12600 leader_election.cc:343] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.124784 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.147431 12835 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.147881 12835 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.148221 12835 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.148626 12794 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.148999 12794 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.149329 12794 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.150497 12798 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.151274 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.175989 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:30.162657 12755 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.179497 12750 tablet_bootstrap.cc:654] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.175761 12794 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.184832 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.186585 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.185531 12847 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.188588 12630 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:30.164710 12834 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.191636 12705 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:30.191851 12749 tablet_bootstrap.cc:492] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.192296 12749 ts_tablet_manager.cc:1403] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.342s	user 0.009s	sys 0.007s
I20260709 12:23:30.186633 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.209810 12598 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:30.210264 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.214191 12834 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:23:30.214172 12522 leader_election.cc:343] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.214820 12802 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:30.218906 12794 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.219801 12750 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.220355 12750 ts_tablet_manager.cc:1403] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.004s
W20260709 12:23:30.211046 12523 leader_election.cc:343] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.223282 12455 catalog_manager.cc:5697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.235266 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:23:30.236654 12674 leader_election.cc:343] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.237037 12750 raft_consensus.cc:359] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.241266 12750 raft_consensus.cc:385] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.241703 12750 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.245594 12750 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.247044 12749 raft_consensus.cc:359] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.251753 12749 raft_consensus.cc:385] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.252202 12749 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.252915 12749 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.248534 12750 ts_tablet_manager.cc:1434] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:23:30.255085 12750 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.256151 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:23:30.250267 12523 leader_election.cc:343] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.261075 12523 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:30.260648 12802 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.270874 12843 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.273468 12835 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.274955 12671 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.275679 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.276557 12631 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:30.275861 12756 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.278221 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:30.278952 12705 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.279417 12749 ts_tablet_manager.cc:1434] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.000s
I20260709 12:23:30.283208 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.284408 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.287240 12558 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.287398 12834 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.284677 12835 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.289693 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.295783 12705 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:30.304873 12631 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.305991 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.306927 12757 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.307443 12757 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:30.308296 12757 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.309001 12750 tablet_bootstrap.cc:654] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.313856 12631 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.315970 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.298307 12749 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.303681 12751 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.320665 12751 ts_tablet_manager.cc:1403] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.309s	user 0.017s	sys 0.016s
I20260709 12:23:30.322427 12750 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.322893 12750 ts_tablet_manager.cc:1403] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.068s	user 0.013s	sys 0.004s
I20260709 12:23:30.324308 12749 tablet_bootstrap.cc:654] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.326304 12750 raft_consensus.cc:359] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.327136 12750 raft_consensus.cc:385] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.327482 12750 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.323628 12751 raft_consensus.cc:359] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.328646 12751 raft_consensus.cc:385] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.333568 12751 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.334595 12751 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.297237 12558 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.331248 12750 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.338193 12750 ts_tablet_manager.cc:1434] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.002s
I20260709 12:23:30.339094 12750 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.340649 12751 ts_tablet_manager.cc:1434] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:23:30.341694 12835 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.343294 12835 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:30.345234 12750 tablet_bootstrap.cc:654] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.344575 12835 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.350009 12751 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.350762 12749 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.351275 12749 ts_tablet_manager.cc:1403] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.010s
I20260709 12:23:30.354095 12749 raft_consensus.cc:359] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.354831 12749 raft_consensus.cc:385] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.355181 12749 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.356297 12749 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.359004 12749 ts_tablet_manager.cc:1434] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:23:30.360114 12749 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.361210 12751 tablet_bootstrap.cc:654] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.366799 12749 tablet_bootstrap.cc:654] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.366932 12750 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.368992 12750 ts_tablet_manager.cc:1403] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.007s
I20260709 12:23:30.369848 12454 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.375937 12751 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.374704 12454 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.376641 12751 ts_tablet_manager.cc:1403] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.027s	user 0.003s	sys 0.009s
I20260709 12:23:30.380141 12751 raft_consensus.cc:359] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.372660 12750 raft_consensus.cc:359] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.381748 12750 raft_consensus.cc:385] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.381922 12751 raft_consensus.cc:385] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.382134 12750 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.382938 12750 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.383498 12749 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.383998 12749 ts_tablet_manager.cc:1403] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.005s
I20260709 12:23:30.384835 12750 ts_tablet_manager.cc:1434] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260709 12:23:30.385958 12750 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.386772 12749 raft_consensus.cc:359] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.387506 12749 raft_consensus.cc:385] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.387794 12749 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.388644 12749 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.391393 12749 ts_tablet_manager.cc:1434] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:30.392059 12750 tablet_bootstrap.cc:654] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.392577 12749 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.393049 12751 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.393955 12751 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.398270 12751 ts_tablet_manager.cc:1434] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:23:30.399478 12751 tablet_bootstrap.cc:492] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.399909 12749 tablet_bootstrap.cc:654] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.405656 12751 tablet_bootstrap.cc:654] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.416450 12750 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.417116 12750 ts_tablet_manager.cc:1403] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.031s	user 0.006s	sys 0.007s
I20260709 12:23:30.421537 12750 raft_consensus.cc:359] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.422482 12750 raft_consensus.cc:385] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.422873 12750 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.426476 12750 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.428244 12749 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.428776 12750 ts_tablet_manager.cc:1434] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260709 12:23:30.428798 12749 ts_tablet_manager.cc:1403] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.037s	user 0.026s	sys 0.009s
I20260709 12:23:30.429967 12750 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.431854 12749 raft_consensus.cc:359] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.432619 12749 raft_consensus.cc:385] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.432952 12749 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.433764 12749 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.436080 12749 ts_tablet_manager.cc:1434] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:30.437192 12749 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.437251 12750 tablet_bootstrap.cc:654] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.441530 12751 tablet_bootstrap.cc:492] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.442085 12751 ts_tablet_manager.cc:1403] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.013s
I20260709 12:23:30.441720 12457 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.443048 12757 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.443872 12757 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.446180 12757 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.446347 12749 tablet_bootstrap.cc:654] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.448808 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.450565 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:30.459074 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:30.459767 12835 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.460561 12835 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.462024 12751 raft_consensus.cc:359] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.462767 12751 raft_consensus.cc:385] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.463049 12751 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.463510 12835 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.463723 12751 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.466136 12751 ts_tablet_manager.cc:1434] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:23:30.466724 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.467374 12559 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
W20260709 12:23:30.459918 12522 leader_election.cc:343] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:30.470749 12523 leader_election.cc:343] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.472337 12751 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.473698 12674 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.474947 12835 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.472143 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.475422 12523 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:30.475461 12835 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.478669 12835 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.484031 12631 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.485164 12757 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.487103 12835 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.491189 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.492565 12558 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.491158 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.494184 12631 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.492698 12835 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.508008 12558 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.508008 12631 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.509835 12674 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.510690 12751 tablet_bootstrap.cc:654] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.511778 12750 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.511778 12749 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.511987 12835 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.512499 12750 ts_tablet_manager.cc:1403] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.083s	user 0.041s	sys 0.027s
I20260709 12:23:30.512550 12749 ts_tablet_manager.cc:1403] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.076s	user 0.032s	sys 0.040s
I20260709 12:23:30.513593 12835 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:30.515206 12834 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.515673 12749 raft_consensus.cc:359] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.516422 12749 raft_consensus.cc:385] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.515892 12834 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.516744 12749 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.516847 12835 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.517522 12749 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.519914 12749 ts_tablet_manager.cc:1434] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:30.520833 12749 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.521243 12751 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.520880 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.521888 12631 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:30.522746 12751 ts_tablet_manager.cc:1403] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.007s
I20260709 12:23:30.523160 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.515585 12750 raft_consensus.cc:359] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.525565 12750 raft_consensus.cc:385] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.525574 12777 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.525959 12750 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.525578 12751 raft_consensus.cc:359] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.526654 12751 raft_consensus.cc:385] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.527140 12751 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.526571 12777 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.526830 12750 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.527776 12751 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.529152 12750 ts_tablet_manager.cc:1434] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.016s	user 0.001s	sys 0.005s
I20260709 12:23:30.530119 12750 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.533771 12751 ts_tablet_manager.cc:1434] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:30.534832 12751 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.536335 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.537501 12756 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.538803 12749 tablet_bootstrap.cc:654] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.540956 12751 tablet_bootstrap.cc:654] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.541872 12750 tablet_bootstrap.cc:654] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.542716 12834 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.542717 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.546695 12558 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.549058 12777 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.552244 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.553436 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.556536 12777 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.557003 12777 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.557389 12777 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.564288 12843 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.569162 12843 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:30.570796 12671 leader_election.cc:343] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.571987 12843 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.572652 12843 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.573143 12843 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.576067 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.578210 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.579078 12704 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:30.579210 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.580098 12630 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:30.580744 12523 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.581249 12757 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.582206 12794 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.582726 12794 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.583195 12794 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.588959 12843 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.576994 12627 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:30.593684 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.595225 12705 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:30.592794 12756 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.600775 12523 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:30.602677 12757 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.611373 12794 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.620703 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.621047 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:30.621524 12794 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.621358 12627 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.621825 12705 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.601706 12777 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.623657 12751 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.633757 12751 ts_tablet_manager.cc:1403] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.003s
I20260709 12:23:30.641248 12845 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.646073 12751 raft_consensus.cc:359] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.646869 12751 raft_consensus.cc:385] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.647197 12751 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.622044 12455 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.647907 12751 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.616804 12757 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:30.652921 12749 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.653712 12749 ts_tablet_manager.cc:1403] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.133s	user 0.045s	sys 0.066s
I20260709 12:23:30.659963 12705 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:30.667775 12751 ts_tablet_manager.cc:1434] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.004s
I20260709 12:23:30.669428 12751 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.674750 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.675463 12558 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.673187 12627 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:30.682375 12523 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.683612 12558 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.683816 12750 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.685714 12750 ts_tablet_manager.cc:1403] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.156s	user 0.025s	sys 0.017s
I20260709 12:23:30.681746 12794 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:30.686069 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.686335 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.687129 12777 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.687338 12835 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.692049 12835 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:30.693334 12749 raft_consensus.cc:359] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.694115 12749 raft_consensus.cc:385] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.694422 12749 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.686903 12627 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.687517 12757 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.694330 12835 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.698856 12751 tablet_bootstrap.cc:654] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.695343 12749 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.701496 12749 ts_tablet_manager.cc:1434] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
I20260709 12:23:30.702632 12749 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.705072 12627 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.709113 12749 tablet_bootstrap.cc:654] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.714092 12750 raft_consensus.cc:359] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.714826 12750 raft_consensus.cc:385] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.715142 12750 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.715804 12750 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.717725 12750 ts_tablet_manager.cc:1434] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:23:30.718732 12750 tablet_bootstrap.cc:492] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.710155 12757 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:30.713325 12835 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.719863 12835 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.720206 12757 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.723286 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.724080 12558 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.723416 12457 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.725708 12674 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.726620 12756 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.726982 12756 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.727180 12751 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.727365 12756 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.727700 12751 ts_tablet_manager.cc:1403] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.004s
I20260709 12:23:30.730584 12751 raft_consensus.cc:359] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.731247 12751 raft_consensus.cc:385] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.731510 12751 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.733739 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:30.735124 12671 leader_election.cc:343] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.737025 12835 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.738021 12751 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.740625 12843 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.741888 12751 ts_tablet_manager.cc:1434] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.002s
I20260709 12:23:30.744625 12751 tablet_bootstrap.cc:492] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.757908 12756 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.759771 12756 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.760710 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.761380 12558 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.767470 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:30.767956 12750 tablet_bootstrap.cc:654] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:30.769439 12671 leader_election.cc:343] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.774577 12558 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:30.776075 12674 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.776645 12751 tablet_bootstrap.cc:654] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.783339 12756 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:30.784538 12756 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:30.785890 12756 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.789587 12751 tablet_bootstrap.cc:492] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.789328 12456 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:30.796207 12751 ts_tablet_manager.cc:1403] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.052s	user 0.011s	sys 0.007s
I20260709 12:23:30.803202 12757 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.819911 12751 raft_consensus.cc:359] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.824514 12751 raft_consensus.cc:385] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.825305 12751 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.825520 12835 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:30.826761 12751 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.831605 12751 ts_tablet_manager.cc:1434] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.035s	user 0.008s	sys 0.000s
I20260709 12:23:30.833285 12751 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.840155 12455 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:30.858672 12749 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.859195 12749 ts_tablet_manager.cc:1403] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.157s	user 0.045s	sys 0.063s
I20260709 12:23:30.860920 12751 tablet_bootstrap.cc:654] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.862049 12749 raft_consensus.cc:359] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.862668 12749 raft_consensus.cc:385] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.862924 12749 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.863544 12749 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.866314 12750 tablet_bootstrap.cc:492] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.866767 12750 ts_tablet_manager.cc:1403] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.148s	user 0.030s	sys 0.025s
I20260709 12:23:30.868198 12777 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.869321 12750 raft_consensus.cc:359] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.870067 12750 raft_consensus.cc:385] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.870342 12750 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.870921 12750 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.873994 12750 ts_tablet_manager.cc:1434] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:30.874927 12749 ts_tablet_manager.cc:1434] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:23:30.875705 12750 tablet_bootstrap.cc:492] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.875756 12749 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.882802 12750 tablet_bootstrap.cc:654] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.883606 12751 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.884092 12751 ts_tablet_manager.cc:1403] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.000s
I20260709 12:23:30.886423 12749 tablet_bootstrap.cc:654] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.888051 12751 raft_consensus.cc:359] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.889259 12751 raft_consensus.cc:385] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.889585 12751 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.893638 12751 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.895884 12751 ts_tablet_manager.cc:1434] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:30.892647 12627 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.902194 12851 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.902724 12851 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.904986 12851 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.908991 12851 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.909535 12851 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.912421 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.905454 12751 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
W20260709 12:23:30.914161 12600 leader_election.cc:343] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.915359 12851 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.905623 12750 tablet_bootstrap.cc:492] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.906386 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.906827 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.916088 12704 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:30.916046 12750 ts_tablet_manager.cc:1403] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.000s
I20260709 12:23:30.916720 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:30.917783 12600 leader_election.cc:343] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.918757 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:23:30.919981 12598 leader_election.cc:343] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.920413 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:30.921692 12749 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.922083 12751 tablet_bootstrap.cc:654] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.921900 12802 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.921841 12845 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:30.922485 12802 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.922849 12802 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.922180 12749 ts_tablet_manager.cc:1403] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.002s
I20260709 12:23:30.925187 12750 raft_consensus.cc:359] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.925911 12750 raft_consensus.cc:385] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.926267 12750 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.925832 12749 raft_consensus.cc:359] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.927006 12749 raft_consensus.cc:385] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.928337 12749 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.927902 12750 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.929152 12749 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.931522 12749 ts_tablet_manager.cc:1434] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:30.940951 12749 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.943962 12845 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.944873 12845 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.948674 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.949643 12750 ts_tablet_manager.cc:1434] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
W20260709 12:23:30.950703 12522 leader_election.cc:343] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.951699 12749 tablet_bootstrap.cc:654] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.950704 12750 tablet_bootstrap.cc:492] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:30.958681 12845 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.958920 12798 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.961797 12798 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.963817 12802 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.960111 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.966017 12802 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.966190 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:30.966409 12798 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:30.966077 12705 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:30.960144 12851 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:30.967722 12523 leader_election.cc:343] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.968369 12749 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:30.968765 12750 tablet_bootstrap.cc:654] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.968873 12749 ts_tablet_manager.cc:1403] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.007s
I20260709 12:23:30.968853 12523 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:30.969684 12756 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.969949 12751 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:30.970389 12751 ts_tablet_manager.cc:1403] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.065s	user 0.023s	sys 0.021s
I20260709 12:23:30.970211 12756 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.970381 12798 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.971174 12798 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.971557 12798 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.975189 12751 raft_consensus.cc:359] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.975880 12751 raft_consensus.cc:385] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.976148 12751 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.976827 12751 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.977945 12749 raft_consensus.cc:359] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.978900 12749 raft_consensus.cc:385] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:30.972476 12756 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:30.973240 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:30.979295 12749 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:30.974428 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:30.980139 12558 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.980199 12749 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.978926 12751 ts_tablet_manager.cc:1434] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:30.981946 12674 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:30.983349 12749 ts_tablet_manager.cc:1434] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:23:30.965559 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.983923 12756 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.984264 12906 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:30.984314 12756 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.984764 12630 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:30.984946 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:30.985642 12749 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:30.985733 12705 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:30.986227 12600 leader_election.cc:343] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:30.986487 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:30.987082 12627 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:30.988313 12751 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:30.988091 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:30.989344 12845 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:30.989734 12845 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:30.990090 12845 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:30.993875 12749 tablet_bootstrap.cc:654] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.996006 12751 tablet_bootstrap.cc:654] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:30.998869 12750 tablet_bootstrap.cc:492] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:30.999394 12750 ts_tablet_manager.cc:1403] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.049s	user 0.017s	sys 0.002s
I20260709 12:23:31.001191 12777 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.002343 12750 raft_consensus.cc:359] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.006012 12750 raft_consensus.cc:385] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.006361 12750 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.007104 12750 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.009356 12845 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:30.984918 12756 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.015177 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:31.015777 12627 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.009377 12750 ts_tablet_manager.cc:1434] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:31.020574 12750 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.024956 12627 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:31.026491 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:31.027356 12843 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.027895 12843 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:31.028789 12843 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.035066 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:23:31.036620 12523 leader_election.cc:343] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.026423 12798 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.037597 12906 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.039633 12845 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.041211 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.041926 12704 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:31.043104 12598 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.044152 12851 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.044557 12851 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.044446 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.045068 12851 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.046588 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:23:31.048292 12522 leader_election.cc:343] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.050887 12705 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:31.052358 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:23:31.056660 12600 leader_election.cc:343] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.057169 12906 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.053684 12756 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.057891 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:31.060892 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.061507 12557 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.061738 12756 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.062856 12835 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.061492 12906 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.065802 12906 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:31.066064 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:31.066725 12906 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.067327 12630 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.070223 12798 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.071774 12750 tablet_bootstrap.cc:654] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.079636 12750 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.067929 12455 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.055253 12704 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.080133 12750 ts_tablet_manager.cc:1403] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.004s
I20260709 12:23:31.080210 12749 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.080964 12751 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.081383 12751 ts_tablet_manager.cc:1403] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.093s	user 0.026s	sys 0.012s
I20260709 12:23:31.080711 12749 ts_tablet_manager.cc:1403] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.024s
I20260709 12:23:31.083041 12750 raft_consensus.cc:359] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.083895 12750 raft_consensus.cc:385] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.084300 12750 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.055251 12851 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.085079 12750 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.085881 12751 raft_consensus.cc:359] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.087456 12750 ts_tablet_manager.cc:1434] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:31.087616 12751 raft_consensus.cc:385] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.087641 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.089267 12704 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:31.090399 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:31.090639 12523 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:31.091064 12705 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.092039 12843 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.092533 12843 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:31.093006 12749 raft_consensus.cc:359] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.093694 12749 raft_consensus.cc:385] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:31.090401 12600 leader_election.cc:343] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.093516 12843 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.099161 12705 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:31.100919 12598 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:31.094084 12749 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.090541 12751 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.101886 12802 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.102483 12751 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.102684 12802 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:31.104133 12751 ts_tablet_manager.cc:1434] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.003s
I20260709 12:23:31.103894 12802 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.104882 12751 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.088433 12750 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.107494 12749 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.110937 12905 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.110961 12751 tablet_bootstrap.cc:654] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.111447 12905 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.114748 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.115653 12630 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:31.121986 12751 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.122534 12751 ts_tablet_manager.cc:1403] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.002s
I20260709 12:23:31.116937 12905 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.118783 12749 ts_tablet_manager.cc:1434] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.001s
I20260709 12:23:31.123831 12749 tablet_bootstrap.cc:492] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:31.123752 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.124428 12705 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:31.130285 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.131204 12777 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.131708 12777 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:31.132084 12905 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.132596 12905 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.132628 12777 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.139389 12798 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.140018 12798 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.146926 12845 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.089231 12851 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.169317 12456 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.190583 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.190994 12905 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.190685 12798 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:23:31.192910 12523 leader_election.cc:343] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.193473 12750 tablet_bootstrap.cc:654] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.198799 12751 raft_consensus.cc:359] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.199813 12751 raft_consensus.cc:385] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.200202 12751 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.201097 12751 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:31.116277 12600 leader_election.cc:343] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.202642 12749 tablet_bootstrap.cc:654] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.202302 12455 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.120035 12557 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
W20260709 12:23:31.208284 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 92051.3us
I20260709 12:23:31.217227 12777 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.219978 12751 ts_tablet_manager.cc:1434] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.002s
I20260709 12:23:31.221289 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.221952 12558 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:31.218912 12598 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:23:31.229882 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 98061.2us
I20260709 12:23:31.231747 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.232371 12704 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:31.233768 12751 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
W20260709 12:23:31.237856 12671 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:31.238400 12598 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.239452 12920 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.239830 12920 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.239785 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:31.240407 12920 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:31.241690 12522 leader_election.cc:343] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.242161 12905 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.242127 12522 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.242588 12905 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.242921 12905 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.243597 12845 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.243772 12835 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.252743 12906 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.257176 12906 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.259395 12906 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.261274 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.267678 12750 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.268293 12750 ts_tablet_manager.cc:1403] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.180s	user 0.022s	sys 0.009s
I20260709 12:23:31.271049 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.272782 12705 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:31.256311 12456 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.277282 12794 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.274763 12598 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.283486 12851 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.286227 12455 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.283674 12750 raft_consensus.cc:359] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.289534 12750 raft_consensus.cc:385] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.289930 12750 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.281651 12920 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.290695 12750 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.298859 12749 tablet_bootstrap.cc:492] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.300356 12749 ts_tablet_manager.cc:1403] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.177s	user 0.032s	sys 0.015s
I20260709 12:23:31.301286 12750 ts_tablet_manager.cc:1434] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.004s
I20260709 12:23:31.305375 12750 tablet_bootstrap.cc:492] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.306293 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.306398 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:31.307015 12705 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.306950 12557 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.304677 12920 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.319249 12851 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.319912 12749 raft_consensus.cc:359] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.321601 12905 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.323279 12557 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:31.320770 12749 raft_consensus.cc:385] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.337203 12749 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.342485 12600 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:31.343340 12920 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.337947 12749 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.344082 12751 tablet_bootstrap.cc:654] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.333285 12705 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:31.343871 12920 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:31.345891 12920 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.350082 12750 tablet_bootstrap.cc:654] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.350525 12749 ts_tablet_manager.cc:1434] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:23:31.351531 12749 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:31.364718 12750 tablet_bootstrap.cc:492] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.364811 12751 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.365376 12750 ts_tablet_manager.cc:1403] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.060s	user 0.008s	sys 0.007s
I20260709 12:23:31.365540 12751 ts_tablet_manager.cc:1403] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.132s	user 0.012s	sys 0.004s
I20260709 12:23:31.371276 12905 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.370777 12454 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.371596 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.372385 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:31.373024 12705 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:31.373586 12600 leader_election.cc:343] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.374241 12749 tablet_bootstrap.cc:654] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.378599 12749 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.379137 12749 ts_tablet_manager.cc:1403] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.002s
I20260709 12:23:31.379163 12705 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:31.379297 12751 raft_consensus.cc:359] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.380153 12751 raft_consensus.cc:385] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.380659 12598 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:31.380479 12751 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.382174 12749 raft_consensus.cc:359] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.382848 12749 raft_consensus.cc:385] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.383078 12749 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.383671 12905 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.383878 12750 raft_consensus.cc:359] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.384056 12751 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.384244 12905 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:31.384649 12750 raft_consensus.cc:385] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.384959 12750 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.385370 12905 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.385722 12750 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.386353 12751 ts_tablet_manager.cc:1434] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:23:31.387301 12751 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.388024 12750 ts_tablet_manager.cc:1434] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.001s
I20260709 12:23:31.383688 12749 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.390013 12750 tablet_bootstrap.cc:492] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.393061 12751 tablet_bootstrap.cc:654] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.399773 12794 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.400332 12750 tablet_bootstrap.cc:654] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.400400 12794 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.403573 12794 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.396306 12835 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:23:31.393941 12749 ts_tablet_manager.cc:1434] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:23:31.406672 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.407541 12705 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:31.407532 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:31.410177 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.411850 12843 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.417472 12905 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.418092 12905 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.420979 12905 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.421964 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.421259 12457 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.423008 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.423678 12705 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:31.425369 12598 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.425858 12749 tablet_bootstrap.cc:492] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:31.426584 12600 leader_election.cc:343] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.427692 12905 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.429358 12905 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.429781 12905 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.430572 12843 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.435987 12749 tablet_bootstrap.cc:654] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.436329 12905 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.439157 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:23:31.440356 12600 leader_election.cc:343] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.442978 12750 tablet_bootstrap.cc:492] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.443418 12750 ts_tablet_manager.cc:1403] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.008s
I20260709 12:23:31.444064 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:31.444753 12706 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.445286 12751 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.445748 12751 ts_tablet_manager.cc:1403] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.059s	user 0.015s	sys 0.023s
I20260709 12:23:31.445924 12705 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.448868 12751 raft_consensus.cc:359] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.449548 12751 raft_consensus.cc:385] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.449834 12751 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.450551 12751 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.451066 12749 tablet_bootstrap.cc:492] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.451610 12749 ts_tablet_manager.cc:1403] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 12:23:31.452546 12751 ts_tablet_manager.cc:1434] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:31.450910 12750 raft_consensus.cc:359] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.453749 12750 raft_consensus.cc:385] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.454011 12750 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.454422 12749 raft_consensus.cc:359] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.454659 12750 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.455255 12749 raft_consensus.cc:385] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.455657 12749 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.456420 12749 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.458454 12749 ts_tablet_manager.cc:1434] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:31.456868 12750 ts_tablet_manager.cc:1434] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:23:31.459534 12750 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.453481 12751 tablet_bootstrap.cc:492] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.462888 12749 tablet_bootstrap.cc:492] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:31.467767 12751 tablet_bootstrap.cc:654] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.468760 12557 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.474030 12706 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:31.475499 12750 tablet_bootstrap.cc:654] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.475699 12794 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.470423 12905 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.477964 12920 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.478286 12598 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:31.480806 12794 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.481385 12794 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.484215 12920 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.485303 12920 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:31.486233 12920 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.490247 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:31.491741 12794 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.492267 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.492908 12705 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:31.494169 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:31.496773 12749 tablet_bootstrap.cc:654] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.502808 12750 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.505790 12843 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:31.511878 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:31.516764 12750 ts_tablet_manager.cc:1403] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.057s	user 0.005s	sys 0.018s
I20260709 12:23:31.522712 12835 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.523245 12835 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.523854 12750 raft_consensus.cc:359] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.524892 12750 raft_consensus.cc:385] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.525224 12750 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.526460 12750 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.527587 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:31.529254 12671 leader_election.cc:343] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.530182 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.530493 12750 ts_tablet_manager.cc:1434] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:31.530934 12557 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:31.531728 12750 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.532187 12674 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:31.532980 12751 tablet_bootstrap.cc:492] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.533530 12751 ts_tablet_manager.cc:1403] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.080s	user 0.020s	sys 0.006s
I20260709 12:23:31.533387 12756 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.534042 12756 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.534507 12756 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.536249 12751 raft_consensus.cc:359] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.536957 12751 raft_consensus.cc:385] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.537334 12751 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.537585 12757 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.538136 12751 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.538889 12750 tablet_bootstrap.cc:654] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.540623 12751 ts_tablet_manager.cc:1434] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:31.525328 12835 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.541705 12751 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.547458 12794 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:31.551496 12757 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.552459 12794 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:23:31.552953 12794 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.559218 12751 tablet_bootstrap.cc:654] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.563719 12750 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.564236 12750 ts_tablet_manager.cc:1403] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.033s	user 0.006s	sys 0.019s
I20260709 12:23:31.571431 12905 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.574776 12756 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.577764 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.578437 12559 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.565910 12455 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:31.580914 12750 raft_consensus.cc:359] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.581925 12750 raft_consensus.cc:385] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.585529 12750 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.587117 12750 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.588038 12794 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.588053 12749 tablet_bootstrap.cc:492] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.592464 12749 ts_tablet_manager.cc:1403] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.130s	user 0.015s	sys 0.010s
I20260709 12:23:31.594873 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:31.589511 12750 ts_tablet_manager.cc:1434] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 12:23:31.596939 12558 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:31.598124 12750 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.598701 12851 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.600419 12906 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:31.600850 12906 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:31.601806 12906 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.603013 12906 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:31.605400 12794 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.605822 12559 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:31.598795 12749 raft_consensus.cc:359] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.606622 12749 raft_consensus.cc:385] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.607180 12749 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.607096 12674 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.608091 12835 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.607992 12749 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.608810 12835 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:31.609942 12835 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.610491 12749 ts_tablet_manager.cc:1434] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 12:23:31.611910 12749 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:31.613284 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:31.616317 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.617332 12798 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:23:31.620064 12756 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.622380 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:31.622740 12751 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.623987 12751 ts_tablet_manager.cc:1403] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.083s	user 0.024s	sys 0.015s
I20260709 12:23:31.626708 12751 raft_consensus.cc:359] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.627326 12751 raft_consensus.cc:385] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.627563 12751 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.628154 12751 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:31.629719 12671 leader_election.cc:343] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.630784 12751 ts_tablet_manager.cc:1434] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:31.633563 12751 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.634119 12749 tablet_bootstrap.cc:654] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.639957 12751 tablet_bootstrap.cc:654] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.641310 12750 tablet_bootstrap.cc:654] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.648198 12920 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.648372 12454 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.650308 12749 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.650789 12749 ts_tablet_manager.cc:1403] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.003s
I20260709 12:23:31.654037 12749 raft_consensus.cc:359] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.654757 12749 raft_consensus.cc:385] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.655035 12749 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.655951 12749 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.661550 12920 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.663087 12836 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.671569 12750 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.674170 12835 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.693622 12835 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.695688 12835 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.698025 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:31.698616 12750 ts_tablet_manager.cc:1403] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.101s	user 0.009s	sys 0.002s
I20260709 12:23:31.699265 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.702924 12559 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
W20260709 12:23:31.700273 12671 leader_election.cc:343] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.704946 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:31.706110 12835 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.706472 12835 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.706799 12835 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.713104 12756 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.713621 12756 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.717398 12835 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.717687 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:31.718127 12756 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.718405 12631 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:31.720793 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.705449 12750 raft_consensus.cc:359] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.722100 12750 raft_consensus.cc:385] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.722452 12750 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.723268 12750 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.721242 12835 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.725435 12835 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:31.725914 12835 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:31.729208 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.729650 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.730052 12559 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:31.730499 12558 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.729219 12835 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.728185 12750 ts_tablet_manager.cc:1434] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.026s	user 0.004s	sys 0.002s
I20260709 12:23:31.736279 12750 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.736073 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:31.736451 12777 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.740597 12751 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.751953 12751 ts_tablet_manager.cc:1403] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.120s	user 0.037s	sys 0.053s
W20260709 12:23:31.753762 12671 leader_election.cc:343] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.754979 12751 raft_consensus.cc:359] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.755712 12751 raft_consensus.cc:385] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.756016 12751 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.756700 12920 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.756677 12751 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.757265 12920 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.759063 12751 ts_tablet_manager.cc:1434] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:31.759253 12920 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.759995 12751 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.762305 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.774569 12751 tablet_bootstrap.cc:654] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.774663 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.775529 12557 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:31.742980 12558 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:31.745898 12749 ts_tablet_manager.cc:1434] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.095s	user 0.008s	sys 0.001s
I20260709 12:23:31.779515 12749 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:31.747802 12835 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.779995 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:31.781111 12777 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.781682 12777 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:31.781834 12835 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:31.782807 12777 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.787782 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:31.788580 12557 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.791000 12750 tablet_bootstrap.cc:654] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.799993 12600 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.802214 12757 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.802721 12757 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.803539 12920 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.804847 12757 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.807965 12750 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.808414 12750 ts_tablet_manager.cc:1403] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.072s	user 0.005s	sys 0.004s
I20260709 12:23:31.809347 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:31.810518 12522 leader_election.cc:343] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.810953 12750 raft_consensus.cc:359] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.811573 12750 raft_consensus.cc:385] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.811810 12750 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.812417 12750 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.812896 12556 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.814733 12750 ts_tablet_manager.cc:1434] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260709 12:23:31.815618 12750 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.820961 12750 tablet_bootstrap.cc:654] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.824636 12851 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:31.825388 12906 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.825908 12906 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.827750 12906 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.832958 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.834566 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:31.835760 12750 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.836198 12750 ts_tablet_manager.cc:1403] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.007s
I20260709 12:23:31.836871 12598 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.837935 12906 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.842052 12749 tablet_bootstrap.cc:654] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.844808 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.847316 12750 raft_consensus.cc:359] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.849231 12750 raft_consensus.cc:385] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.849532 12750 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.849637 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:31.850235 12627 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.850186 12750 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.852551 12750 ts_tablet_manager.cc:1434] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:31.853503 12750 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.856137 12557 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:31.857530 12627 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:31.857679 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:31.858889 12777 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:31.859186 12750 tablet_bootstrap.cc:654] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.859535 12631 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:31.859800 12777 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:31.861012 12777 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.871431 12920 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.872427 12750 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.872877 12750 ts_tablet_manager.cc:1403] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.006s
W20260709 12:23:31.874135 12523 leader_election.cc:343] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:31.874683 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:31.875929 12757 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:31.875707 12750 raft_consensus.cc:359] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.876883 12750 raft_consensus.cc:385] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.877172 12750 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.879208 12750 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.891647 12751 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.899000 12851 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.900648 12751 ts_tablet_manager.cc:1403] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.141s	user 0.056s	sys 0.055s
I20260709 12:23:31.903901 12751 raft_consensus.cc:359] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.904570 12751 raft_consensus.cc:385] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.904843 12751 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.905594 12751 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.907823 12750 ts_tablet_manager.cc:1434] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.035s	user 0.009s	sys 0.005s
I20260709 12:23:31.908746 12750 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.912922 12905 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:31.913743 12751 ts_tablet_manager.cc:1434] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 12:23:31.914525 12750 tablet_bootstrap.cc:654] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.914702 12751 tablet_bootstrap.cc:492] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:31.929955 12750 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:31.930428 12750 ts_tablet_manager.cc:1403] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.008s
I20260709 12:23:31.931278 12751 tablet_bootstrap.cc:654] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.937359 12749 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:31.938062 12749 ts_tablet_manager.cc:1403] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.159s	user 0.012s	sys 0.013s
I20260709 12:23:31.938177 12750 raft_consensus.cc:359] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.947458 12750 raft_consensus.cc:385] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.947759 12750 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
W20260709 12:23:31.934253 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 43955.3us
I20260709 12:23:31.951385 12750 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.954612 12750 ts_tablet_manager.cc:1434] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.002s
I20260709 12:23:31.955351 12750 tablet_bootstrap.cc:492] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:31.955808 12749 raft_consensus.cc:359] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.957020 12749 raft_consensus.cc:385] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:31.957283 12749 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:31.959049 12749 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.966424 12455 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.973398 12851 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.973941 12455 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:31.974222 12851 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.978484 12851 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.978583 12750 tablet_bootstrap.cc:654] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.983325 12749 ts_tablet_manager.cc:1434] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.045s	user 0.005s	sys 0.002s
I20260709 12:23:31.984337 12749 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:31.990252 12749 tablet_bootstrap.cc:654] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:31.991601 12751 tablet_bootstrap.cc:492] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:31.992036 12751 ts_tablet_manager.cc:1403] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.078s	user 0.009s	sys 0.024s
I20260709 12:23:31.992452 12845 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:31.992914 12845 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:31.994928 12845 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:31.997193 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:31.999356 12751 raft_consensus.cc:359] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.000017 12751 raft_consensus.cc:385] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.000259 12751 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.000859 12751 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.003468 12751 ts_tablet_manager.cc:1434] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:23:32.004339 12751 tablet_bootstrap.cc:492] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
W20260709 12:23:32.004571 12523 leader_election.cc:343] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.004333 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.005425 12627 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:32.010888 12751 tablet_bootstrap.cc:654] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.010740 12522 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.012315 12845 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.012755 12845 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.013140 12845 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.013074 12794 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.018090 12794 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.021306 12845 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.022719 12749 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:32.022614 12794 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.023290 12749 ts_tablet_manager.cc:1403] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.001s
I20260709 12:23:32.023744 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.024276 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:32.024809 12631 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.025950 12749 raft_consensus.cc:359] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.026594 12749 raft_consensus.cc:385] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.026883 12749 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.026703 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.027797 12704 raft_consensus.cc:2393] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:32.029338 12751 tablet_bootstrap.cc:492] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:32.029296 12523 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.029958 12751 ts_tablet_manager.cc:1403] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.002s
I20260709 12:23:32.032469 12757 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.032358 12749 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.035396 12751 raft_consensus.cc:359] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.036026 12751 raft_consensus.cc:385] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.036260 12751 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.037329 12751 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.034438 12749 ts_tablet_manager.cc:1434] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:32.037983 12777 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.038457 12777 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.038946 12749 tablet_bootstrap.cc:492] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:32.040490 12777 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.053396 12751 ts_tablet_manager.cc:1434] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 12:23:32.054356 12751 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:32.059796 12631 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:32.061023 12845 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.064536 12522 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:32.061789 12749 tablet_bootstrap.cc:654] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.062436 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:32.065855 12798 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.066468 12798 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:32.067616 12798 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.068691 12751 tablet_bootstrap.cc:654] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.069578 12967 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.070178 12967 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.073505 12967 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.077751 12845 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.080091 12749 tablet_bootstrap.cc:492] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
W20260709 12:23:32.079276 12523 leader_election.cc:343] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.080555 12749 ts_tablet_manager.cc:1403] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.004s
I20260709 12:23:32.082598 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.083244 12559 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:32.084306 12749 raft_consensus.cc:359] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.078349 12845 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.084983 12749 raft_consensus.cc:385] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.085276 12749 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.085964 12749 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.087949 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.089020 12556 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:32.090058 12777 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.090672 12777 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.091027 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.090111 12749 ts_tablet_manager.cc:1434] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 12:23:32.092579 12749 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:32.087993 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.093713 12777 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:23:32.095243 12522 leader_election.cc:343] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:32.096372 12523 leader_election.cc:343] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.096843 12523 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.114148 12751 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:32.114629 12751 ts_tablet_manager.cc:1403] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.019s
I20260709 12:23:32.089586 12845 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.118261 12845 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.118932 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.119578 12632 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:32.121196 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.122501 12751 raft_consensus.cc:359] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.123442 12751 raft_consensus.cc:385] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.123713 12751 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.125703 12749 tablet_bootstrap.cc:654] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.128895 12751 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.122349 12630 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:32.124627 12967 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.126686 12905 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:23:32.130810 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:32.135929 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.138209 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.138823 12706 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:32.139349 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.138886 12556 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:32.142109 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:32.143209 12777 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.143076 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.143586 12777 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.143772 12557 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:32.143959 12777 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.129269 12757 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.147934 12835 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.151063 12905 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.151980 12905 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.152300 12905 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.154202 12777 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.154789 12454 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.155920 12674 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:32.156152 12777 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.157339 12835 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:32.157684 12835 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.158025 12835 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.165117 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:32.165746 12557 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.165709 12967 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.173875 12751 ts_tablet_manager.cc:1434] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.001s
I20260709 12:23:32.168308 12905 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.174925 12751 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:32.178548 12750 tablet_bootstrap.cc:492] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:32.178926 12750 ts_tablet_manager.cc:1403] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.224s	user 0.075s	sys 0.084s
I20260709 12:23:32.177999 12905 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.165275 12835 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.193980 12557 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:32.202193 12835 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.210752 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:32.211591 12708 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:32.214732 12750 raft_consensus.cc:359] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.215433 12750 raft_consensus.cc:385] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.215700 12750 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.216346 12750 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.218536 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:32.219767 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:32.219354 12632 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:32.220748 12631 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.225261 12750 ts_tablet_manager.cc:1434] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 12:23:32.226282 12750 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:32.235244 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:32.236006 12554 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:32.237560 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:32.238194 12557 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:32.240355 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:32.242745 12836 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.243208 12836 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:32.243965 12836 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.246706 12749 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:32.247205 12749 ts_tablet_manager.cc:1403] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.155s	user 0.003s	sys 0.029s
I20260709 12:23:32.234676 12631 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:23:32.257308 12751 tablet_bootstrap.cc:654] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.260668 12750 tablet_bootstrap.cc:654] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.260910 12749 raft_consensus.cc:359] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.261101 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.266791 12967 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.264876 12749 raft_consensus.cc:385] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.268162 12906 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.269384 12906 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.268631 12749 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.276368 12906 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.277079 12967 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.282316 12835 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.285708 12749 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.287856 12749 ts_tablet_manager.cc:1434] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.001s
I20260709 12:23:32.288622 12749 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:32.290349 12454 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.291505 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.292198 12556 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:32.294075 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.300139 12835 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.300665 12835 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.303766 12967 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.304657 12967 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.305087 12967 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.308018 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:32.309468 12851 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.309818 12851 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.310150 12851 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.310266 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.310895 12558 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:32.297549 12557 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:23:32.322664 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:32.323608 12967 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.324533 12967 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.324890 12967 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.325213 12967 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.329787 12749 tablet_bootstrap.cc:654] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.336593 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:32.336416 12756 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.337678 12836 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:32.338178 12836 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:32.339042 12836 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.344345 12967 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.349681 12835 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.352895 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.353317 12756 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.354159 12967 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.354856 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:32.355615 12558 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:32.357270 12674 leader_election.cc:343] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.370294 12558 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:32.372295 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:32.373488 12967 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.374128 12967 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:32.375150 12967 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.384600 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.388487 12756 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.395370 12851 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.397624 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.399060 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.433669 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:32.437827 12756 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.440837 12756 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.442880 12756 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.443765 12777 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.437420 12706 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
W20260709 12:23:32.448240 12598 leader_election.cc:343] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.450174 12751 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:32.450338 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.450650 12751 ts_tablet_manager.cc:1403] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.276s	user 0.029s	sys 0.039s
I20260709 12:23:32.450644 12845 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.451268 12750 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:32.451817 12750 ts_tablet_manager.cc:1403] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.226s	user 0.040s	sys 0.031s
I20260709 12:23:32.451228 12845 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.456126 12845 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.456725 12751 raft_consensus.cc:359] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.457469 12751 raft_consensus.cc:385] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.457816 12751 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.458825 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:32.460300 12522 leader_election.cc:343] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.458626 12751 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.462247 12751 ts_tablet_manager.cc:1434] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:32.462283 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:32.462626 12851 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.463542 12751 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:32.463353 12557 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:32.462790 12598 leader_election.cc:343] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:32.466782 12674 leader_election.cc:343] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.471086 12750 raft_consensus.cc:359] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.471756 12750 raft_consensus.cc:385] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.472036 12750 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.476615 12750 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.494977 12455 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.487268 12557 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:32.498034 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:32.499398 12851 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.500082 12750 ts_tablet_manager.cc:1434] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.001s
W20260709 12:23:32.500077 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 57602.3us
I20260709 12:23:32.501513 12750 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:32.502558 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:32.512779 12671 leader_election.cc:343] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.513155 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:32.505676 12851 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:32.516348 12777 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.518406 12851 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.510747 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:32.524871 12523 leader_election.cc:343] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.525053 12631 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:32.522439 12454 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 2, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.525317 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.528390 12845 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.529520 12671 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:32.530557 12798 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.531134 12798 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.532595 12798 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.530582 12992 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.535498 12749 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:32.535923 12749 ts_tablet_manager.cc:1403] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.247s	user 0.025s	sys 0.015s
I20260709 12:23:32.540288 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:32.540498 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.540891 12706 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:32.542213 12522 leader_election.cc:343] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.534399 12992 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.543599 12749 raft_consensus.cc:359] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.544275 12992 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.544323 12749 raft_consensus.cc:385] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.545045 12749 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.545795 12749 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.547384 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.549490 12749 ts_tablet_manager.cc:1434] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:23:32.550388 12749 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:32.558101 12523 leader_election.cc:343] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.558414 12706 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:32.558641 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.559470 12798 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.562781 12750 tablet_bootstrap.cc:654] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.566339 12845 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.573828 12751 tablet_bootstrap.cc:654] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.583907 12992 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.604684 12750 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:32.605170 12750 ts_tablet_manager.cc:1403] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.006s
I20260709 12:23:32.605298 12751 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:32.605708 12751 ts_tablet_manager.cc:1403] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.142s	user 0.010s	sys 0.002s
I20260709 12:23:32.611413 12751 raft_consensus.cc:359] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.612047 12751 raft_consensus.cc:385] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.612317 12751 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.613090 12750 raft_consensus.cc:359] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.614104 12750 raft_consensus.cc:385] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.613891 12751 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.614341 12750 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.614869 12750 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.616302 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:32.616876 12557 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.616783 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:32.617591 12630 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.618424 12750 ts_tablet_manager.cc:1434] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:23:32.619661 12750 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:32.619820 12751 ts_tablet_manager.cc:1434] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:23:32.620571 12751 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:32.626273 12756 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.626978 12756 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.653350 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.657096 12708 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.665822 12756 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.615969 12992 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.667716 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.666972 12455 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:32.674161 12749 tablet_bootstrap.cc:654] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.674243 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:32.677820 12630 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:32.679188 12671 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:32.680935 12836 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.681567 12836 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.682011 12836 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:32.682466 12557 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:32.688081 12750 tablet_bootstrap.cc:654] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.687875 12845 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.688570 12836 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.694231 12751 tablet_bootstrap.cc:654] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.708283 12750 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:32.708774 12750 ts_tablet_manager.cc:1403] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.089s	user 0.010s	sys 0.042s
I20260709 12:23:32.711256 12750 raft_consensus.cc:359] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.711894 12750 raft_consensus.cc:385] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.712169 12750 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.712783 12750 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.714321 12750 ts_tablet_manager.cc:1434] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:23:32.715713 12750 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:32.736898 12749 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:32.737346 12749 ts_tablet_manager.cc:1403] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.187s	user 0.012s	sys 0.015s
I20260709 12:23:32.738842 12455 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:32.740250 12751 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:32.739923 12749 raft_consensus.cc:359] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.740659 12749 raft_consensus.cc:385] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.740751 12751 ts_tablet_manager.cc:1403] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.120s	user 0.018s	sys 0.022s
I20260709 12:23:32.740970 12749 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.741722 12749 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.743584 12836 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.743924 12749 ts_tablet_manager.cc:1434] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:32.744199 12751 raft_consensus.cc:359] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.744920 12749 tablet_bootstrap.cc:492] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:32.745214 12751 raft_consensus.cc:385] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.745530 12751 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.746546 12750 tablet_bootstrap.cc:654] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.746426 12751 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.748983 12751 ts_tablet_manager.cc:1434] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:32.749855 12751 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:32.751754 12749 tablet_bootstrap.cc:654] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.755892 12751 tablet_bootstrap.cc:654] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.767059 12757 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.767625 12757 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.770270 12757 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.771296 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.771808 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.772183 12630 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
W20260709 12:23:32.772564 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:23:32.773263 12523 leader_election.cc:343] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.774623 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.776221 12757 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.776763 12757 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.777257 12757 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.789444 12992 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.790158 12992 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.796352 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:32.797467 12557 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:32.801038 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.805285 12750 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:32.805961 12750 ts_tablet_manager.cc:1403] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.000s
I20260709 12:23:32.806248 12671 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:32.807582 12836 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.809716 12750 raft_consensus.cc:359] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.810720 12750 raft_consensus.cc:385] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.811074 12750 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.811954 12750 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.814015 12845 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:32.814320 12992 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:32.814570 12845 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.815879 12750 ts_tablet_manager.cc:1434] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:23:32.816875 12750 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:32.816833 12845 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.819546 12836 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:32.804018 12756 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.823918 12750 tablet_bootstrap.cc:654] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:32.789328 12757 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.826658 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:32.827464 12708 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:32.830576 12851 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.833173 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:32.834160 12798 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:32.834502 12798 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:32.834852 12798 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.835355 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:32.838497 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:32.839066 12628 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.839406 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:23:32.840822 12523 leader_election.cc:343] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:32.842685 12522 leader_election.cc:343] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.846740 12749 tablet_bootstrap.cc:492] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:32.849488 12749 ts_tablet_manager.cc:1403] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.105s	user 0.019s	sys 0.038s
I20260709 12:23:32.854383 12558 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:32.856956 12756 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.857761 12798 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.846740 12750 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:32.856763 12757 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.859027 12750 ts_tablet_manager.cc:1403] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.005s
I20260709 12:23:32.847659 12628 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:32.874086 12750 raft_consensus.cc:359] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.860985 12798 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:32.862895 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:32.882820 12705 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:32.878808 12851 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:32.882598 12750 raft_consensus.cc:385] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.884325 12750 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.885246 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:32.887668 12750 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.889573 12798 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.890038 12798 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:32.890412 12750 ts_tablet_manager.cc:1434] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.003s
I20260709 12:23:32.890826 12798 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.891403 12750 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:32.860419 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:32.893898 12628 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
W20260709 12:23:32.903264 12522 leader_election.cc:343] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:32.901921 12836 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:32.908835 12705 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:32.906598 12749 raft_consensus.cc:359] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.909348 12749 raft_consensus.cc:385] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:32.909776 12749 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:32.910635 12749 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.912938 12749 ts_tablet_manager.cc:1434] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.000s
I20260709 12:23:32.922523 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:32.924214 12798 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:32.924746 12798 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:32.925635 12798 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:32.938140 12749 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.019342 12751 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.019889 12751 ts_tablet_manager.cc:1403] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.270s	user 0.054s	sys 0.107s
I20260709 12:23:33.024143 12757 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.024353 12750 tablet_bootstrap.cc:654] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.024662 12757 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.025950 12851 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.026408 12851 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.026808 12757 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.028391 12851 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.030062 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.030689 12705 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:33.031076 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.032250 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.033066 12920 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.033440 12920 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.033772 12920 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.033793 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.042109 12749 tablet_bootstrap.cc:654] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.042284 12920 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.042515 12751 raft_consensus.cc:359] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.043211 12751 raft_consensus.cc:385] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.043493 12751 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.044096 12751 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.045686 12920 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.046164 12751 ts_tablet_manager.cc:1434] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:23:33.047161 12751 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.047739 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.048359 12557 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:33.048497 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:33.049033 12704 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:33.035164 12522 leader_election.cc:343] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.058866 12751 tablet_bootstrap.cc:654] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:33.063583 12523 leader_election.cc:343] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.064694 12457 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.065577 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.066437 12757 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.066329 12457 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.080581 12967 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.083076 12756 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:23:33.083662 12756 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.085789 12756 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.085850 12967 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.087615 12751 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.087431 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.088065 12751 ts_tablet_manager.cc:1403] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.008s
I20260709 12:23:33.088191 12632 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:23:33.089395 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.090370 12756 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:33.091249 12756 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:23:33.091089 12751 raft_consensus.cc:359] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.057293 12704 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:33.091790 12751 raft_consensus.cc:385] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.092896 12751 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.094303 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.098680 12751 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.091601 12756 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:33.099825 12967 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.097216 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.100286 12967 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:33.100557 12557 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 2: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:33.101308 12751 ts_tablet_manager.cc:1434] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:33.101122 12967 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.103291 12751 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.108464 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:33.109071 12557 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.111358 12750 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.111850 12750 ts_tablet_manager.cc:1403] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.221s	user 0.015s	sys 0.022s
I20260709 12:23:33.111658 12756 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.117352 12751 tablet_bootstrap.cc:654] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.118870 12756 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.121014 12750 raft_consensus.cc:359] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.121937 12750 raft_consensus.cc:385] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.122550 12750 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.123167 12836 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.123613 12750 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.122381 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.126494 12750 ts_tablet_manager.cc:1434] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:23:33.127977 12750 tablet_bootstrap.cc:492] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.132324 12751 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.136386 12627 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:23:33.138571 12751 ts_tablet_manager.cc:1403] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.036s	user 0.003s	sys 0.020s
I20260709 12:23:33.139307 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.140192 12756 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:33.141778 12756 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:33.141438 12751 raft_consensus.cc:359] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.142290 12751 raft_consensus.cc:385] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.142652 12750 tablet_bootstrap.cc:654] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.142561 12756 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.142602 12751 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.147017 12751 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.149928 12751 ts_tablet_manager.cc:1434] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:33.150899 12751 tablet_bootstrap.cc:492] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.172580 12557 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:33.176559 12749 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.177089 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:33.182720 12558 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 2: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:33.181289 12457 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.180209 12750 tablet_bootstrap.cc:492] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.185184 12750 ts_tablet_manager.cc:1403] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.009s
I20260709 12:23:33.180895 12751 tablet_bootstrap.cc:654] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.185815 12749 ts_tablet_manager.cc:1403] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.248s	user 0.024s	sys 0.026s
I20260709 12:23:33.191242 12750 raft_consensus.cc:359] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.191973 12750 raft_consensus.cc:385] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.192274 12750 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.193228 12750 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.196506 12851 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.196980 12851 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.198514 12750 ts_tablet_manager.cc:1434] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:33.198915 12851 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.199401 12750 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.201082 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.201912 12705 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:33.201699 12455 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.202930 12749 raft_consensus.cc:359] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.203590 12749 raft_consensus.cc:385] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.203848 12749 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.205981 12749 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.209138 12749 ts_tablet_manager.cc:1434] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260709 12:23:33.211534 12749 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.213105 12992 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.226354 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.229913 12749 tablet_bootstrap.cc:654] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.231868 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.234248 12920 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.235740 12750 tablet_bootstrap.cc:654] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.245388 12920 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.252055 12750 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.255606 12798 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.256309 12798 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.258821 12750 ts_tablet_manager.cc:1403] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 12:23:33.260721 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.261626 12632 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:33.261622 12750 raft_consensus.cc:359] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.262467 12750 raft_consensus.cc:385] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.262979 12750 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.263520 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:33.263584 12750 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.264827 12757 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.265156 12757 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.265502 12757 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.266494 12798 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.267017 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:33.268594 12523 leader_election.cc:343] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.271250 12749 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.271947 12749 ts_tablet_manager.cc:1403] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.001s
I20260709 12:23:33.275454 12749 raft_consensus.cc:359] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.276535 12749 raft_consensus.cc:385] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.276970 12749 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.276160 12757 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.277951 12749 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.282505 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.283090 12632 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.283603 12750 ts_tablet_manager.cc:1434] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:23:33.284029 12757 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.285550 12757 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.285943 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:33.286586 12749 ts_tablet_manager.cc:1434] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:33.287515 12749 tablet_bootstrap.cc:492] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:33.287746 12523 leader_election.cc:343] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.288952 12751 tablet_bootstrap.cc:492] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.289438 12751 ts_tablet_manager.cc:1403] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.139s	user 0.038s	sys 0.045s
I20260709 12:23:33.285961 12757 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.292855 12750 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.293285 12632 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:33.293452 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.292136 12751 raft_consensus.cc:359] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.299104 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.299561 12750 tablet_bootstrap.cc:654] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:33.300334 12522 leader_election.cc:343] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.301337 13012 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.301828 13012 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:33.302457 12757 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.302645 13012 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.306165 12992 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.306742 12749 tablet_bootstrap.cc:654] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.306655 12992 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.308667 12992 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.310496 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.310809 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.310515 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.311760 12627 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:23:33.312899 12523 leader_election.cc:343] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.313339 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.314247 12798 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.315876 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:33.316783 12992 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.318403 12798 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.299389 12751 raft_consensus.cc:385] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.322383 12751 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.323127 12751 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.325227 12751 ts_tablet_manager.cc:1434] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.000s
I20260709 12:23:33.330756 12751 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.340201 12992 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.339591 12457 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:33.343681 12751 tablet_bootstrap.cc:654] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.345436 13012 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.354246 12749 tablet_bootstrap.cc:492] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.354768 12749 ts_tablet_manager.cc:1403] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.005s
I20260709 12:23:33.357383 12756 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.358084 12756 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.359551 12749 raft_consensus.cc:359] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.360293 12749 raft_consensus.cc:385] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.360570 12749 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.360603 12756 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.362007 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.362936 12627 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:33.364356 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.365049 12835 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.365435 12835 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.365252 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.365861 12835 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.366269 12558 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:33.378659 12956 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.379220 12956 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.381291 12956 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.383464 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.384083 12632 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:33.385236 12750 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.385723 12750 ts_tablet_manager.cc:1403] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.011s
I20260709 12:23:33.385794 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.386693 12558 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:33.387552 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.388370 12956 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.388244 12750 raft_consensus.cc:359] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.388767 12956 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.389257 12956 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.389757 12835 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.391677 12835 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.392647 12749 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.393200 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:33.393858 12557 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.394881 12749 ts_tablet_manager.cc:1434] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260709 12:23:33.395807 12749 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.400663 12557 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:33.388948 12750 raft_consensus.cc:385] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.409616 12750 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.410279 12750 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.411168 12751 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.411610 12751 ts_tablet_manager.cc:1403] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.081s	user 0.018s	sys 0.046s
I20260709 12:23:33.411504 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.411823 12750 ts_tablet_manager.cc:1434] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.026s	user 0.003s	sys 0.002s
I20260709 12:23:33.412365 12992 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.412652 12750 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.412811 12992 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:33.413614 12992 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.414155 12751 raft_consensus.cc:359] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.414808 12751 raft_consensus.cc:385] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.415060 12751 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.416898 12751 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.401552 12749 tablet_bootstrap.cc:654] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.418932 12751 ts_tablet_manager.cc:1434] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:33.419791 12751 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.408577 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.422137 12750 tablet_bootstrap.cc:654] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.421936 12632 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.431651 12749 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.432089 12749 ts_tablet_manager.cc:1403] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 12:23:33.437320 12956 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.439980 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:33.440583 12558 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.441761 12749 raft_consensus.cc:359] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.442390 12749 raft_consensus.cc:385] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.442574 12751 tablet_bootstrap.cc:654] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.442643 12749 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.443409 12749 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.445506 12749 ts_tablet_manager.cc:1434] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:33.446333 12749 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.451864 12749 tablet_bootstrap.cc:654] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.439419 12956 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.455053 12455 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.455446 12558 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:33.456141 12750 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.461783 12750 ts_tablet_manager.cc:1403] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.010s
I20260709 12:23:33.462373 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.463223 12956 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.463663 12956 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:33.464414 12956 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.464576 12750 raft_consensus.cc:359] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.465298 12750 raft_consensus.cc:385] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.465656 12750 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.466461 12750 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.468555 12750 ts_tablet_manager.cc:1434] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:33.469514 12750 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.470716 12632 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:33.476033 12750 tablet_bootstrap.cc:654] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.482918 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.483565 12628 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.486024 13012 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:33.496904 12628 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:33.499199 12751 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.499732 12751 ts_tablet_manager.cc:1403] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.015s
I20260709 12:23:33.502997 12749 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.503608 12749 ts_tablet_manager.cc:1403] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.057s	user 0.010s	sys 0.014s
I20260709 12:23:33.503252 12751 raft_consensus.cc:359] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.504038 12751 raft_consensus.cc:385] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.504366 12751 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.504997 12751 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.507315 12751 ts_tablet_manager.cc:1434] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:33.507416 13012 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.508281 12751 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.507514 12749 raft_consensus.cc:359] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.510859 12749 raft_consensus.cc:385] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.511224 12749 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.512135 12749 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.514976 12751 tablet_bootstrap.cc:654] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.515645 12749 ts_tablet_manager.cc:1434] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 12:23:33.516835 12749 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.510488 12750 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.519760 12750 ts_tablet_manager.cc:1403] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.050s	user 0.013s	sys 0.011s
I20260709 12:23:33.522946 12750 raft_consensus.cc:359] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.523840 12750 raft_consensus.cc:385] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.524194 12750 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.525028 12750 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.527453 12750 ts_tablet_manager.cc:1434] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:33.535387 12749 tablet_bootstrap.cc:654] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.538691 12750 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.541157 12851 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.544795 12750 tablet_bootstrap.cc:654] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.575095 12757 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.575624 12757 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.585497 12757 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.585640 12845 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.586140 12845 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.587704 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.588260 12845 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:23:33.590225 12523 leader_election.cc:343] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:33.592722 13045 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:23:33.593545 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.595914 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.596298 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.596549 12630 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:33.600261 12749 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.600996 12749 ts_tablet_manager.cc:1403] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.084s	user 0.016s	sys 0.032s
I20260709 12:23:33.603708 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.604379 12845 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:23:33.604722 12522 leader_election.cc:343] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.604750 12845 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.605263 12522 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.605334 12845 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.605396 12749 raft_consensus.cc:359] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.606628 12749 raft_consensus.cc:385] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.606942 12749 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.607213 12757 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.581511 13012 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.608641 13012 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.607882 12749 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.610713 13012 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.611135 12749 ts_tablet_manager.cc:1434] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:23:33.612426 12749 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.613534 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.614180 12704 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:33.616094 12523 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:33.620430 12749 tablet_bootstrap.cc:654] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.622008 13012 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.622403 13012 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.622752 13012 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.634393 13050 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.634898 13050 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.636922 12851 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:33.638778 13050 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.638226 12751 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.639456 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.639657 12751 ts_tablet_manager.cc:1403] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.132s	user 0.031s	sys 0.024s
I20260709 12:23:33.629376 12457 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:33.644804 12751 raft_consensus.cc:359] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.650939 12751 raft_consensus.cc:385] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.652308 12749 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:33.652850 12749 ts_tablet_manager.cc:1403] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.041s	user 0.013s	sys 0.011s
I20260709 12:23:33.642316 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.657037 12704 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:33.658625 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.651805 12967 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.660612 12967 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.663348 12967 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.664757 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.640080 12628 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
W20260709 12:23:33.666021 12598 leader_election.cc:343] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:33.667622 12522 leader_election.cc:343] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.652361 12751 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.669981 12749 raft_consensus.cc:359] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.670624 12749 raft_consensus.cc:385] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.671164 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.672158 12557 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:33.673125 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:33.673823 12851 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.674255 12851 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.674816 12851 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.673950 12845 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.671252 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:33.669629 12751 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.670871 12749 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.683790 12757 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.683722 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.684237 12757 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.684396 12630 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.684583 12757 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.694875 12749 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.699263 12558 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:33.701304 12756 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.702390 12756 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:33.702767 12756 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:33.703676 12756 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.714380 12756 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:33.741369 12750 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.741977 12750 ts_tablet_manager.cc:1403] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.203s	user 0.035s	sys 0.093s
I20260709 12:23:33.748924 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:33.738968 12845 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.768628 12751 ts_tablet_manager.cc:1434] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.128s	user 0.018s	sys 0.013s
I20260709 12:23:33.773705 12749 ts_tablet_manager.cc:1434] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.121s	user 0.018s	sys 0.003s
I20260709 12:23:33.773904 12757 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.774358 12750 raft_consensus.cc:359] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.774804 12749 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:33.774963 12750 raft_consensus.cc:385] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.775269 12750 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.775729 12757 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.775854 12750 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.778671 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:33.779268 12706 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.777328 12750 ts_tablet_manager.cc:1434] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.000s
I20260709 12:23:33.782259 12750 tablet_bootstrap.cc:492] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.783377 12751 tablet_bootstrap.cc:492] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.780457 12992 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.787810 12992 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.797719 13050 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:33.820673 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 134577us
I20260709 12:23:33.862267 12798 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:33.862751 12798 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.864346 13050 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.864887 12798 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.843755 12750 tablet_bootstrap.cc:654] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.867426 12706 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:33.791359 12704 raft_consensus.cc:2410] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:23:33.851308 12751 tablet_bootstrap.cc:654] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.852365 12630 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:23:33.858361 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.871811 12628 raft_consensus.cc:2393] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:33.850205 12992 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:33.868477 12851 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.873842 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.875229 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.875811 12632 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:33.876974 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:33.877041 12851 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.870476 13050 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.878656 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:23:33.880139 12522 leader_election.cc:343] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.880785 12522 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:33.881346 12751 tablet_bootstrap.cc:492] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:33.881091 13012 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.881925 12751 ts_tablet_manager.cc:1403] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.099s	user 0.006s	sys 0.014s
I20260709 12:23:33.882230 13051 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.883567 13051 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.883921 13051 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.884246 13051 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.884994 12751 raft_consensus.cc:359] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.885501 12798 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:33.885706 12751 raft_consensus.cc:385] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.886037 12751 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.886053 12798 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:33.886750 12751 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.887166 12798 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:33.889806 12522 leader_election.cc:343] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.891117 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:33.891723 12559 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.896548 12750 tablet_bootstrap.cc:492] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:33.897099 12750 ts_tablet_manager.cc:1403] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.115s	user 0.010s	sys 0.016s
I20260709 12:23:33.900542 12749 tablet_bootstrap.cc:654] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:33.900960 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.901631 12632 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.902912 12559 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:33.911821 12751 ts_tablet_manager.cc:1434] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.001s
I20260709 12:23:33.913128 12751 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:33.916591 12704 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.918260 12750 raft_consensus.cc:359] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.919025 12750 raft_consensus.cc:385] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:33.919395 12750 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:33.920145 12750 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.922626 12750 ts_tablet_manager.cc:1434] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260709 12:23:33.922783 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:33.923676 12750 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:33.923797 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:33.924563 12851 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.926237 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.926537 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:33.926963 12707 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:33.927136 12705 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:33.925065 12851 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:33.928952 13051 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.929065 12851 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:33.932723 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:33.932925 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:33.933336 12628 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:33.950271 12598 leader_election.cc:343] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:33.963740 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:33.966034 12757 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.972841 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:33.975188 12835 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:33.883575 13012 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.992022 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:33.977932 12845 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:33.970221 13051 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:33.998243 12757 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:33.998622 12757 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:33.998920 12757 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:33.981494 12632 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:34.005990 12757 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.007825 12835 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:33.999794 12845 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:34.010944 12757 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.012454 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:34.012987 12628 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:34.013623 13052 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.019709 13052 raft_consensus.cc:697] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:34.015077 12845 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.023186 12749 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:34.015053 12751 tablet_bootstrap.cc:654] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.023746 12749 ts_tablet_manager.cc:1403] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.249s	user 0.029s	sys 0.028s
I20260709 12:23:34.027382 12750 tablet_bootstrap.cc:654] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.028764 12522 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:34.030043 12757 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.030635 12757 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:34.031483 12757 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.032473 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:34.033100 12703 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.036286 12455 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 3, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.017621 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:34.073782 12703 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:34.020670 13052 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.054335 13050 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.083228 13050 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.087780 13066 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.088510 13066 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.092500 12756 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:34.102977 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:34.104658 12750 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:34.105278 12750 ts_tablet_manager.cc:1403] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.182s	user 0.013s	sys 0.016s
I20260709 12:23:34.107976 13050 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.119874 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:34.120517 12704 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.118893 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:34.122599 12706 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.126639 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:34.128224 13066 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.128991 12750 raft_consensus.cc:359] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.130885 12750 raft_consensus.cc:385] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.130826 12992 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:34.130029 12749 raft_consensus.cc:359] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.131670 12749 raft_consensus.cc:385] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.132221 12749 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.132942 12749 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.131359 12750 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.135097 12750 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.136708 12750 ts_tablet_manager.cc:1434] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260709 12:23:34.137667 12750 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:34.139779 12956 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:34.141460 12523 leader_election.cc:343] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.133096 12704 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:34.147727 12749 ts_tablet_manager.cc:1434] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.124s	user 0.009s	sys 0.001s
I20260709 12:23:34.152349 12749 tablet_bootstrap.cc:492] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:34.155014 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:34.167769 12523 leader_election.cc:343] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.183476 12756 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.184144 12756 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.288779 12756 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:34.294386 12750 tablet_bootstrap.cc:654] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.299491 12751 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:34.300530 12751 ts_tablet_manager.cc:1403] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.388s	user 0.050s	sys 0.042s
I20260709 12:23:34.307708 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:34.310527 12558 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:34.308318 13051 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.317157 13056 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.333206 12749 tablet_bootstrap.cc:654] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.327255 13051 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.333928 12706 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:34.340355 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:34.351223 12751 raft_consensus.cc:359] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.351938 12751 raft_consensus.cc:385] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.352222 12751 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.334547 13056 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.354388 13056 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.352833 12751 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.347267 13066 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.356436 13066 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:34.362582 12751 ts_tablet_manager.cc:1434] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.001s
I20260709 12:23:34.363562 12751 tablet_bootstrap.cc:492] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:34.359311 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.364403 13066 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:34.369973 13067 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.265s	user 0.005s	sys 0.007s
I20260709 12:23:34.373184 13051 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.374629 12749 tablet_bootstrap.cc:492] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:34.375137 12749 ts_tablet_manager.cc:1403] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.223s	user 0.007s	sys 0.009s
I20260709 12:23:34.378253 12750 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:34.378713 12750 ts_tablet_manager.cc:1403] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.027s
I20260709 12:23:34.384114 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:34.387240 12523 leader_election.cc:343] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.392619 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:23:34.393947 12522 leader_election.cc:343] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.397599 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:34.391604 12749 raft_consensus.cc:359] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.402051 12749 raft_consensus.cc:385] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.402312 12749 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.404143 12749 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.407963 13055 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.408990 12749 ts_tablet_manager.cc:1434] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.004s
I20260709 12:23:34.409984 12749 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
W20260709 12:23:34.401238 13074 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:23:34.402513 12992 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.408454 13055 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.438704 12750 raft_consensus.cc:359] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.424399 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:34.439459 12750 raft_consensus.cc:385] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.426147 12702 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:23:34.441390 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.442533 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.442476 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.443953 12703 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:23:34.440668 12750 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.445919 12750 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.448225 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:34.450891 12967 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.457024 12751 tablet_bootstrap.cc:654] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.448364 12702 pending_rounds.cc:85] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 1
I20260709 12:23:34.467234 12702 pending_rounds.cc:107] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:23:34.467595 12702 raft_consensus.cc:2889] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:23:34.470067 13012 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.470247 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.472121 12634 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:23:34.473079 12992 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.475497 13055 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.479496 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:34.482820 13055 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:34.484756 12598 leader_election.cc:343] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.486933 12750 ts_tablet_manager.cc:1434] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.108s	user 0.005s	sys 0.003s
I20260709 12:23:34.487871 12750 tablet_bootstrap.cc:492] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:34.488050 12967 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:34.492231 12522 leader_election.cc:343] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.492830 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:23:34.494467 12522 leader_election.cc:343] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.494706 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:34.494868 12522 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:34.495334 12556 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:34.497324 12749 tablet_bootstrap.cc:654] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.498802 13071 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.498901 12600 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:23:34.512660 12522 leader_election.cc:343] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.512997 12522 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:34.518914 13050 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.519778 12798 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:34.503942 13055 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.520799 13055 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.521255 13055 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.503182 13012 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.534754 12750 tablet_bootstrap.cc:654] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.527331 12798 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.540804 12798 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.545619 12992 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.540388 13050 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.546558 12992 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.548794 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.549685 12992 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:34.553640 12751 tablet_bootstrap.cc:492] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:34.554358 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.562474 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:23:34.653468 12522 leader_election.cc:343] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.658907 12751 ts_tablet_manager.cc:1403] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.296s	user 0.016s	sys 0.014s
W20260709 12:23:34.659166 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 93586.7us
I20260709 12:23:34.655699 12455 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.664808 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:34.663055 13071 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:34.661139 12455 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.651916 12798 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.668084 12455 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:34.675019 12674 leader_election.cc:343] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.672245 12455 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.669073 13063 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:34.713850 12751 raft_consensus.cc:359] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.715679 12751 raft_consensus.cc:385] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.715991 12751 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.716614 12751 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.720101 12750 tablet_bootstrap.cc:492] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:34.720738 12750 ts_tablet_manager.cc:1403] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.233s	user 0.014s	sys 0.022s
I20260709 12:23:34.731056 13055 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.741628 12751 ts_tablet_manager.cc:1434] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.082s	user 0.007s	sys 0.004s
I20260709 12:23:34.741676 13055 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:34.742647 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:23:34.743901 12598 leader_election.cc:343] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.747074 12750 raft_consensus.cc:359] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.747747 12750 raft_consensus.cc:385] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.747994 12750 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.748579 12750 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:34.751744 12523 leader_election.cc:343] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:34.752301 12523 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:34.752871 13052 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.755167 12750 ts_tablet_manager.cc:1434] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:23:34.755246 12634 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:34.757452 12749 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:34.757917 12749 ts_tablet_manager.cc:1403] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.348s	user 0.030s	sys 0.013s
I20260709 12:23:34.760528 12749 raft_consensus.cc:359] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.761183 12749 raft_consensus.cc:385] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.761454 12749 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.762050 12749 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.764106 12749 ts_tablet_manager.cc:1434] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:34.764921 12749 tablet_bootstrap.cc:492] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:34.766355 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:34.766991 12559 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.770728 12749 tablet_bootstrap.cc:654] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.773651 12750 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:34.779584 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:34.782392 12750 tablet_bootstrap.cc:654] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.784503 12835 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:34.784864 12835 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:34.785161 12835 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.793884 13055 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.797983 13063 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:34.777246 12751 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:34.808363 12835 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.821689 13066 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:23:34.844803 12522 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:34.846859 12835 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:34.851028 12559 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:34.854898 12600 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:34.856145 13055 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.856964 13055 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:34.860625 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:34.861289 12629 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.871380 12629 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:34.878700 12751 tablet_bootstrap.cc:654] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.858018 13055 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.887902 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:34.888720 13076 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:34.889213 13076 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:34.889003 13089 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:34.890177 13076 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.890779 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:34.891434 12559 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.925287 12992 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:34.925891 12992 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.928076 12992 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:34.932170 12454 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:34.937901 13089 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:34.942261 12749 tablet_bootstrap.cc:492] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:34.942759 12749 ts_tablet_manager.cc:1403] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.178s	user 0.059s	sys 0.060s
I20260709 12:23:34.944325 12750 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:34.944766 12750 ts_tablet_manager.cc:1403] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.171s	user 0.023s	sys 0.040s
I20260709 12:23:34.947288 12750 raft_consensus.cc:359] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.947911 12750 raft_consensus.cc:385] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.948182 12750 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.948756 12750 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.938535 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:34.950184 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:34.950872 12750 ts_tablet_manager.cc:1434] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:34.950889 12557 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:34.958774 12749 raft_consensus.cc:359] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.959466 12749 raft_consensus.cc:385] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:34.959733 12749 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:34.960359 12749 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:34.965525 12559 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:34.967213 12749 ts_tablet_manager.cc:1434] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.024s	user 0.004s	sys 0.002s
I20260709 12:23:34.968173 12749 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:34.974387 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:34.975207 12956 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:34.978840 12750 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:34.984943 12956 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:34.985399 12749 tablet_bootstrap.cc:654] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.987440 12750 tablet_bootstrap.cc:654] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:34.991786 12749 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:34.992324 12749 ts_tablet_manager.cc:1403] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.024s	user 0.010s	sys 0.000s
I20260709 12:23:35.003158 12749 raft_consensus.cc:359] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.004632 12749 raft_consensus.cc:385] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.004937 12749 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.005710 12749 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.008168 12749 ts_tablet_manager.cc:1434] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:23:35.009153 12749 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.013217 12751 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.013757 12751 ts_tablet_manager.cc:1403] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.237s	user 0.014s	sys 0.004s
I20260709 12:23:35.016717 12751 raft_consensus.cc:359] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.017493 12751 raft_consensus.cc:385] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.017815 12751 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.018498 12751 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.022605 12751 ts_tablet_manager.cc:1434] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:35.024762 12749 tablet_bootstrap.cc:654] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.029103 12751 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.035687 12751 tablet_bootstrap.cc:654] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.045953 12457 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.061724 12751 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.062301 12751 ts_tablet_manager.cc:1403] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.033s	user 0.013s	sys 0.000s
I20260709 12:23:35.065115 12751 raft_consensus.cc:359] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.067876 12751 raft_consensus.cc:385] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.068171 12751 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.068849 12751 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.071409 12751 ts_tablet_manager.cc:1434] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:35.072659 12751 tablet_bootstrap.cc:492] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.078783 12751 tablet_bootstrap.cc:654] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.088872 12749 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.089389 12749 ts_tablet_manager.cc:1403] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.010s
I20260709 12:23:35.089442 12750 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.090129 12750 ts_tablet_manager.cc:1403] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.112s	user 0.013s	sys 0.015s
I20260709 12:23:35.092295 12749 raft_consensus.cc:359] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.092957 12750 raft_consensus.cc:359] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.093909 12750 raft_consensus.cc:385] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.094199 12750 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.094632 12751 tablet_bootstrap.cc:492] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.095108 12751 ts_tablet_manager.cc:1403] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.000s
I20260709 12:23:35.094877 12750 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.097988 12750 ts_tablet_manager.cc:1434] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:35.093092 12749 raft_consensus.cc:385] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.098546 12751 raft_consensus.cc:359] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.098948 12750 tablet_bootstrap.cc:492] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:35.099224 12749 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.099318 12751 raft_consensus.cc:385] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.099706 12751 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.100026 12749 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.102355 12749 ts_tablet_manager.cc:1434] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.002s
I20260709 12:23:35.103327 12749 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.103165 12751 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.111320 12751 ts_tablet_manager.cc:1434] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:23:35.112931 12751 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.113585 13089 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.114419 12750 tablet_bootstrap.cc:654] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.114121 13089 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.118199 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.119325 12751 tablet_bootstrap.cc:654] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:35.119927 12522 leader_election.cc:343] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.125543 13089 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.130716 12750 tablet_bootstrap.cc:492] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.131597 12750 ts_tablet_manager.cc:1403] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260709 12:23:35.134387 12750 raft_consensus.cc:359] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.135121 12750 raft_consensus.cc:385] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.135617 12750 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.136250 12750 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.137836 12749 tablet_bootstrap.cc:654] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.138649 12750 ts_tablet_manager.cc:1434] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:35.139786 12750 tablet_bootstrap.cc:492] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:35.139819 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:35.141702 12523 leader_election.cc:343] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.142199 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.143450 13089 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.153755 12750 tablet_bootstrap.cc:654] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.168895 12750 tablet_bootstrap.cc:492] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.169395 12750 ts_tablet_manager.cc:1403] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.007s
I20260709 12:23:35.172286 13055 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.172221 12751 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.173534 12751 ts_tablet_manager.cc:1403] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.061s	user 0.027s	sys 0.023s
I20260709 12:23:35.176293 12749 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.176891 12749 ts_tablet_manager.cc:1403] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.074s	user 0.012s	sys 0.002s
I20260709 12:23:35.176954 12751 raft_consensus.cc:359] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.172878 13055 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.177845 12751 raft_consensus.cc:385] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.178180 12751 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.178890 12751 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.180608 12992 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.181443 12751 ts_tablet_manager.cc:1434] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:35.181295 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:35.181161 12992 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.182581 12749 raft_consensus.cc:359] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.185609 12749 raft_consensus.cc:385] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.185680 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.185968 12749 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.186358 12558 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.187227 12749 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.187860 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.188814 12835 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.189174 12835 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.189517 12835 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.194721 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.196414 12835 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.197216 13055 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.184597 12751 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.184949 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.198086 12629 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.196697 12600 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.199831 12749 ts_tablet_manager.cc:1434] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.004s
I20260709 12:23:35.183525 12992 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.201249 12750 raft_consensus.cc:359] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.202028 12750 raft_consensus.cc:385] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.202330 12750 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.203033 12750 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.203804 13055 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.205716 12750 ts_tablet_manager.cc:1434] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.000s
I20260709 12:23:35.207984 12750 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:35.210486 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:35.211825 12749 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.213299 12558 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.218421 12992 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.218955 12992 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.220736 12750 tablet_bootstrap.cc:654] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.222280 12992 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.222154 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.224465 12631 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.226063 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.226186 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:35.227098 12629 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.227695 12992 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.228756 12992 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.229162 12992 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.230820 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.231559 12559 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.232551 12750 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.233022 12750 ts_tablet_manager.cc:1403] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.011s
I20260709 12:23:35.228397 12749 tablet_bootstrap.cc:654] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.241513 12835 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.247960 12558 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.246230 12992 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.249171 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.254931 13076 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.255139 12629 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.255650 13076 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:35.257853 13076 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.250986 12750 raft_consensus.cc:359] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.258827 12750 raft_consensus.cc:385] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.259145 12750 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.259613 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:35.260244 12559 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.256930 12751 tablet_bootstrap.cc:654] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.259830 12750 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.265427 12750 ts_tablet_manager.cc:1434] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.032s	user 0.002s	sys 0.006s
I20260709 12:23:35.267624 12750 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:35.269382 12798 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.269945 12798 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.270769 13071 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.271271 13071 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.272172 12798 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.273564 13071 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.275136 12751 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.275645 12751 ts_tablet_manager.cc:1403] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.091s	user 0.008s	sys 0.002s
I20260709 12:23:35.277009 12750 tablet_bootstrap.cc:654] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.278426 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.279340 12751 raft_consensus.cc:359] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:35.279938 12522 leader_election.cc:343] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.280120 12751 raft_consensus.cc:385] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.280531 12751 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.281975 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:35.282013 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:35.281374 12751 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.288645 13076 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:35.288815 12523 leader_election.cc:343] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.289249 13076 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.291801 13076 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:23:35.289659 12523 leader_election.cc:343] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.293100 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.294339 12992 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.288823 12559 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.296125 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.296792 13089 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.298023 12751 ts_tablet_manager.cc:1434] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.022s	user 0.001s	sys 0.008s
I20260709 12:23:35.301367 12454 catalog_manager.cc:5697] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:35.301988 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:35.310330 12749 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.310829 12749 ts_tablet_manager.cc:1403] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.012s
I20260709 12:23:35.313650 12749 raft_consensus.cc:359] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.302701 12558 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.303398 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.302908 12674 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.302989 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:35.316131 12627 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.316370 12751 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.316565 12674 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.303413 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.318254 12631 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.319099 13076 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.319628 13076 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:35.320223 12956 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.320652 12956 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.321030 12956 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.320523 13076 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:35.322417 12522 leader_election.cc:343] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.322885 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.323655 13089 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.324427 12627 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.314394 12749 raft_consensus.cc:385] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.330724 12749 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.332190 12749 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.334847 12750 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.329864 12956 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.335355 12750 ts_tablet_manager.cc:1403] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.068s	user 0.009s	sys 0.006s
I20260709 12:23:35.337960 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:35.338297 12749 ts_tablet_manager.cc:1434] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:23:35.338577 12557 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.338675 12750 raft_consensus.cc:359] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.339385 12750 raft_consensus.cc:385] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.339780 12750 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.339300 12749 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.340435 12750 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.344081 12750 ts_tablet_manager.cc:1434] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:23:35.349872 12835 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.350817 12751 tablet_bootstrap.cc:654] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.351200 12557 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.352962 12750 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:35.361224 12956 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.364830 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:35.365549 12627 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.367024 12674 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.372112 12750 tablet_bootstrap.cc:654] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.375435 12627 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.376624 12749 tablet_bootstrap.cc:654] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.384874 12454 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.367820 12956 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.389981 12956 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:35.392207 12956 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.394544 12751 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.397603 12751 ts_tablet_manager.cc:1403] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.081s	user 0.008s	sys 0.005s
I20260709 12:23:35.400424 13071 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.400780 12751 raft_consensus.cc:359] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.401086 13071 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.401634 12751 raft_consensus.cc:385] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.401401 13076 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.404161 12751 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.404882 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:35.406631 12523 leader_election.cc:343] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.408632 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.404906 12751 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.412073 12629 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 0.
I20260709 12:23:35.418134 12751 ts_tablet_manager.cc:1434] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:23:35.419298 12522 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.420241 12798 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.420627 12798 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.420976 12798 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.412144 13071 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.426432 12750 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.426893 12750 ts_tablet_manager.cc:1403] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.012s
I20260709 12:23:35.429378 12750 raft_consensus.cc:359] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.430047 12750 raft_consensus.cc:385] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.430320 12750 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.430917 12750 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.434831 13091 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.435271 12750 ts_tablet_manager.cc:1434] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:23:35.436200 12750 tablet_bootstrap.cc:492] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: Bootstrap starting.
I20260709 12:23:35.441936 13091 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.444614 12798 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.446895 12627 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.449730 12750 tablet_bootstrap.cc:654] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.464233 12749 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.464731 12749 ts_tablet_manager.cc:1403] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.126s	user 0.020s	sys 0.025s
I20260709 12:23:35.467641 12749 raft_consensus.cc:359] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.468333 12749 raft_consensus.cc:385] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.468755 12749 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.468219 12457 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.469077 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:35.471521 12749 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.472144 12629 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.476853 12749 ts_tablet_manager.cc:1434] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260709 12:23:35.479718 12956 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.480103 12749 tablet_bootstrap.cc:492] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.480424 12956 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.482965 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:35.483107 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.483626 12707 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.483731 12558 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.484756 12751 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.485067 12674 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.485888 12992 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.486284 12992 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.486696 12992 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.488852 12798 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.491827 12956 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.498004 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.499665 12634 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.521368 12751 tablet_bootstrap.cc:654] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.519021 12992 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.527909 12750 tablet_bootstrap.cc:492] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: No bootstrap required, opened a new log
I20260709 12:23:35.529311 12956 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.529878 12956 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.532177 12956 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.533335 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:35.534952 12671 leader_election.cc:343] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.535480 12629 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:35.536517 12522 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:35.537308 13071 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.537796 13071 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:35.535921 12707 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:23:35.538590 13071 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.583827 12750 ts_tablet_manager.cc:1403] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: Time spent bootstrapping tablet: real 0.148s	user 0.019s	sys 0.019s
I20260709 12:23:35.584910 13063 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.584878 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.585701 12555 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.585565 13063 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.587641 12750 raft_consensus.cc:359] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.588675 12750 raft_consensus.cc:385] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.589038 12750 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.613517 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.587764 13063 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.621025 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:35.621788 12835 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.622140 12835 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.622437 12835 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.627415 12750 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.638257 12750 ts_tablet_manager.cc:1434] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.001s
I20260709 12:23:35.645810 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:35.646796 12835 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:35.647877 12523 leader_election.cc:343] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:35.658576 12522 leader_election.cc:343] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.659132 12522 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.660931 12835 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.663564 12749 tablet_bootstrap.cc:654] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.663654 12992 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.679997 13131 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.689342 12751 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.689910 12751 ts_tablet_manager.cc:1403] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.209s	user 0.021s	sys 0.011s
W20260709 12:23:35.692744 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 50466.3us
I20260709 12:23:35.696058 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:35.696655 12557 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.698071 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:35.698273 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:35.698660 12558 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.698737 12627 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.704491 12557 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.704975 12558 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.706410 12674 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.707403 12627 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:35.707559 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.709424 13076 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.709393 12992 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:35.711516 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:35.717247 13076 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:35.718204 13076 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.722851 12992 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:35.723783 12992 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.727902 13089 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.728400 13089 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:35.729511 12671 leader_election.cc:343] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.730432 13089 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.732069 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:23:35.733922 12523 leader_election.cc:343] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.733804 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:35.736124 12522 leader_election.cc:343] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.736744 12522 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.737541 13089 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.741554 12751 raft_consensus.cc:359] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.741572 13132 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.748972 12751 raft_consensus.cc:385] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.749327 12751 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.741160 12457 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 0 to 1, leader changed from <none> to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:35.750069 12751 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.747838 12749 tablet_bootstrap.cc:492] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.752051 12749 ts_tablet_manager.cc:1403] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.272s	user 0.025s	sys 0.023s
I20260709 12:23:35.752576 12751 ts_tablet_manager.cc:1434] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.000s
I20260709 12:23:35.766635 12749 raft_consensus.cc:359] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.770042 12751 tablet_bootstrap.cc:492] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.772984 12992 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.774857 12992 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.780608 12454 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.782724 12454 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:35.783861 12749 raft_consensus.cc:385] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.786232 12749 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.787153 12749 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.790524 12749 ts_tablet_manager.cc:1434] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.003s
I20260709 12:23:35.796904 12749 tablet_bootstrap.cc:492] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.797483 12751 tablet_bootstrap.cc:654] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.818922 12749 tablet_bootstrap.cc:654] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.852456 12751 tablet_bootstrap.cc:492] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.852913 12751 ts_tablet_manager.cc:1403] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.089s	user 0.026s	sys 0.018s
I20260709 12:23:35.852967 12749 tablet_bootstrap.cc:492] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.853458 12749 ts_tablet_manager.cc:1403] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.057s	user 0.007s	sys 0.004s
I20260709 12:23:35.853817 12835 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.855499 12751 raft_consensus.cc:359] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.856190 12751 raft_consensus.cc:385] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.856444 12751 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.857148 12749 raft_consensus.cc:359] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.857170 12751 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.859687 12751 ts_tablet_manager.cc:1434] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:35.860569 12751 tablet_bootstrap.cc:492] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.857966 12749 raft_consensus.cc:385] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.861578 12749 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.862350 12749 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.864418 12749 ts_tablet_manager.cc:1434] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:35.865315 12749 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.866335 12751 tablet_bootstrap.cc:654] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.871351 12749 tablet_bootstrap.cc:654] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.874576 12992 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:35.883291 13139 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.883787 13139 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.886018 13139 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.894167 12749 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:35.894217 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:35.899636 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.900708 12557 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 1: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:23:35.902279 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:35.903249 13139 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.894682 12749 ts_tablet_manager.cc:1403] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.009s
I20260709 12:23:35.913612 13089 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.914521 13089 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.916075 12992 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:35.917840 13139 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:35.924558 12749 raft_consensus.cc:359] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.929159 12749 raft_consensus.cc:385] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.929497 12749 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.930248 12751 tablet_bootstrap.cc:492] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.930748 12751 ts_tablet_manager.cc:1403] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.070s	user 0.025s	sys 0.040s
I20260709 12:23:35.933218 12751 raft_consensus.cc:359] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.933881 12751 raft_consensus.cc:385] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:35.934123 12751 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:35.934737 12751 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.937934 12751 ts_tablet_manager.cc:1434] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:35.937979 12749 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.939311 12751 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:35.939258 13076 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.939900 13076 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.945331 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:35.945848 13076 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:35.945991 12555 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:35.947162 12751 tablet_bootstrap.cc:654] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:35.947357 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:35.948755 13136 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:35.949232 13136 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:35.949685 13136 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:35.957621 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:35.958364 12749 ts_tablet_manager.cc:1434] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
W20260709 12:23:35.959306 12671 leader_election.cc:343] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:35.959575 12749 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:35.980257 13135 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:35.980808 13135 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:35.983099 13135 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:35.988255 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:35.983281 12751 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:35.989434 12751 ts_tablet_manager.cc:1403] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.006s
I20260709 12:23:35.994513 12751 raft_consensus.cc:359] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.006237 12751 raft_consensus.cc:385] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.002616 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:36.006671 12751 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.007692 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:23:36.008154 12522 leader_election.cc:343] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.008239 13136 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:36.011758 12522 leader_election.cc:343] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.007223 13089 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.013000 12751 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.014767 12751 ts_tablet_manager.cc:1434] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260709 12:23:36.015527 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:36.016074 12751 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:36.022274 12751 tablet_bootstrap.cc:654] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.023489 12992 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.024112 12992 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.016074 12634 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.026607 12992 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:36.028580 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:36.029292 12555 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:36.030400 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:36.031164 12559 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.031046 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:36.032366 12992 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.032904 12992 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.033210 12992 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.035072 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:36.035936 12629 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
W20260709 12:23:36.038834 12523 leader_election.cc:343] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.039232 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:36.041917 12992 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.044839 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:36.045428 12555 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.046845 12634 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:36.047688 13139 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.049180 13139 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.051594 12751 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:36.052057 12751 ts_tablet_manager.cc:1403] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.008s
I20260709 12:23:36.052778 13139 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.054332 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:36.054651 12751 raft_consensus.cc:359] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.055315 12751 raft_consensus.cc:385] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.055176 12554 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:36.055645 12751 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.056277 12751 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.056751 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:36.058171 13134 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.058683 13134 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.058949 13135 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.059131 13134 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.059971 12555 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:36.061203 12992 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:36.062114 12751 ts_tablet_manager.cc:1434] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:36.063035 12751 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:36.063489 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:36.064759 13076 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.065236 13076 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:36.066179 13076 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.069582 12751 tablet_bootstrap.cc:654] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.075132 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:36.076085 12702 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:36.077909 13131 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.078325 12559 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:36.078368 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:36.097565 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:36.098829 13076 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.099431 13076 raft_consensus.cc:697] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:36.100255 13076 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.084303 13136 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:36.085536 12749 tablet_bootstrap.cc:654] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.087158 12751 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:36.107885 12751 ts_tablet_manager.cc:1403] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.006s
I20260709 12:23:36.098932 12454 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.110515 12751 raft_consensus.cc:359] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.111177 12751 raft_consensus.cc:385] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.111418 12751 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.112025 12751 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.115806 12751 ts_tablet_manager.cc:1434] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.002s
I20260709 12:23:36.116744 12751 tablet_bootstrap.cc:492] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Bootstrap starting.
I20260709 12:23:36.126562 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:36.127177 12627 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.073086 13134 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:36.130146 12523 leader_election.cc:343] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.130560 12523 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:36.131687 13089 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.133131 13089 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.136744 12992 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.137614 12627 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:36.142681 13134 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.143800 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:36.144459 12558 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.144944 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:36.145607 12702 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.152246 12558 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:36.153573 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:36.154587 12749 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:36.155076 12749 ts_tablet_manager.cc:1403] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.000s
I20260709 12:23:36.156244 13139 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.156915 13139 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:36.157775 13139 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.167443 12702 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:36.165498 12454 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.173434 12751 tablet_bootstrap.cc:654] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.176383 13132 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.180146 12749 raft_consensus.cc:359] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.181190 12749 raft_consensus.cc:385] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.181558 12749 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.182299 12749 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.184410 12749 ts_tablet_manager.cc:1434] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.029s	user 0.003s	sys 0.003s
I20260709 12:23:36.185276 12749 tablet_bootstrap.cc:492] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:36.184821 12457 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.192317 12749 tablet_bootstrap.cc:654] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.203370 12751 tablet_bootstrap.cc:492] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: No bootstrap required, opened a new log
I20260709 12:23:36.203824 12751 ts_tablet_manager.cc:1403] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Time spent bootstrapping tablet: real 0.087s	user 0.019s	sys 0.007s
I20260709 12:23:36.206864 12751 raft_consensus.cc:359] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.207535 12751 raft_consensus.cc:385] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.207810 12751 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.208424 12751 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.210489 12751 ts_tablet_manager.cc:1434] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:36.220259 13134 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.220891 13134 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.225821 13134 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.226257 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:36.226966 12559 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:36.227474 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:36.228138 12600 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:23:36.228799 12598 leader_election.cc:343] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.228956 13139 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.229339 13139 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.229718 13139 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.234160 12749 tablet_bootstrap.cc:492] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:36.234644 12749 ts_tablet_manager.cc:1403] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.029s
I20260709 12:23:36.236692 13139 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.237249 12749 raft_consensus.cc:359] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.237957 12749 raft_consensus.cc:385] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.238219 12749 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.238862 12749 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.239334 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:36.240072 12559 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.241029 12749 ts_tablet_manager.cc:1434] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:36.241940 12749 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: Bootstrap starting.
I20260709 12:23:36.246456 13139 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.247498 12749 tablet_bootstrap.cc:654] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:36.247767 12559 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:36.247656 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:36.249042 12600 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:23:36.251736 12598 leader_election.cc:343] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:36.256101 13134 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.257388 13134 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:36.259924 12749 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: No bootstrap required, opened a new log
I20260709 12:23:36.260454 12749 ts_tablet_manager.cc:1403] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260709 12:23:36.260104 13134 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.263059 12749 raft_consensus.cc:359] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.263792 12749 raft_consensus.cc:385] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:36.264094 12749 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Initialized, Role: FOLLOWER
I20260709 12:23:36.264758 12749 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.266885 12749 ts_tablet_manager.cc:1434] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:36.275326 12457 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.296391 12992 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.299631 12992 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.319787 13132 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.320261 13132 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.322280 13132 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:36.323868 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:36.324591 12558 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 1: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:23:36.328529 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:36.330199 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:36.331240 13132 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.339306 13132 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:36.354043 13132 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.354650 13132 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.357520 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:36.358101 12558 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
I20260709 12:23:36.359251 12674 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:36.359925 12992 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.360252 12992 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.360523 12992 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.361732 13132 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:36.364401 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:36.366117 12627 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 0.
W20260709 12:23:36.367892 12505 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:36.367776 12992 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.370123 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:36.370340 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:36.370653 12559 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.370836 12627 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.373077 12992 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:36.377733 12559 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:36.378873 12674 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:36.379706 13136 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.380175 13136 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:36.380893 13136 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.384858 12627 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:23:36.392175 12456 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:36.447997 13139 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:36.448467 13139 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.450400 13139 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.451076 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:36.451435 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:36.451684 12558 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:36.452042 12702 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 0.
I20260709 12:23:36.453188 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:36.453896 13139 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:36.454249 13139 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:36.454592 13139 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.459111 13139 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.460610 13139 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:36.461216 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:36.461551 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:36.461783 12558 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.462112 12702 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:36.465600 12558 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:36.466495 12702 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:23:36.466542 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:36.467393 13139 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:36.467819 13139 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:36.468611 13139 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:36.478181 12456 catalog_manager.cc:5697] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 0 to 1, leader changed from <none> to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:36.523902 13076 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.540418 13132 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.552897 13137 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.566581 13076 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.586735 13134 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.588956 13134 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.780553 13076 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.781563 13137 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.844758 13139 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:36.858371 13181 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:36.966046 13134 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:37.057999 13134 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:37.435660 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:37.467993 13192 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.468035 13190 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:37.468050 13189 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:37.469815 11392 server_base.cc:1061] running on GCE node
I20260709 12:23:37.474426 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:37.474753 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:37.474972 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783599817474957 us; error 0 us; skew 500 ppm
I20260709 12:23:37.475569 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:37.478392 11392 webserver.cc:533] Webserver started at http://127.11.32.4:39069/ using document root <none> and password file <none>
I20260709 12:23:37.479012 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:37.479235 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:37.479547 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:37.480820 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-3-root/instance:
uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-sckv"
I20260709 12:23:37.486297 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:23:37.490857 13197 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.491816 11392 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.002s
I20260709 12:23:37.492206 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-3-root
uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
format_stamp: "Formatted at 2026-07-09 12:23:37 on dist-test-slave-sckv"
I20260709 12:23:37.492527 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:37.504791 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:37.506135 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:37.507743 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:37.510591 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:37.510783 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.511092 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:37.511274 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:37.586184 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.4:37323
I20260709 12:23:37.586302 13259 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.4:37323 every 8 connection(s)
I20260709 12:23:37.592180 11392 auto_leader_rebalancer-test.cc:439] add a tserver: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:37.619100 13260 heartbeater.cc:344] Connected to a master server at 127.11.32.62:45335
I20260709 12:23:37.619580 13260 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:37.620558 13260 heartbeater.cc:507] Master 127.11.32.62:45335 requested a full tablet report, sending...
I20260709 12:23:37.622709 12454 ts_manager.cc:194] Registered new tserver with Master: 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:23:37.624015 12454 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34372
I20260709 12:23:38.504520 12559 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:38.514055 12702 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.515720 13267 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:38.531638 12629 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.536680 13185 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.537699 13267 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.539218 12705 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.544972 12627 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.556361 12454 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:38.574234 12522 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4719532adf46473495ced717a908a078. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.591905 12627 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:38.603143 12705 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.603592 12559 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.605319 13184 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:38.607364 13184 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:38.617964 12597 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3f9ecf42cca34c34954029c3568e54b2. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.619181 13184 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.621105 12705 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.624009 12559 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.626358 13260 heartbeater.cc:499] Master 127.11.32.62:45335 was elected leader, sending a full tablet report...
I20260709 12:23:38.645287 12456 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.658541 12705 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:38.671387 12559 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.675235 13137 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:38.696244 12627 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.697726 13137 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.701862 13265 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.713807 12558 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.736333 12454 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:38.744226 12671 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1a59b6927edd4e21a78fe14b7acdad1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.744740 12558 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:38.736295 12627 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:23:38.767437 12522 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ca7fa9a22ba4b0b8300a42169fced1c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:38.769027 12702 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.770030 12629 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:38.770329 13185 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.771574 13071 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:38.784752 13267 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.786026 12702 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.787647 12629 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.804713 12457 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:38.895336 13295 ts_tablet_manager.cc:933] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:38.899710 13295 tablet_copy_client.cc:323] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:38.913601 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 4719532adf46473495ced717a908a078 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:38.914269 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 4719532adf46473495ced717a908a078 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-4719532adf46473495ced717a908a078
I20260709 12:23:38.928612 12569 tablet_copy_source_session.cc:215] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:38.934742 13295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4719532adf46473495ced717a908a078. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.953111 13295 tablet_copy_client.cc:806] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:38.953893 13295 tablet_copy_client.cc:670] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:38.994758 13295 tablet_copy_client.cc:538] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.012526 13295 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:39.037631 13295 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:39.038611 13295 tablet_bootstrap.cc:492] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:39.039350 13295 ts_tablet_manager.cc:1403] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.027s	user 0.022s	sys 0.004s
I20260709 12:23:39.042384 13295 raft_consensus.cc:359] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.043244 13295 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:39.043965 13295 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.047694 13295 ts_tablet_manager.cc:1434] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:23:39.049356 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-4719532adf46473495ced717a908a078 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:39.049875 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-4719532adf46473495ced717a908a078 on tablet 4719532adf46473495ced717a908a078 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:39.114734 13295 ts_tablet_manager.cc:933] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:39.116344 13295 tablet_copy_client.cc:323] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:39.125947 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 1a59b6927edd4e21a78fe14b7acdad1c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:39.126439 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 1a59b6927edd4e21a78fe14b7acdad1c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-1a59b6927edd4e21a78fe14b7acdad1c
I20260709 12:23:39.131556 12718 tablet_copy_source_session.cc:215] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.134266 13295 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a59b6927edd4e21a78fe14b7acdad1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.147439 13295 tablet_copy_client.cc:806] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.148131 13295 tablet_copy_client.cc:670] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.152211 13295 tablet_copy_client.cc:538] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.160593 13295 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:39.175189 13302 ts_tablet_manager.cc:933] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:39.177755 13302 tablet_copy_client.cc:323] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:39.188134 13295 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:39.189103 13295 tablet_bootstrap.cc:492] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:39.190335 13295 ts_tablet_manager.cc:1403] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.009s
I20260709 12:23:39.194742 13295 raft_consensus.cc:359] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.195858 13295 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:39.196496 13295 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.214860 13295 ts_tablet_manager.cc:1434] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.024s	user 0.003s	sys 0.003s
I20260709 12:23:39.216926 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-1a59b6927edd4e21a78fe14b7acdad1c received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:39.217389 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-1a59b6927edd4e21a78fe14b7acdad1c on tablet 1a59b6927edd4e21a78fe14b7acdad1c with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:39.226416 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 3f9ecf42cca34c34954029c3568e54b2 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:39.227003 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 3f9ecf42cca34c34954029c3568e54b2 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-3f9ecf42cca34c34954029c3568e54b2
I20260709 12:23:39.235050 12644 tablet_copy_source_session.cc:215] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.238293 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3f9ecf42cca34c34954029c3568e54b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.254304 13302 tablet_copy_client.cc:806] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.254861 13302 tablet_copy_client.cc:670] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.259521 13302 tablet_copy_client.cc:538] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.270045 13302 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:39.307400 13302 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:39.308300 13302 tablet_bootstrap.cc:492] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:39.309264 13302 ts_tablet_manager.cc:1403] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.039s	user 0.028s	sys 0.008s
I20260709 12:23:39.314277 13302 raft_consensus.cc:359] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.315158 13302 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:39.315796 13302 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.318013 13302 ts_tablet_manager.cc:1434] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:39.319600 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-3f9ecf42cca34c34954029c3568e54b2 received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:39.320032 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-3f9ecf42cca34c34954029c3568e54b2 on tablet 3f9ecf42cca34c34954029c3568e54b2 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:39.370407 13302 ts_tablet_manager.cc:933] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:39.372073 13302 tablet_copy_client.cc:323] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:39.374168 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 2ca7fa9a22ba4b0b8300a42169fced1c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:39.374763 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 2ca7fa9a22ba4b0b8300a42169fced1c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-2ca7fa9a22ba4b0b8300a42169fced1c
I20260709 12:23:39.381278 12569 tablet_copy_source_session.cc:215] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:39.385298 13302 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ca7fa9a22ba4b0b8300a42169fced1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.395293 13235 raft_consensus.cc:1217] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:39.428064 13302 tablet_copy_client.cc:806] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:39.428645 13302 tablet_copy_client.cc:670] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:39.431854 13302 tablet_copy_client.cc:538] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:39.440624 13302 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:39.462330 13302 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:39.463299 13302 tablet_bootstrap.cc:492] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:39.463945 13302 ts_tablet_manager.cc:1403] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.007s
I20260709 12:23:39.466840 13302 raft_consensus.cc:359] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.467707 13302 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:39.468323 13302 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:39.470676 13302 ts_tablet_manager.cc:1434] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:39.472353 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-2ca7fa9a22ba4b0b8300a42169fced1c received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:39.472795 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-2ca7fa9a22ba4b0b8300a42169fced1c on tablet 2ca7fa9a22ba4b0b8300a42169fced1c with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:39.546702 13235 raft_consensus.cc:1217] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:39.668824 13235 raft_consensus.cc:1217] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:39.772480 13298 raft_consensus.cc:1064] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:39.774772 13298 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:39.782160 13235 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:39.785825 13311 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.786844 12634 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:39.790309 13311 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.793653 12705 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:39.795157 13234 raft_consensus.cc:1217] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:39.803761 13298 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.818662 13071 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.820391 12634 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.841158 13235 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.847457 12456 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.893271 12706 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.922219 12557 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:39.927990 13235 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:39.930774 12705 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:39.932050 13071 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:39.934316 13311 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:39.940267 13055 raft_consensus.cc:1064] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:39.942062 13298 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.944325 13055 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:39.948515 13235 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:39.963152 13234 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:39.966094 13184 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.969897 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4719532adf46473495ced717a908a078 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:39.975804 12557 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:39.977334 12706 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:39.978464 13184 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.980824 13184 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:39.981616 12454 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:39.999688 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 4719532adf46473495ced717a908a078 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:40.004503 13055 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.005985 12705 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.008695 12706 raft_consensus.cc:2955] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.033898 13327 tablet_replica.cc:333] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:40.034037 13235 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.043138 13327 raft_consensus.cc:2243] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.043877 13327 raft_consensus.cc:2272] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.049043 13327 ts_tablet_manager.cc:1916] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:40.050428 12457 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:23:40.063781 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 55806.5us
I20260709 12:23:40.065338 13327 ts_tablet_manager.cc:1929] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:40.066026 13327 log.cc:1199] T 4719532adf46473495ced717a908a078 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/4719532adf46473495ced717a908a078
I20260709 12:23:40.067967 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 4719532adf46473495ced717a908a078 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:40.069267 12557 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.090754 12627 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:40.099013 13235 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:40.100766 13323 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:40.109699 13184 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.111856 13235 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.117465 12557 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:40.128283 13322 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:40.136078 12457 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.136267 12557 raft_consensus.cc:2955] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.148507 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 3f9ecf42cca34c34954029c3568e54b2 with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:40.150880 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3f9ecf42cca34c34954029c3568e54b2 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:40.173125 13328 tablet_replica.cc:333] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:40.188194 13328 raft_consensus.cc:2243] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.188818 13328 raft_consensus.cc:2272] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.191643 13328 ts_tablet_manager.cc:1916] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:40.204954 13328 ts_tablet_manager.cc:1929] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:40.205461 13328 log.cc:1199] T 3f9ecf42cca34c34954029c3568e54b2 P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/3f9ecf42cca34c34954029c3568e54b2
I20260709 12:23:40.207540 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 3f9ecf42cca34c34954029c3568e54b2 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:40.210558 13317 raft_consensus.cc:1064] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:40.214514 13317 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:40.215873 13071 raft_consensus.cc:1064] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:40.218420 13071 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:40.224534 13235 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.224561 12557 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.224561 12634 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.227028 13317 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:40.229162 13307 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:40.231707 13307 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.239719 13234 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.241065 12627 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.242280 13071 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.243716 13185 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:40.261225 12705 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:40.263589 13185 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:40.269745 13307 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.283552 12634 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.291167 13185 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.295416 12627 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.299422 13235 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.309103 12454 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.309615 13234 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.328133 12705 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:40.337225 12706 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.341385 12629 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:40.341082 12454 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.360500 13265 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.373565 12558 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:40.374583 13265 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.377203 13233 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:40.382228 13317 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.382799 13234 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:40.383000 12627 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:40.388105 13298 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.391567 13298 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:40.398909 13298 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.400493 12627 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.392341 13233 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.406248 13234 raft_consensus.cc:2955] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.381914 12634 raft_consensus.cc:2955] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.435488 12454 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.436924 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ca7fa9a22ba4b0b8300a42169fced1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:40.445348 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1a59b6927edd4e21a78fe14b7acdad1c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:40.454599 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 1a59b6927edd4e21a78fe14b7acdad1c with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:40.456674 12456 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:40.467684 13338 tablet_replica.cc:333] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:40.478792 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ca7fa9a22ba4b0b8300a42169fced1c with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:40.479804 13328 tablet_replica.cc:333] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:40.480885 13328 raft_consensus.cc:2243] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.481709 13328 raft_consensus.cc:2272] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.483093 13338 raft_consensus.cc:2243] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:40.483863 13338 pending_rounds.cc:70] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Trying to abort 1 pending ops.
I20260709 12:23:40.484148 13338 pending_rounds.cc:77] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305624863587500032 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } } }
I20260709 12:23:40.485728 13338 raft_consensus.cc:2917] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:23:40.486215 13338 raft_consensus.cc:2889] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:23:40.486647 13338 raft_consensus.cc:2272] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:40.487061 13328 ts_tablet_manager.cc:1916] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:40.492784 13338 ts_tablet_manager.cc:1916] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:40.509768 13328 ts_tablet_manager.cc:1929] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:40.510207 13328 log.cc:1199] T 2ca7fa9a22ba4b0b8300a42169fced1c P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/2ca7fa9a22ba4b0b8300a42169fced1c
I20260709 12:23:40.510421 13338 ts_tablet_manager.cc:1929] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:40.510905 13338 log.cc:1199] T 1a59b6927edd4e21a78fe14b7acdad1c P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/1a59b6927edd4e21a78fe14b7acdad1c
I20260709 12:23:40.511724 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 2ca7fa9a22ba4b0b8300a42169fced1c (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:40.512590 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 1a59b6927edd4e21a78fe14b7acdad1c (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:41.567127 12558 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:41.572814 12706 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:41.573565 12522 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 75aab4686614449489ce5c08d0860bd6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.574113 12631 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:41.574244 13339 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.575356 13298 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.584057 13339 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.585755 12631 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.590219 12706 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.603310 12455 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.607391 12703 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:41.627936 12631 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:41.628084 12671 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c5facffc88a94bc58f10135f6686804c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.628789 12558 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:41.629290 13317 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.630177 13307 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.640169 13307 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.647614 12558 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.658946 12457 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.674815 12627 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.685189 12703 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:23:41.702714 12671 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 74acfff7189b45af8e177ff563645d9d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.703284 12557 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:41.702134 12631 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:41.706037 13352 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.708878 13353 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.716619 13352 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.728682 12631 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.736374 12455 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.742532 12557 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.744553 12559 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:41.764715 12703 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:41.765240 12522 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 793f816912494728bf76dd612942dc4c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:41.766618 13339 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.768301 12631 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:41.769649 13339 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:41.778487 13341 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.780812 12703 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.786027 12627 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:41.798127 12457 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:42.055783 13361 ts_tablet_manager.cc:933] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:42.057755 13361 tablet_copy_client.cc:323] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:42.059692 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet c5facffc88a94bc58f10135f6686804c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:42.060196 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet c5facffc88a94bc58f10135f6686804c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-c5facffc88a94bc58f10135f6686804c
I20260709 12:23:42.065773 12718 tablet_copy_source_session.cc:215] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.068902 13361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c5facffc88a94bc58f10135f6686804c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.085309 13361 tablet_copy_client.cc:806] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.085984 13361 tablet_copy_client.cc:670] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.099119 13361 tablet_copy_client.cc:538] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.109668 13361 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:42.135694 13364 ts_tablet_manager.cc:933] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:42.141847 13361 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.142984 13361 tablet_bootstrap.cc:492] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:42.143402 13364 tablet_copy_client.cc:323] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:42.144634 13361 ts_tablet_manager.cc:1403] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.008s
I20260709 12:23:42.145104 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 75aab4686614449489ce5c08d0860bd6 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:42.145725 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 75aab4686614449489ce5c08d0860bd6 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-75aab4686614449489ce5c08d0860bd6
I20260709 12:23:42.150261 13361 raft_consensus.cc:359] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.151335 13361 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:42.152076 13361 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.155449 12569 tablet_copy_source_session.cc:215] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.155525 13361 ts_tablet_manager.cc:1434] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:42.158002 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-c5facffc88a94bc58f10135f6686804c received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:42.158416 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-c5facffc88a94bc58f10135f6686804c on tablet c5facffc88a94bc58f10135f6686804c with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:42.159231 13364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75aab4686614449489ce5c08d0860bd6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.181766 13364 tablet_copy_client.cc:806] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.182598 13364 tablet_copy_client.cc:670] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.186954 13364 tablet_copy_client.cc:538] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.191959 13361 ts_tablet_manager.cc:933] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:42.197641 13361 tablet_copy_client.cc:323] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:42.198967 13364 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:42.199429 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 793f816912494728bf76dd612942dc4c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:42.200065 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 793f816912494728bf76dd612942dc4c from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-793f816912494728bf76dd612942dc4c
I20260709 12:23:42.208513 12569 tablet_copy_source_session.cc:215] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.212998 13361 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 793f816912494728bf76dd612942dc4c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.227205 13364 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.228171 13364 tablet_bootstrap.cc:492] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:42.228752 13364 ts_tablet_manager.cc:1403] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.030s	user 0.013s	sys 0.007s
I20260709 12:23:42.230778 13361 tablet_copy_client.cc:806] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.231405 13361 tablet_copy_client.cc:670] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.231823 13364 raft_consensus.cc:359] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.232753 13364 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:42.233453 13364 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.237386 13364 ts_tablet_manager.cc:1434] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:23:42.240746 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-75aab4686614449489ce5c08d0860bd6 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:42.241005 13361 tablet_copy_client.cc:538] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.241190 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-75aab4686614449489ce5c08d0860bd6 on tablet 75aab4686614449489ce5c08d0860bd6 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:42.246507 13364 ts_tablet_manager.cc:933] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:42.262234 13361 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:42.281739 13364 tablet_copy_client.cc:323] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:42.283561 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 74acfff7189b45af8e177ff563645d9d from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:42.284032 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 74acfff7189b45af8e177ff563645d9d from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-74acfff7189b45af8e177ff563645d9d
I20260709 12:23:42.289736 12718 tablet_copy_source_session.cc:215] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:42.293259 13364 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 74acfff7189b45af8e177ff563645d9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:42.303056 13361 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.303999 13361 tablet_bootstrap.cc:492] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:42.305554 13361 ts_tablet_manager.cc:1403] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.012s
I20260709 12:23:42.315858 13361 raft_consensus.cc:359] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.316805 13361 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:42.317590 13361 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.319130 13364 tablet_copy_client.cc:806] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:42.319702 13364 tablet_copy_client.cc:670] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:42.323400 13364 tablet_copy_client.cc:538] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:42.325750 13361 ts_tablet_manager.cc:1434] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.020s	user 0.010s	sys 0.003s
I20260709 12:23:42.329788 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-793f816912494728bf76dd612942dc4c received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:42.330232 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-793f816912494728bf76dd612942dc4c on tablet 793f816912494728bf76dd612942dc4c with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:42.332929 13364 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:42.351637 13364 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:42.352373 13364 tablet_bootstrap.cc:492] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:42.352931 13364 ts_tablet_manager.cc:1403] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.008s
I20260709 12:23:42.355245 13364 raft_consensus.cc:359] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.355875 13364 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:42.356469 13364 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:42.358749 13364 ts_tablet_manager.cc:1434] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:42.360352 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-74acfff7189b45af8e177ff563645d9d received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:42.360817 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-74acfff7189b45af8e177ff563645d9d on tablet 74acfff7189b45af8e177ff563645d9d with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:42.499091 13233 raft_consensus.cc:1217] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:42.511962 13233 raft_consensus.cc:1217] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:42.678014 13233 raft_consensus.cc:1217] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:42.709352 13233 raft_consensus.cc:1217] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:43.022540 13317 raft_consensus.cc:1064] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:43.024504 13317 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.034675 12634 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.034799 13233 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.037345 13317 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.038012 12559 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.038722 13344 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.043920 13374 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.063097 13344 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.064837 12631 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.067063 12557 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.089367 12454 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.104045 13341 raft_consensus.cc:1064] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:43.106727 13341 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.120205 13233 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.122040 13298 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:43.127617 13234 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.129480 12631 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.134083 12706 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.137132 13298 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:23:43.152436 13339 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.173008 13298 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.176259 12703 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.196353 13379 raft_consensus.cc:1064] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:43.199411 13379 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.203435 12631 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.203442 13233 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.181129 12627 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.205919 13317 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.207471 13344 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.214636 13353 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.219358 12631 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.223099 12703 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.223917 13233 raft_consensus.cc:2955] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.228315 13234 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.242741 12455 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.246708 12457 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.260056 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c5facffc88a94bc58f10135f6686804c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:43.266549 12559 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.269673 13379 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:43.272083 13233 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.275247 13353 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.276532 12627 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.281356 13353 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.282719 13341 raft_consensus.cc:1064] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:43.285331 13341 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.286808 12557 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.290278 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet c5facffc88a94bc58f10135f6686804c with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:43.296033 13234 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.298326 13339 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.296788 12703 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.305119 13298 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.312947 13298 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.319847 13234 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.327159 13233 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.330154 13393 tablet_replica.cc:333] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:43.330030 13379 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.331686 13393 raft_consensus.cc:2243] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.332854 13393 raft_consensus.cc:2272] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.332227 12559 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.344192 12631 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.354243 13393 ts_tablet_manager.cc:1916] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:43.356930 13389 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:23:43.358143 13395 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:23:43.369868 12456 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.378880 12455 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.388409 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 75aab4686614449489ce5c08d0860bd6 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
W20260709 12:23:43.397737 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 71685.3us
I20260709 12:23:43.402185 12702 raft_consensus.cc:2955] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.403138 12703 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:43.406208 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 77183.2us
I20260709 12:23:43.408589 12631 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:43.410373 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 75aab4686614449489ce5c08d0860bd6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:43.419368 13393 ts_tablet_manager.cc:1929] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:43.419957 13393 log.cc:1199] T c5facffc88a94bc58f10135f6686804c P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/c5facffc88a94bc58f10135f6686804c
I20260709 12:23:43.423360 13233 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.426962 13399 tablet_replica.cc:333] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:43.428328 13397 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:43.440563 13398 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:43.447067 12702 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.456919 13233 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.458842 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet c5facffc88a94bc58f10135f6686804c (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:43.460748 13317 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.466739 12631 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.469331 13317 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.470486 13402 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.472015 13353 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.477869 13233 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.484449 12702 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.520179 13234 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.521354 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 74acfff7189b45af8e177ff563645d9d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:43.521492 12453 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.541314 12455 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.549093 12634 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.573065 13399 raft_consensus.cc:2243] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.573948 13399 raft_consensus.cc:2272] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.576061 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 74acfff7189b45af8e177ff563645d9d with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:43.577299 13393 tablet_replica.cc:333] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:43.577862 13399 ts_tablet_manager.cc:1916] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:43.578493 13393 raft_consensus.cc:2243] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.579336 13393 raft_consensus.cc:2272] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.585850 13393 ts_tablet_manager.cc:1916] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:43.569342 12558 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:43.604274 13399 ts_tablet_manager.cc:1929] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:43.604856 13399 log.cc:1199] T 75aab4686614449489ce5c08d0860bd6 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/75aab4686614449489ce5c08d0860bd6
I20260709 12:23:43.606658 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 75aab4686614449489ce5c08d0860bd6 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:43.612912 13233 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.614847 13389 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:43.619320 13393 ts_tablet_manager.cc:1929] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:43.619638 12705 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:43.620642 12631 raft_consensus.cc:2955] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.621444 13401 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:43.619835 13393 log.cc:1199] T 74acfff7189b45af8e177ff563645d9d P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/74acfff7189b45af8e177ff563645d9d
I20260709 12:23:43.623665 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 74acfff7189b45af8e177ff563645d9d (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:43.624601 13389 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.630843 13233 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.638993 12703 raft_consensus.cc:2955] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.644095 12454 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:43.648167 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 793f816912494728bf76dd612942dc4c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:43.662250 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 793f816912494728bf76dd612942dc4c with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:43.663865 13399 tablet_replica.cc:333] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:43.664914 13399 raft_consensus.cc:2243] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:43.665688 13399 raft_consensus.cc:2272] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:43.673640 13399 ts_tablet_manager.cc:1916] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:43.686774 13399 ts_tablet_manager.cc:1929] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:43.687062 13399 log.cc:1199] T 793f816912494728bf76dd612942dc4c P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/793f816912494728bf76dd612942dc4c
I20260709 12:23:43.688306 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 793f816912494728bf76dd612942dc4c (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:44.725049 12558 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:23:44.731418 12522 consensus_peers.cc:597] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 140159e481364d9e99f0f034c42b7fda. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:44.731721 12706 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:44.732174 12631 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:44.733464 13401 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.734335 13389 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.741832 13401 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.743512 12706 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.744972 12631 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.761741 12453 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.762748 12558 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:44.777057 12706 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:44.778474 12522 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 936a02b62f0d46168b0550920bd53ed3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:44.780158 12631 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:44.779031 13401 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:23:44.783139 13411 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:44.808037 13408 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.809760 12706 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.809684 12631 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.823669 12631 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:44.828115 12454 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.837525 12706 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:44.838076 12597 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33554b5715244a96b9faa863336bdc3b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:44.838944 13354 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.840058 12558 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:44.841229 13354 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.847693 13405 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.852465 12706 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.867924 12453 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.893791 12557 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.895399 12631 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:23:44.910640 12597 consensus_peers.cc:597] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d457e0ba678747fba0ac2a4c1b42649e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:44.914696 12706 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:44.915906 12558 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:44.918008 13354 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.918927 13424 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:44.933904 13354 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.936053 12557 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.936407 12703 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:44.957276 12454 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.282189 13428 ts_tablet_manager.cc:933] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:45.284610 13428 tablet_copy_client.cc:323] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:45.286276 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 140159e481364d9e99f0f034c42b7fda from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:45.286815 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 140159e481364d9e99f0f034c42b7fda from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-140159e481364d9e99f0f034c42b7fda
I20260709 12:23:45.293752 12569 tablet_copy_source_session.cc:215] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:45.297298 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 140159e481364d9e99f0f034c42b7fda. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:45.312937 13428 tablet_copy_client.cc:806] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:45.313580 13428 tablet_copy_client.cc:670] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:45.313764 13430 ts_tablet_manager.cc:933] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:45.315953 13430 tablet_copy_client.cc:323] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:45.317970 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 936a02b62f0d46168b0550920bd53ed3 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:45.318529 13428 tablet_copy_client.cc:538] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:45.318495 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 936a02b62f0d46168b0550920bd53ed3 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-936a02b62f0d46168b0550920bd53ed3
I20260709 12:23:45.318938 13432 ts_tablet_manager.cc:933] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:45.327901 13432 tablet_copy_client.cc:323] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:45.329870 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet d457e0ba678747fba0ac2a4c1b42649e from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:45.329484 12569 tablet_copy_source_session.cc:215] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:45.330420 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet d457e0ba678747fba0ac2a4c1b42649e from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-d457e0ba678747fba0ac2a4c1b42649e
I20260709 12:23:45.335289 13430 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936a02b62f0d46168b0550920bd53ed3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:45.337461 12644 tablet_copy_source_session.cc:215] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:45.347093 13432 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d457e0ba678747fba0ac2a4c1b42649e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:45.351138 13428 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:45.351557 13430 tablet_copy_client.cc:806] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:45.352195 13430 tablet_copy_client.cc:670] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:45.355907 13430 tablet_copy_client.cc:538] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:45.367720 13430 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:45.370848 13432 tablet_copy_client.cc:806] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:45.371547 13432 tablet_copy_client.cc:670] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:45.377975 13432 tablet_copy_client.cc:538] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:45.398241 13432 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:45.400359 13428 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.402109 13430 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.403465 13430 tablet_bootstrap.cc:492] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:45.403421 13428 tablet_bootstrap.cc:492] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:45.404448 13430 ts_tablet_manager.cc:1403] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.037s	user 0.025s	sys 0.004s
I20260709 12:23:45.404495 13428 ts_tablet_manager.cc:1403] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.054s	user 0.022s	sys 0.007s
I20260709 12:23:45.408836 13428 raft_consensus.cc:359] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.409813 13428 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:45.410501 13428 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.411047 13430 raft_consensus.cc:359] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.412002 13430 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:45.412734 13430 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.423491 13428 ts_tablet_manager.cc:1434] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:23:45.425944 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-140159e481364d9e99f0f034c42b7fda received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:45.426370 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-140159e481364d9e99f0f034c42b7fda on tablet 140159e481364d9e99f0f034c42b7fda with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:45.464280 13428 ts_tablet_manager.cc:933] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:45.482178 13428 tablet_copy_client.cc:323] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:45.483862 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 33554b5715244a96b9faa863336bdc3b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:45.484378 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 33554b5715244a96b9faa863336bdc3b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-33554b5715244a96b9faa863336bdc3b
I20260709 12:23:45.492297 12644 tablet_copy_source_session.cc:215] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:45.495599 13428 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33554b5715244a96b9faa863336bdc3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:45.509459 13428 tablet_copy_client.cc:806] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:45.510107 13428 tablet_copy_client.cc:670] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:45.514025 13428 tablet_copy_client.cc:538] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:45.526515 13428 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:45.533885 13432 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.534134 13430 ts_tablet_manager.cc:1434] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.122s	user 0.010s	sys 0.004s
I20260709 12:23:45.536257 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-936a02b62f0d46168b0550920bd53ed3 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:45.536656 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-936a02b62f0d46168b0550920bd53ed3 on tablet 936a02b62f0d46168b0550920bd53ed3 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:45.539186 13432 tablet_bootstrap.cc:492] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:45.539953 13432 ts_tablet_manager.cc:1403] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.142s	user 0.042s	sys 0.036s
I20260709 12:23:45.542976 13432 raft_consensus.cc:359] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.543818 13432 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:45.545647 13432 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.549669 13432 ts_tablet_manager.cc:1434] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:45.551496 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-d457e0ba678747fba0ac2a4c1b42649e received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:45.551935 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-d457e0ba678747fba0ac2a4c1b42649e on tablet d457e0ba678747fba0ac2a4c1b42649e with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:45.557482 13428 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:45.558473 13428 tablet_bootstrap.cc:492] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:45.559193 13428 ts_tablet_manager.cc:1403] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.033s	user 0.022s	sys 0.000s
I20260709 12:23:45.561944 13428 raft_consensus.cc:359] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.562769 13428 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:45.563464 13428 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:45.566862 13428 ts_tablet_manager.cc:1434] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:45.569372 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-33554b5715244a96b9faa863336bdc3b received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:45.570256 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-33554b5715244a96b9faa863336bdc3b on tablet 33554b5715244a96b9faa863336bdc3b with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:45.861078 13234 raft_consensus.cc:1217] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:45.872006 13234 raft_consensus.cc:1217] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:45.883152 13234 raft_consensus.cc:1217] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:45.927708 13234 raft_consensus.cc:1217] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:46.284857 13423 raft_consensus.cc:1064] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:46.286988 13423 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.294334 13443 raft_consensus.cc:1064] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:46.297806 13443 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.301656 13234 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.301854 12703 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.303268 13424 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.304637 13354 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:46.310904 13234 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.313030 12634 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.313509 12703 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.315071 13401 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.315358 12558 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.316992 13401 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.321125 13401 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.338467 13424 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:46.343722 13443 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.353226 12706 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.364701 12627 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.373836 13234 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.381815 12453 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.382477 13447 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.396351 13233 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.406144 12557 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.420619 12706 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.432160 13411 raft_consensus.cc:1064] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:46.434737 13411 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.456357 13233 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.457643 12631 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.458087 12706 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.459177 13411 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.460471 13443 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.462251 13443 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:46.485365 12557 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.491410 12706 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:46.492849 13401 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:46.502651 12453 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.503123 13443 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.508466 13234 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:46.510016 13411 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:46.509980 12706 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.515184 13411 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.515803 13234 raft_consensus.cc:2955] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.531236 13233 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.521697 12634 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.527911 13447 raft_consensus.cc:1064] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:46.541836 13447 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.558175 13233 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.558701 12703 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.559769 13424 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.560678 13423 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:46.565981 12705 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.588599 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 936a02b62f0d46168b0550920bd53ed3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:46.612047 12631 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.620133 13446 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.623256 13234 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.636408 12558 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:46.620769 12706 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:46.638609 13233 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:46.639178 12705 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.639899 13447 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:46.643005 12456 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.643683 13448 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:46.658315 12453 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.664016 13448 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.673019 12706 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.676009 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 936a02b62f0d46168b0550920bd53ed3 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:46.678663 12456 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:46.681648 13234 raft_consensus.cc:2955] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.677325 13446 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:46.711800 12455 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.714701 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 33554b5715244a96b9faa863336bdc3b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:46.718367 13472 tablet_replica.cc:333] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:46.720083 13472 raft_consensus.cc:2243] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.721225 13472 raft_consensus.cc:2272] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.724859 13472 ts_tablet_manager.cc:1916] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:46.732669 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 33554b5715244a96b9faa863336bdc3b with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:46.729076 12558 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.734368 13474 tablet_replica.cc:333] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:46.735287 13474 raft_consensus.cc:2243] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.736045 13474 raft_consensus.cc:2272] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.739451 13474 ts_tablet_manager.cc:1916] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:46.754216 13474 ts_tablet_manager.cc:1929] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:46.754707 13474 log.cc:1199] T 33554b5715244a96b9faa863336bdc3b P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/33554b5715244a96b9faa863336bdc3b
I20260709 12:23:46.756551 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 33554b5715244a96b9faa863336bdc3b (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:46.766052 12558 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:46.768198 13472 ts_tablet_manager.cc:1929] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:46.768642 13472 log.cc:1199] T 936a02b62f0d46168b0550920bd53ed3 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/936a02b62f0d46168b0550920bd53ed3
I20260709 12:23:46.770335 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 936a02b62f0d46168b0550920bd53ed3 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:46.771042 13234 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:46.772423 12634 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:46.772500 13460 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:46.774017 13465 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:46.779678 13460 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.781738 12634 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.781783 13234 raft_consensus.cc:2955] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.796711 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 140159e481364d9e99f0f034c42b7fda with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:46.798952 12455 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:46.810873 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 140159e481364d9e99f0f034c42b7fda with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:46.816680 13475 tablet_replica.cc:333] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:46.817786 13475 raft_consensus.cc:2243] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:46.819991 13475 raft_consensus.cc:2272] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:46.825096 13475 ts_tablet_manager.cc:1916] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:46.841337 13475 ts_tablet_manager.cc:1929] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:46.841791 13475 log.cc:1199] T 140159e481364d9e99f0f034c42b7fda P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/140159e481364d9e99f0f034c42b7fda
I20260709 12:23:46.843380 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 140159e481364d9e99f0f034c42b7fda (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:47.251430 12627 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:47.259218 13234 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.261117 13424 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:47.266965 12558 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:47.270013 13446 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:47.274091 13446 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:47.278088 12558 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:47.282059 13233 raft_consensus.cc:2955] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:47.287145 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d457e0ba678747fba0ac2a4c1b42649e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:47.299263 12453 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.322700 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet d457e0ba678747fba0ac2a4c1b42649e with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:47.324522 13475 tablet_replica.cc:333] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:47.325853 13475 raft_consensus.cc:2243] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:47.326766 13475 raft_consensus.cc:2272] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:47.331462 13475 ts_tablet_manager.cc:1916] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:47.343243 13475 ts_tablet_manager.cc:1929] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:47.343799 13475 log.cc:1199] T d457e0ba678747fba0ac2a4c1b42649e P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/d457e0ba678747fba0ac2a4c1b42649e
I20260709 12:23:47.345469 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet d457e0ba678747fba0ac2a4c1b42649e (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:48.395345 12627 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:23:48.402076 12597 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 94aed3506ab5437b8943521ce387d9e4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.402762 12703 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.403867 12559 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.404883 13483 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:48.405869 13446 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.413335 13483 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.415452 12559 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.415799 12703 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.428229 12558 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:48.431411 12455 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.439694 12702 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.440668 12627 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.442317 13460 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:23:48.443456 12522 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a6ad0911475a422ab0936b28dc4c93f1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.444087 13466 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:48.464975 13466 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.466904 12703 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.483064 12634 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.493827 12627 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:23:48.507910 12597 consensus_peers.cc:597] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 04a769018c454aa685eae73d74c89abb. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.509742 12703 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.510471 12558 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.511504 12455 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.512331 13446 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.515009 13483 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.523859 13446 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.526834 12702 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.531144 12558 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.544162 12627 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:48.546080 12455 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:48.573271 12597 consensus_peers.cc:597] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2514eba211b3456c96ca755c4c7c084b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:48.574215 12703 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.575717 13424 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.577083 12559 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:48.578652 13424 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:48.583926 13483 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.585742 12703 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.592120 12557 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.604199 12453 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:48.796897 13500 ts_tablet_manager.cc:933] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:48.799044 13500 tablet_copy_client.cc:323] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:48.801077 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 94aed3506ab5437b8943521ce387d9e4 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:48.801662 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 94aed3506ab5437b8943521ce387d9e4 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-94aed3506ab5437b8943521ce387d9e4
I20260709 12:23:48.809621 12644 tablet_copy_source_session.cc:215] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:48.812352 13500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 94aed3506ab5437b8943521ce387d9e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:48.825909 13500 tablet_copy_client.cc:806] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:48.826491 13500 tablet_copy_client.cc:670] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:48.838822 13500 tablet_copy_client.cc:538] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:48.848824 13500 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:48.866285 13500 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:48.867103 13500 tablet_bootstrap.cc:492] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:48.867900 13500 ts_tablet_manager.cc:1403] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.006s
I20260709 12:23:48.870549 13500 raft_consensus.cc:359] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:48.871379 13500 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:48.872036 13500 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:48.877099 13500 ts_tablet_manager.cc:1434] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:48.878873 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-94aed3506ab5437b8943521ce387d9e4 received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:48.879360 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-94aed3506ab5437b8943521ce387d9e4 on tablet 94aed3506ab5437b8943521ce387d9e4 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:48.962282 13500 ts_tablet_manager.cc:933] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:48.963892 13500 tablet_copy_client.cc:323] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:48.965337 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 2514eba211b3456c96ca755c4c7c084b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:48.965909 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 2514eba211b3456c96ca755c4c7c084b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-2514eba211b3456c96ca755c4c7c084b
I20260709 12:23:48.973601 12644 tablet_copy_source_session.cc:215] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:48.976861 13500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2514eba211b3456c96ca755c4c7c084b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.002168 13500 tablet_copy_client.cc:806] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.002694 13500 tablet_copy_client.cc:670] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.006702 13500 tablet_copy_client.cc:538] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.016165 13500 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:49.036545 13505 ts_tablet_manager.cc:933] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:49.039405 13505 tablet_copy_client.cc:323] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:49.041692 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet a6ad0911475a422ab0936b28dc4c93f1 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:49.042248 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet a6ad0911475a422ab0936b28dc4c93f1 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-a6ad0911475a422ab0936b28dc4c93f1
I20260709 12:23:49.043797 13500 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.044691 13500 tablet_bootstrap.cc:492] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:49.045310 13500 ts_tablet_manager.cc:1403] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.012s
I20260709 12:23:49.049639 13500 raft_consensus.cc:359] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:49.050472 13500 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:49.051080 13500 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:49.053453 13500 ts_tablet_manager.cc:1434] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:49.055007 12569 tablet_copy_source_session.cc:215] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.056160 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-2514eba211b3456c96ca755c4c7c084b received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:49.056578 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-2514eba211b3456c96ca755c4c7c084b on tablet 2514eba211b3456c96ca755c4c7c084b with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:49.059039 13500 ts_tablet_manager.cc:933] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:49.064515 13505 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6ad0911475a422ab0936b28dc4c93f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.073802 13500 tablet_copy_client.cc:323] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:49.075466 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 04a769018c454aa685eae73d74c89abb from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:49.075979 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 04a769018c454aa685eae73d74c89abb from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-04a769018c454aa685eae73d74c89abb
I20260709 12:23:49.082794 12644 tablet_copy_source_session.cc:215] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:49.084401 13505 tablet_copy_client.cc:806] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.086025 13500 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04a769018c454aa685eae73d74c89abb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:49.092214 13505 tablet_copy_client.cc:670] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.097594 13505 tablet_copy_client.cc:538] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.102066 13500 tablet_copy_client.cc:806] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:49.102628 13500 tablet_copy_client.cc:670] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:49.106528 13500 tablet_copy_client.cc:538] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:49.119534 13500 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:49.121924 13505 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:49.147310 13500 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.148154 13500 tablet_bootstrap.cc:492] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:49.148754 13500 ts_tablet_manager.cc:1403] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.008s
I20260709 12:23:49.152443 13500 raft_consensus.cc:359] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:49.153223 13500 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:49.153790 13500 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:49.155776 13500 ts_tablet_manager.cc:1434] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:49.157895 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-04a769018c454aa685eae73d74c89abb received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:49.158279 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-04a769018c454aa685eae73d74c89abb on tablet 04a769018c454aa685eae73d74c89abb with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:49.169508 13505 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:49.170812 13505 tablet_bootstrap.cc:492] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:49.171518 13505 ts_tablet_manager.cc:1403] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.011s
I20260709 12:23:49.174733 13505 raft_consensus.cc:359] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:49.175581 13505 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:49.176229 13505 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:49.178740 13505 ts_tablet_manager.cc:1434] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:49.184098 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-a6ad0911475a422ab0936b28dc4c93f1 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:49.184546 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-a6ad0911475a422ab0936b28dc4c93f1 on tablet a6ad0911475a422ab0936b28dc4c93f1 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:49.351177 13233 raft_consensus.cc:1217] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:49.383774 13233 raft_consensus.cc:1217] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:49.540867 13233 raft_consensus.cc:1217] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:49.552861 13233 raft_consensus.cc:1217] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:49.798450 13483 raft_consensus.cc:1064] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:49.800956 13483 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:49.807091 13234 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:49.808557 13483 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.809965 12703 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:49.811296 12559 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:49.812649 13483 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.825125 13517 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.838678 13483 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.841614 12703 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.855564 12559 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.865171 13234 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.867998 12456 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.878783 13446 raft_consensus.cc:1064] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:49.881430 13446 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:49.890326 13234 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:49.892805 12702 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:49.894183 13446 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.895149 13511 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.898958 12559 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:49.900497 13483 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:49.920550 12627 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:49.927115 13483 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.929322 13234 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:49.930882 13515 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:49.939311 13515 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.940201 12558 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:49.938743 12559 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.946525 13446 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:49.947079 12702 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.952450 13233 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.971783 13514 raft_consensus.cc:1064] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:49.971306 12453 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.974350 13514 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:49.988986 13483 raft_consensus.cc:1064] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:49.991891 13483 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:49.990612 13234 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:49.983067 12559 raft_consensus.cc:2955] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.003674 12627 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.008034 13513 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.015728 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2514eba211b3456c96ca755c4c7c084b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.012830 12703 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.018313 13465 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.025290 13233 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.027367 12627 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:50.030252 13465 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.036260 12453 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.046751 13232 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.048216 12706 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.048944 13232 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.050043 13511 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.051441 13515 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:50.056171 12557 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:50.058383 13530 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:50.061841 12702 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.064246 13483 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.066694 13515 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:23:50.090445 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 2514eba211b3456c96ca755c4c7c084b with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:50.105243 13530 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.106658 13234 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.122013 13515 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.122953 13465 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.123481 12706 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.126930 13233 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.133872 12454 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.134618 12557 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.143672 12456 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.147511 12703 raft_consensus.cc:2955] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.151607 13232 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.147584 12702 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.155840 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 94aed3506ab5437b8943521ce387d9e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.168344 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 94aed3506ab5437b8943521ce387d9e4 with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:50.171347 13539 tablet_replica.cc:333] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:50.172608 13539 raft_consensus.cc:2243] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.173364 13539 raft_consensus.cc:2272] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.175194 12627 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.194835 12455 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.196624 13539 ts_tablet_manager.cc:1916] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:50.201850 13540 tablet_replica.cc:333] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:50.203384 13540 raft_consensus.cc:2243] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.204285 13540 raft_consensus.cc:2272] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.216316 13539 ts_tablet_manager.cc:1929] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:50.216835 13539 log.cc:1199] T 2514eba211b3456c96ca755c4c7c084b P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/2514eba211b3456c96ca755c4c7c084b
I20260709 12:23:50.221251 13540 ts_tablet_manager.cc:1916] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:50.220746 12631 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:50.226912 12557 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.219295 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 2514eba211b3456c96ca755c4c7c084b (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:50.228358 13515 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:50.234170 13233 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.238240 13446 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.240077 13530 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.252090 12557 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.255563 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 04a769018c454aa685eae73d74c89abb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.253379 13233 raft_consensus.cc:2955] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.273859 13540 ts_tablet_manager.cc:1929] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:50.274610 13540 log.cc:1199] T 94aed3506ab5437b8943521ce387d9e4 P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/94aed3506ab5437b8943521ce387d9e4
I20260709 12:23:50.276669 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 94aed3506ab5437b8943521ce387d9e4 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:50.276499 12557 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:50.286768 13233 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.289299 12703 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:50.289603 13465 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:50.291030 13513 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:50.282478 12456 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.301946 13513 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.303887 12702 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.319346 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a6ad0911475a422ab0936b28dc4c93f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:50.321231 13233 raft_consensus.cc:2955] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.320807 12455 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:50.331278 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 04a769018c454aa685eae73d74c89abb with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:50.332297 13539 tablet_replica.cc:333] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:50.333171 13539 raft_consensus.cc:2243] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.334123 13539 raft_consensus.cc:2272] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.337900 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet a6ad0911475a422ab0936b28dc4c93f1 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:50.337481 13539 ts_tablet_manager.cc:1916] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:50.356637 13541 tablet_replica.cc:333] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:50.357844 13541 raft_consensus.cc:2243] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:50.358668 13541 raft_consensus.cc:2272] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:50.362267 13541 ts_tablet_manager.cc:1916] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:50.367751 13539 ts_tablet_manager.cc:1929] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:50.368225 13539 log.cc:1199] T 04a769018c454aa685eae73d74c89abb P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/04a769018c454aa685eae73d74c89abb
I20260709 12:23:50.369886 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 04a769018c454aa685eae73d74c89abb (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:50.377061 13541 ts_tablet_manager.cc:1929] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:50.377506 13541 log.cc:1199] T a6ad0911475a422ab0936b28dc4c93f1 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/a6ad0911475a422ab0936b28dc4c93f1
I20260709 12:23:50.379290 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet a6ad0911475a422ab0936b28dc4c93f1 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:51.409250 12702 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:51.420969 12559 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.422304 12627 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.423702 13543 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.424796 13353 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:51.427613 12671 consensus_peers.cc:597] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5548d773e7254d74bd88a9092bf7567d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.435452 13526 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.437237 12627 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.439404 12559 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.453239 12703 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:51.458395 12455 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:23:51.463475 12671 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9257ace92110474f9ba7f25a16b03161. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.466231 12559 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.467468 12631 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.468837 13353 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.479828 13526 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.506731 13353 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.528509 12557 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:51.530443 12634 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.534279 12559 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.545399 12454 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:51.562676 12703 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:51.562747 12522 consensus_peers.cc:597] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 47430c4494f1431f8fb577cd8838f972. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.565259 12634 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.565582 13513 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.567363 13465 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.580224 13513 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.582926 12634 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.584770 12703 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.607479 12634 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:51.608980 12455 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:23:51.615504 12597 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 08834ef951b049b39c60e46c2ed865e9. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:51.616576 12703 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.617085 12558 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:51.617944 13530 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:51.622969 13446 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:51.636430 13564 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.644495 12702 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.651862 12558 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.664582 12455 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:51.956754 13566 ts_tablet_manager.cc:933] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:51.958683 13566 tablet_copy_client.cc:323] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:51.960316 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 47430c4494f1431f8fb577cd8838f972 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:51.960922 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 47430c4494f1431f8fb577cd8838f972 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-47430c4494f1431f8fb577cd8838f972
I20260709 12:23:51.972398 12569 tablet_copy_source_session.cc:215] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:51.975258 13566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47430c4494f1431f8fb577cd8838f972. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.989300 13566 tablet_copy_client.cc:806] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:51.989910 13566 tablet_copy_client.cc:670] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:51.994051 13566 tablet_copy_client.cc:538] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:52.002537 13568 ts_tablet_manager.cc:933] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:52.004840 13568 tablet_copy_client.cc:323] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:52.011382 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 5548d773e7254d74bd88a9092bf7567d from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:52.012065 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 5548d773e7254d74bd88a9092bf7567d from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-5548d773e7254d74bd88a9092bf7567d
I20260709 12:23:52.010097 13566 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:52.025064 12718 tablet_copy_source_session.cc:215] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:52.031071 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5548d773e7254d74bd88a9092bf7567d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:52.084868 13566 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:52.087752 13566 tablet_bootstrap.cc:492] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:52.088902 13572 ts_tablet_manager.cc:933] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:52.090636 13568 tablet_copy_client.cc:806] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:52.092089 13568 tablet_copy_client.cc:670] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:52.092890 13566 ts_tablet_manager.cc:1403] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.083s	user 0.023s	sys 0.026s
I20260709 12:23:52.096643 13568 tablet_copy_client.cc:538] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:52.098090 13566 raft_consensus.cc:359] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.099472 13566 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:52.100612 13566 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.107110 13566 ts_tablet_manager.cc:1434] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:23:52.114300 13568 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:52.117874 13572 tablet_copy_client.cc:323] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:52.121227 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 9257ace92110474f9ba7f25a16b03161 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:52.121915 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 9257ace92110474f9ba7f25a16b03161 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-9257ace92110474f9ba7f25a16b03161
I20260709 12:23:52.129693 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-47430c4494f1431f8fb577cd8838f972 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:52.130147 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-47430c4494f1431f8fb577cd8838f972 on tablet 47430c4494f1431f8fb577cd8838f972 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:52.130156 12718 tablet_copy_source_session.cc:215] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:52.138757 13572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9257ace92110474f9ba7f25a16b03161. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:52.143175 13568 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:52.144100 13568 tablet_bootstrap.cc:492] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:52.144760 13568 ts_tablet_manager.cc:1403] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.008s
I20260709 12:23:52.147827 13568 raft_consensus.cc:359] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.148674 13568 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:52.149334 13568 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.152047 13568 ts_tablet_manager.cc:1434] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.004s
I20260709 12:23:52.154932 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-5548d773e7254d74bd88a9092bf7567d received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:52.155373 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-5548d773e7254d74bd88a9092bf7567d on tablet 5548d773e7254d74bd88a9092bf7567d with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:52.161026 13572 tablet_copy_client.cc:806] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:52.161664 13572 tablet_copy_client.cc:670] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:52.165237 13572 tablet_copy_client.cc:538] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:52.175957 13568 ts_tablet_manager.cc:933] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:52.175552 13572 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:52.190392 13568 tablet_copy_client.cc:323] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:52.194157 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 08834ef951b049b39c60e46c2ed865e9 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:52.194813 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 08834ef951b049b39c60e46c2ed865e9 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-08834ef951b049b39c60e46c2ed865e9
I20260709 12:23:52.204919 12644 tablet_copy_source_session.cc:215] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:52.208489 13568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 08834ef951b049b39c60e46c2ed865e9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:52.211901 13572 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:52.212983 13572 tablet_bootstrap.cc:492] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:52.213816 13572 ts_tablet_manager.cc:1403] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.039s	user 0.023s	sys 0.011s
I20260709 12:23:52.217142 13572 raft_consensus.cc:359] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.218150 13572 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:52.218921 13572 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.221693 13572 ts_tablet_manager.cc:1434] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:52.223683 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-9257ace92110474f9ba7f25a16b03161 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:52.224107 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-9257ace92110474f9ba7f25a16b03161 on tablet 9257ace92110474f9ba7f25a16b03161 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:52.226608 13568 tablet_copy_client.cc:806] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:52.227237 13568 tablet_copy_client.cc:670] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:52.231503 13568 tablet_copy_client.cc:538] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:52.245723 13568 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:52.273290 13568 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:52.274287 13568 tablet_bootstrap.cc:492] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:52.275012 13568 ts_tablet_manager.cc:1403] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.030s	user 0.018s	sys 0.008s
I20260709 12:23:52.278132 13568 raft_consensus.cc:359] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.279026 13568 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:52.279704 13568 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:52.282413 13568 ts_tablet_manager.cc:1434] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:52.284433 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-08834ef951b049b39c60e46c2ed865e9 received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:52.284869 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-08834ef951b049b39c60e46c2ed865e9 on tablet 08834ef951b049b39c60e46c2ed865e9 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:52.378516 13233 raft_consensus.cc:1217] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:52.475389 13233 raft_consensus.cc:1217] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:52.585119 13233 raft_consensus.cc:1217] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:52.639153 13233 raft_consensus.cc:1217] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:52.976449 13513 raft_consensus.cc:1064] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:52.978641 13513 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:52.993731 13234 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.994683 12703 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.995507 13465 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:52.997174 13580 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:53.019767 12627 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.023762 13556 raft_consensus.cc:1064] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:53.023655 13581 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.026456 13556 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:53.033571 13580 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.044566 13234 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.043239 12627 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.051987 13571 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.044497 12703 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.065294 12559 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.067068 13587 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.073796 12631 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.076439 13587 raft_consensus.cc:1064] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:53.076958 13556 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.078941 13587 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:53.083942 12455 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.098130 13234 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.099908 12557 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.101181 13587 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.103317 13233 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.104622 12629 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.112767 13584 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:53.115837 13584 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.131723 13556 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.134261 12557 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.136436 12634 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.147028 13562 raft_consensus.cc:1064] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:53.149713 13557 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.149631 13562 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:53.157076 13233 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.170524 12557 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:53.171100 12559 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.171772 12455 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.177836 13234 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.179279 13580 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.182121 12634 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.190604 13232 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.194242 13513 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.249434 13233 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.258559 12456 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.264685 13580 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.274389 13233 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.274487 12634 raft_consensus.cc:2955] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.282081 13530 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.330376 12702 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:53.335467 12706 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:53.342767 13234 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.343709 13232 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.353983 13571 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:53.360230 12634 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.358485 13557 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:23:53.373586 12456 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.382709 13556 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:53.388444 12706 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.395412 12557 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:23:53.356161 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 101040us
I20260709 12:23:53.399935 13584 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.403136 13604 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.407795 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 47430c4494f1431f8fb577cd8838f972 with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:53.410318 13557 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.415253 13233 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.423175 12634 raft_consensus.cc:2955] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.427256 13232 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.433969 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 47430c4494f1431f8fb577cd8838f972 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:53.434356 13571 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.435691 12453 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.452510 12559 raft_consensus.cc:2955] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.453361 12558 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:53.462885 13600 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:53.471350 13607 tablet_replica.cc:333] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:53.477700 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 5548d773e7254d74bd88a9092bf7567d with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:53.509281 13607 raft_consensus.cc:2243] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.510252 13607 raft_consensus.cc:2272] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.516319 13607 ts_tablet_manager.cc:1916] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:53.519253 12454 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.524034 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9257ace92110474f9ba7f25a16b03161 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:53.524786 13601 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.528482 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5548d773e7254d74bd88a9092bf7567d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:53.530174 12558 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.548621 13613 tablet_replica.cc:333] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:53.584687 13613 raft_consensus.cc:2243] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.584524 13232 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.588239 13613 raft_consensus.cc:2272] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.588384 12702 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:53.605244 13607 ts_tablet_manager.cc:1929] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:53.605890 13607 log.cc:1199] T 47430c4494f1431f8fb577cd8838f972 P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/47430c4494f1431f8fb577cd8838f972
I20260709 12:23:53.611722 13613 ts_tablet_manager.cc:1916] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:53.630523 13613 ts_tablet_manager.cc:1929] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:53.630939 13613 log.cc:1199] T 5548d773e7254d74bd88a9092bf7567d P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/5548d773e7254d74bd88a9092bf7567d
I20260709 12:23:53.671360 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 47430c4494f1431f8fb577cd8838f972 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:54.118508 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 5548d773e7254d74bd88a9092bf7567d (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:54.226362 12455 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:54.452015 12558 consensus_meta.cc:287] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.920s	user 0.017s	sys 0.007s
I20260709 12:23:54.560945 13622 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:23:54.561687 13622 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:54.563900 13622 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:54.570979 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 9257ace92110474f9ba7f25a16b03161 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:54.594007 12628 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:23:54.597729 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:23:54.607244 13635 tablet_replica.cc:333] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:54.608448 13635 raft_consensus.cc:2243] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.609100 13635 pending_rounds.cc:70] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Trying to abort 1 pending ops.
I20260709 12:23:54.609386 13635 pending_rounds.cc:77] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305624916285599744 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "9257ace92110474f9ba7f25a16b03161" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } } }
I20260709 12:23:54.610855 13635 raft_consensus.cc:2917] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 12:23:54.611290 13635 raft_consensus.cc:2889] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 12:23:54.611665 13635 raft_consensus.cc:2272] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.614398 13635 ts_tablet_manager.cc:1916] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.631798 13635 ts_tablet_manager.cc:1929] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.632225 13635 log.cc:1199] T 9257ace92110474f9ba7f25a16b03161 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/9257ace92110474f9ba7f25a16b03161
I20260709 12:23:54.633824 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 9257ace92110474f9ba7f25a16b03161 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:54.640013 13228 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.641646 13630 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.647563 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:23:54.665248 12702 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:54.668759 13630 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:54.671764 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:54.681133 13228 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:54.697017 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 08834ef951b049b39c60e46c2ed865e9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:54.698668 13623 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:54.701634 12671 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:54.702616 13631 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:54.706696 12453 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:54.710675 12706 raft_consensus.cc:2955] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:54.719686 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 08834ef951b049b39c60e46c2ed865e9 with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:54.721642 13640 tablet_replica.cc:333] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:54.722695 13640 raft_consensus.cc:2243] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:54.723412 13640 raft_consensus.cc:2272] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:54.727648 13640 ts_tablet_manager.cc:1916] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:54.739130 13640 ts_tablet_manager.cc:1929] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:54.739475 13640 log.cc:1199] T 08834ef951b049b39c60e46c2ed865e9 P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/08834ef951b049b39c60e46c2ed865e9
I20260709 12:23:54.740820 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 08834ef951b049b39c60e46c2ed865e9 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:55.161867 13629 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:23:55.162423 13629 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:55.164261 13629 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:55.164781 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:23:55.165159 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:23:55.166661 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:23:55.167243 13629 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:23:55.397372 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08001ee480 after lost signal to thread 11395
W20260709 12:23:55.398648 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1c00 after lost signal to thread 12491
W20260709 12:23:55.399595 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08003467c0 after lost signal to thread 12583
W20260709 12:23:55.400401 12580 debug-util.cc:398] Leaking SignalData structure 0x7b0800343fc0 after lost signal to thread 12658
W20260709 12:23:55.401180 12580 debug-util.cc:398] Leaking SignalData structure 0x7b080009cc60 after lost signal to thread 12732
W20260709 12:23:55.402086 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08003426c0 after lost signal to thread 13259
W20260709 12:23:55.402539 12580 debug-util.cc:398] Leaking SignalData structure 0x7b0800286520 after lost signal to thread 13613
I20260709 12:23:55.803164 12559 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:55.811322 12703 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:55.812597 12522 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0e137b72ba4847d6ad89da17af64db7d. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.812773 12628 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.813531 13619 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.814424 13641 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.834786 13629 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:55.837222 12628 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:55.842953 12703 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:55.863732 12453 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:55.870186 12634 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:55.885674 12703 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:55.885985 12597 consensus_peers.cc:597] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 613ed3057bf74d02a48d823635fd0b6a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:55.887773 12559 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:55.888221 13627 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.893141 13627 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:55.943857 13627 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:55.958482 12558 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:55.972034 12706 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.009006 12629 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.058908 12704 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.013384 13656 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:23:56.116503 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 81401.6us
W20260709 12:23:56.235555 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 132116us
W20260709 12:23:56.238551 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 60232us
I20260709 12:23:56.238108 12455 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:23:56.240550 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 160520us
W20260709 12:23:56.267249 12671 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7f25843830014b4c8c5707696cddc7f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.282558 12558 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.302261 13674 ts_tablet_manager.cc:933] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:23:56.306768 13615 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.316273 13632 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:56.339891 12633 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.359455 12702 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.362393 12556 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.363500 12455 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.378082 13674 tablet_copy_client.cc:323] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:23:56.383827 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 0e137b72ba4847d6ad89da17af64db7d from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:23:56.384584 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 0e137b72ba4847d6ad89da17af64db7d from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-0e137b72ba4847d6ad89da17af64db7d
I20260709 12:23:56.398336 12569 tablet_copy_source_session.cc:215] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:23:56.401575 12671 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e18a3c206d6646e69fba42e3b74572a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:56.402362 13674 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e137b72ba4847d6ad89da17af64db7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.407238 12556 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.408808 13656 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.416483 12633 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:56.418239 13676 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:56.420260 13659 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.422684 12556 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.444587 13674 tablet_copy_client.cc:806] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.447698 13674 tablet_copy_client.cc:670] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.450104 12454 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.455544 13674 tablet_copy_client.cc:538] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.468858 12633 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:23:56.470216 13674 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:56.574299 13681 ts_tablet_manager.cc:933] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:56.617354 13681 tablet_copy_client.cc:323] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:23:56.619341 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 613ed3057bf74d02a48d823635fd0b6a from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:23:56.619946 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 613ed3057bf74d02a48d823635fd0b6a from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-613ed3057bf74d02a48d823635fd0b6a
I20260709 12:23:56.629262 12644 tablet_copy_source_session.cc:215] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.637933 13681 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 613ed3057bf74d02a48d823635fd0b6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.647043 13674 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.650817 13684 ts_tablet_manager.cc:933] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:56.653219 13674 tablet_bootstrap.cc:492] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:56.654000 13674 ts_tablet_manager.cc:1403] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.184s	user 0.014s	sys 0.011s
I20260709 12:23:56.657017 13674 raft_consensus.cc:359] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.657909 13674 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:56.658609 13674 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.659199 13684 tablet_copy_client.cc:323] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:56.660939 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 7f25843830014b4c8c5707696cddc7f0 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:56.661499 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 7f25843830014b4c8c5707696cddc7f0 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-7f25843830014b4c8c5707696cddc7f0
I20260709 12:23:56.675180 12718 tablet_copy_source_session.cc:215] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:56.679293 13684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f25843830014b4c8c5707696cddc7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:56.706314 13681 tablet_copy_client.cc:806] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.708190 13681 tablet_copy_client.cc:670] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.711022 13674 ts_tablet_manager.cc:1434] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.001s
I20260709 12:23:56.713351 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-0e137b72ba4847d6ad89da17af64db7d received from {username='slave'} at 127.0.0.1:36566
I20260709 12:23:56.713819 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-0e137b72ba4847d6ad89da17af64db7d on tablet 0e137b72ba4847d6ad89da17af64db7d with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:56.714903 13684 tablet_copy_client.cc:806] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:56.715829 13684 tablet_copy_client.cc:670] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:56.719271 13681 tablet_copy_client.cc:538] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.723738 13684 tablet_copy_client.cc:538] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:56.729854 13681 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:56.733400 13684 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:56.759455 13681 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.760485 13681 tablet_bootstrap.cc:492] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:56.761238 13681 ts_tablet_manager.cc:1403] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.008s
I20260709 12:23:56.764521 13681 raft_consensus.cc:359] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.765560 13681 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:56.767791 13228 raft_consensus.cc:1217] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:56.766331 13681 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.807723 13681 ts_tablet_manager.cc:1434] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.046s	user 0.002s	sys 0.004s
I20260709 12:23:56.818347 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-613ed3057bf74d02a48d823635fd0b6a received from {username='slave'} at 127.0.0.1:40560
I20260709 12:23:56.818832 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-613ed3057bf74d02a48d823635fd0b6a on tablet 613ed3057bf74d02a48d823635fd0b6a with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:56.820089 13684 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:56.823143 13684 tablet_bootstrap.cc:492] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:56.825292 13684 ts_tablet_manager.cc:1403] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.092s	user 0.025s	sys 0.000s
I20260709 12:23:56.846341 13684 raft_consensus.cc:359] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.849607 13684 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:56.850692 13684 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:56.853695 13684 ts_tablet_manager.cc:1434] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:23:56.855664 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-7f25843830014b4c8c5707696cddc7f0 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:56.856125 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-7f25843830014b4c8c5707696cddc7f0 on tablet 7f25843830014b4c8c5707696cddc7f0 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:56.964571 13684 ts_tablet_manager.cc:933] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:23:56.967543 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 75680.7us
I20260709 12:23:56.970052 13226 raft_consensus.cc:1217] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:56.982162 13684 tablet_copy_client.cc:323] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:23:56.985366 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet e18a3c206d6646e69fba42e3b74572a6 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:23:56.985967 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet e18a3c206d6646e69fba42e3b74572a6 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-e18a3c206d6646e69fba42e3b74572a6
I20260709 12:23:57.009765 12718 tablet_copy_source_session.cc:215] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:57.014259 13684 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e18a3c206d6646e69fba42e3b74572a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:57.034198 13684 tablet_copy_client.cc:806] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:57.034925 13684 tablet_copy_client.cc:670] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:57.039165 13684 tablet_copy_client.cc:538] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:57.061084 13684 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:23:57.139564 13226 raft_consensus.cc:1217] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:57.145493 13684 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:57.146709 13684 tablet_bootstrap.cc:492] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:23:57.176569 13684 ts_tablet_manager.cc:1403] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.004s
I20260709 12:23:57.180110 13684 raft_consensus.cc:359] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:57.181087 13684 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:23:57.181877 13684 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:23:57.184623 13684 ts_tablet_manager.cc:1434] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:57.229005 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-e18a3c206d6646e69fba42e3b74572a6 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:23:57.231104 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-e18a3c206d6646e69fba42e3b74572a6 on tablet e18a3c206d6646e69fba42e3b74572a6 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:57.338788 13669 raft_consensus.cc:1064] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:57.351292 13669 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:23:57.358914 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 66509.2us
I20260709 12:23:57.422869 13228 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.425870 13700 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.439129 12626 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 12:23:57.451308 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 80649.7us
I20260709 12:23:57.490378 13702 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 12:23:57.522465 13672 raft_consensus.cc:1064] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
W20260709 12:23:57.530328 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 94714.4us
I20260709 12:23:57.538810 13672 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:57.573705 13234 raft_consensus.cc:1217] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:57.584390 12704 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.584643 13700 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.592929 12626 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.598894 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:57.602169 13667 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.605789 13234 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.607689 12556 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.608335 13689 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.611495 13689 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:57.612819 12704 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.617285 13707 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.667590 12704 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:23:57.684819 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 60914.1us
I20260709 12:23:57.690646 13228 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.705894 13689 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.707743 12454 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.724229 13234 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.743417 13699 raft_consensus.cc:1064] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:57.746279 13699 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:57.757400 12558 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.768373 12702 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.775714 13234 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.786062 12634 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.787549 12556 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:57.787714 13656 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.790148 13705 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.798233 13615 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:57.821614 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:23:57.822434 12558 raft_consensus.cc:606] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:57.826881 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:23:57.827560 12558 raft_consensus.cc:606] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:57.847886 13700 raft_consensus.cc:993] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:57.848426 13667 raft_consensus.cc:1081] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:57.850400 13228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:23:57.851051 13228 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:57.851459 13228 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.875140 13705 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.882666 13228 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:57.880350 12626 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.889953 12456 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.901350 12553 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.910650 13228 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:57.912400 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:57.913493 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:57.917332 12634 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.917397 12559 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:57.917855 12559 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:57.918510 12559 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:57.919523 12559 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:57.921025 13233 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.925051 12634 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:57.926961 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:57.927996 13686 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:57.929786 13686 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:23:57.930778 13686 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:57.947082 12634 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:57.950842 12704 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:23:57.960637 12704 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:57.949271 12455 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:57.954528 12559 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:57.970227 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:23:57.970948 12558 raft_consensus.cc:606] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:57.974170 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:23:57.974656 13705 raft_consensus.cc:993] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:23:57.974679 12558 raft_consensus.cc:606] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:57.975203 13705 raft_consensus.cc:1081] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:23:57.977792 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:23:57.978374 12558 raft_consensus.cc:606] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:57.981501 13233 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:57.983076 13707 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:57.986091 12559 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:57.987494 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:23:57.987618 13707 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:57.991745 13707 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.989368 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:57.993884 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:57.993561 13234 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.997845 12559 raft_consensus.cc:2955] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:57.999953 12457 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.003485 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 613ed3057bf74d02a48d823635fd0b6a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:58.009526 12558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:23:58.010800 12558 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.011157 12558 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.054508 13702 raft_consensus.cc:993] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.055058 13702 raft_consensus.cc:1081] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.056871 12634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:23:58.057544 12634 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.057963 12634 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.090099 12634 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.093321 13667 raft_consensus.cc:993] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:58.093875 13667 raft_consensus.cc:1081] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:58.093982 12634 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:58.095973 13228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:23:58.096215 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:58.096772 12704 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.096627 13228 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.097954 13228 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.095285 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:58.101979 12559 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:23:58.104514 12442 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 3 similar messages]
I20260709 12:23:58.106781 13228 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.107407 12559 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:58.107568 12558 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.109221 12559 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.111511 12559 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.111534 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:58.112926 12557 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.113206 12557 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:58.113970 12557 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.114512 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:58.115027 12557 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.115060 12702 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.104625 12704 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:23:58.121628 12706 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:58.127727 12455 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 1 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.129786 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:58.130615 13710 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.131071 13710 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:58.132532 12557 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:58.131893 13710 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.140067 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:23:58.141217 13686 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.141755 13686 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:23:58.142038 13667 raft_consensus.cc:993] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.142513 13667 raft_consensus.cc:1081] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.142647 13686 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.144584 12628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:23:58.145095 12628 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.145464 12628 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.150767 12559 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:23:58.168538 12702 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:58.169363 13228 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:58.157239 12628 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.169845 12559 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.173219 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:58.173811 12557 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.174248 12557 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:58.175120 12557 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.180167 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:58.180737 12702 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.183250 13228 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.184755 12628 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:58.184842 13702 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.188792 12702 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:23:58.190644 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:58.191530 13710 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.192018 13710 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:58.192884 13710 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.194945 13700 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.197111 13234 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.176340 12557 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.218544 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0e137b72ba4847d6ad89da17af64db7d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:58.224350 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 613ed3057bf74d02a48d823635fd0b6a with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45128
I20260709 12:23:58.232702 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:58.233346 12628 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.236968 12706 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.237762 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:58.238168 12558 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:23:58.238358 12703 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:58.238746 12703 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:58.239439 12703 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.240872 12703 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.239850 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:23:58.242946 13699 raft_consensus.cc:1064] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:23:58.245273 13699 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.242889 13234 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:58.252187 12703 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:58.253688 12628 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:58.254598 13234 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:58.255887 12522 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:58.257906 13700 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:58.258589 13700 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:58.260147 13700 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:23:58.266755 12442 catalog_manager.cc:4755] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): ChangeConfig:REMOVE_PEER RPC failed for tablet 7f25843830014b4c8c5707696cddc7f0: Remote error: Service unavailable: leader transfer in progress
I20260709 12:23:58.268638 12557 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:23:58.268610 12456 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.283824 13667 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.300053 13733 tablet_replica.cc:333] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:23:58.305907 12705 raft_consensus.cc:2955] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.307525 13234 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.307682 12634 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.301337 13733 raft_consensus.cc:2243] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.313448 13733 raft_consensus.cc:2272] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.319685 13733 ts_tablet_manager.cc:1916] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:58.324119 12557 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.328722 13699 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.331470 12456 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.326670 12455 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:58.334028 12457 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:58.338388 12442 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 7f25843830014b4c8c5707696cddc7f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica c6795b140b3247279a2231c6b9360d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.337788 13699 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:23:58.352854 13699 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:58.359542 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 0e137b72ba4847d6ad89da17af64db7d with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:58.384485 13700 raft_consensus.cc:993] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.385298 13667 raft_consensus.cc:1081] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.387343 12628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:23:58.387925 12628 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.388295 12628 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.375219 12457 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.412253 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:58.412983 12558 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:58.417097 12559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:58.417248 12628 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.417816 12559 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:58.419382 12628 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:58.420332 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:58.420414 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:58.420981 12705 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.421041 12559 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:58.421487 12559 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:58.422271 12559 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:58.423178 12558 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:58.423761 12558 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:23:58.425217 12559 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:58.429230 12705 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:23:58.430428 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:58.431262 13710 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:58.431734 13710 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:58.432690 13710 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:23:58.436290 12505 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:23:58.436759 12505 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 7f25843830014b4c8c5707696cddc7f0 already in progress
W20260709 12:23:58.437054 12505 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 7f25843830014b4c8c5707696cddc7f0 already in progress
I20260709 12:23:58.441478 13736 tablet_replica.cc:333] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:58.442631 13736 raft_consensus.cc:2243] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.436777 12559 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:23:58.443346 13736 raft_consensus.cc:2272] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.450654 13615 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.451735 13234 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.461274 13733 ts_tablet_manager.cc:1929] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:58.462118 13733 log.cc:1199] T 613ed3057bf74d02a48d823635fd0b6a P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/613ed3057bf74d02a48d823635fd0b6a
I20260709 12:23:58.462356 12626 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.464164 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 613ed3057bf74d02a48d823635fd0b6a (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:58.465595 13736 ts_tablet_manager.cc:1916] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:58.472770 12455 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.474282 12559 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.505228 12558 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.506726 13686 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:58.506590 12457 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 4, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.513960 13736 ts_tablet_manager.cc:1929] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:58.521716 13736 log.cc:1199] T 0e137b72ba4847d6ad89da17af64db7d P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/0e137b72ba4847d6ad89da17af64db7d
I20260709 12:23:58.523643 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 0e137b72ba4847d6ad89da17af64db7d (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:58.526994 12634 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.529081 13686 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:58.543352 12705 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.554955 12706 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.557036 13228 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.557602 12556 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:58.558216 13727 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:58.560109 13658 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:58.563122 12559 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:58.564030 13656 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.564662 13686 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:58.570879 13705 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.590023 12556 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.595381 13228 raft_consensus.cc:2955] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.603956 12557 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.606494 13710 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.610256 12705 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.612203 13710 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:58.630906 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e18a3c206d6646e69fba42e3b74572a6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:58.665643 12456 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:58.667270 12703 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.670845 13652 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
W20260709 12:23:58.740360 13748 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:23:58.747126 12557 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:58.748710 13710 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:58.776353 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 144184us
I20260709 12:23:58.788455 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet e18a3c206d6646e69fba42e3b74572a6 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:23:58.789376 13736 tablet_replica.cc:333] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:23:58.790477 13736 raft_consensus.cc:2243] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:58.791266 13736 raft_consensus.cc:2272] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:58.807480 13736 ts_tablet_manager.cc:1916] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:23:58.832409 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 63296.4us
I20260709 12:23:58.859601 12626 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:58.863775 13667 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:58.871848 13756 raft_consensus.cc:993] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.872411 13756 raft_consensus.cc:1081] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:58.874711 12626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:23:58.875480 12626 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:58.875988 12626 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.887871 13234 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:23:58.886842 12626 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.893105 13755 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:58.894323 13736 ts_tablet_manager.cc:1929] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:58.897657 13736 log.cc:1199] T e18a3c206d6646e69fba42e3b74572a6 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/e18a3c206d6646e69fba42e3b74572a6
I20260709 12:23:58.899956 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet e18a3c206d6646e69fba42e3b74572a6 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:58.904547 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:58.905200 12558 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:58.905712 12558 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:58.905974 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:23:58.906558 13228 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.906559 12558 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.908812 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:58.909399 12705 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.909529 12558 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:58.910262 12626 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:23:58.918233 12558 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:23:58.919494 13228 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:23:58.934876 12597 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:58.923800 12705 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:23:58.935753 12704 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:23:58.935909 13760 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:58.936429 13760 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:58.937309 13760 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:58.956514 12454 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.969367 12705 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:58.971657 13652 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.993316 12556 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:23:58.995342 13760 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.247254 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:59.331751 12626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:23:59.332412 12626 raft_consensus.cc:606] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:59.333956 13754 raft_consensus.cc:993] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:59.334432 13754 raft_consensus.cc:1081] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:59.336910 12626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:23:59.337553 12626 raft_consensus.cc:606] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:23:59.340579 13228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:23:59.341064 13228 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.341394 13228 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.348387 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:23:59.349258 12634 raft_consensus.cc:606] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:59.352190 13228 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.355880 13228 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:59.356500 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:59.358136 12558 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.356995 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:23:59.359171 12634 raft_consensus.cc:606] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:23:59.357131 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:59.360205 12628 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.360499 12628 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:59.361146 12628 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.362228 12628 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.364997 12558 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:59.366216 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:23:59.367096 13752 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.368105 12705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:23:59.368685 12705 raft_consensus.cc:606] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:23:59.369236 12628 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:59.370410 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:23:59.371886 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:59.372593 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:59.429102 13228 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:59.430712 13754 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.452868 13752 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:23:59.454360 13752 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.466761 12558 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:59.470017 13754 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:59.479512 13754 raft_consensus.cc:993] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:59.480278 13760 raft_consensus.cc:1081] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:23:59.483445 13228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:23:59.484303 13228 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.484838 13228 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.482311 12454 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.494856 13228 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.498284 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:59.499094 12634 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.499465 12634 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:59.500468 12634 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.503753 12634 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.509537 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:59.510315 12556 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.510680 13754 raft_consensus.cc:993] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:23:59.511143 13754 raft_consensus.cc:1081] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:23:59.514258 12559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:23:59.514784 12559 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.515120 12559 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.519263 12556 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:59.527115 12559 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.528561 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:23:59.509500 13228 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:23:59.539590 13752 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.540083 13752 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:23:59.541368 12559 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:59.537907 12634 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:23:59.553875 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:59.554517 12704 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.540982 13752 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.565222 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:59.565940 12626 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.566247 12626 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:59.566897 12704 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:59.567124 12626 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.568751 12626 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.579754 13760 raft_consensus.cc:993] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:23:59.581535 13760 raft_consensus.cc:1081] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:23:59.580010 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:59.583379 13700 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.583858 13700 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:59.584985 13700 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.590662 12704 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:23:59.593021 13754 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:59.602281 12559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:23:59.602838 12559 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.603209 12559 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.616933 12559 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.622543 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:23:59.623159 12628 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.623461 12628 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:59.623673 12559 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:59.624235 12628 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.628706 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:59.629303 12705 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.633471 12628 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.636360 12626 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:59.641362 12705 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:59.646127 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:23:59.647816 13759 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.648283 13759 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:23:59.645154 12628 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:23:59.649114 13759 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.662699 12455 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.663851 12634 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:23:59.670794 12456 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.691489 13228 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:59.693372 13760 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:23:59.702570 13754 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:59.706928 12457 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.714509 13234 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:59.733376 12703 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:23:59.748847 12454 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 6, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:59.764038 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 7f25843830014b4c8c5707696cddc7f0 with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:38704
I20260709 12:23:59.769929 13707 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.774488 13783 tablet_replica.cc:333] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:23:59.779757 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7f25843830014b4c8c5707696cddc7f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:23:59.784508 13699 raft_consensus.cc:993] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:59.785089 13699 raft_consensus.cc:1081] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:23:59.786695 12703 raft_consensus.cc:2955] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 3 to 6, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:23:59.794198 12634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:23:59.797652 12634 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:59.798043 12634 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.807763 13783 raft_consensus.cc:2243] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:59.808595 13783 raft_consensus.cc:2272] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:59.814805 13783 ts_tablet_manager.cc:1916] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:59.834740 13783 ts_tablet_manager.cc:1929] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:23:59.835287 13783 log.cc:1199] T 7f25843830014b4c8c5707696cddc7f0 P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/7f25843830014b4c8c5707696cddc7f0
I20260709 12:23:59.837201 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 7f25843830014b4c8c5707696cddc7f0 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:23:59.843550 12634 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.848369 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:23:59.848945 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:23:59.849529 12559 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.853446 12634 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:23:59.848937 12703 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:59.855798 12703 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:23:59.856370 12559 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:23:59.856665 12703 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.857494 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:23:59.858188 12703 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:59.858355 13777 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:59.858899 13777 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:23:59.859750 13777 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:23:59.865835 12703 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:23:59.875658 12457 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.949759 12559 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:59.951129 13752 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.977082 12626 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:59.977298 12628 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:59.979135 13752 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:59.979439 13787 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:23:59.984450 12559 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:23:59.989151 13787 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:00.004514 12703 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:00.041189 12704 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.044205 13759 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.066831 12559 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.068107 12628 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.074558 13705 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.088001 13699 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.092206 13658 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:00.088022 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e072821343d84e57b593eb6bc58c585a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.110580 12628 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.111411 12556 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:00.114195 13667 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.122577 12559 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:00.155826 12703 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.162761 13759 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:00.173878 12703 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:00.174604 12522 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0afb49cf962a46388bf387ad7b344c39. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.177047 12626 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:00.178229 12628 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:00.176759 13667 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.189530 13759 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:00.203308 12634 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:00.540305 13805 ts_tablet_manager.cc:933] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:00.542878 13805 tablet_copy_client.cc:323] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:24:00.862138 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet e072821343d84e57b593eb6bc58c585a from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:24:00.862758 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet e072821343d84e57b593eb6bc58c585a from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-e072821343d84e57b593eb6bc58c585a
I20260709 12:24:00.872036 12718 tablet_copy_source_session.cc:215] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:00.875844 13805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e072821343d84e57b593eb6bc58c585a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:00.477082 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:00.900220 13805 tablet_copy_client.cc:806] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:00.900942 13805 tablet_copy_client.cc:670] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
W20260709 12:24:00.912185 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 704692us
I20260709 12:24:00.940335 12455 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:00.985028 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 779108us
I20260709 12:24:00.989869 13798 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.024572 13759 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:01.029568 13805 tablet_copy_client.cc:538] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:01.033064 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:01.033777 12634 raft_consensus.cc:606] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:01.037202 12559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:01.037788 12559 raft_consensus.cc:606] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:01.044538 12705 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:01.045063 12705 raft_consensus.cc:606] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:01.054173 12559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:01.054792 12559 raft_consensus.cc:606] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:01.060107 13805 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:01.065045 12628 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:01.078852 12703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:01.079387 12703 raft_consensus.cc:606] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:01.080747 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:01.082147 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:01.095340 12703 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:01.118804 13820 raft_consensus.cc:993] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:01.126420 13817 raft_consensus.cc:1081] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:01.139688 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:01.201150 12559 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.221711 13803 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:01.222215 13794 raft_consensus.cc:993] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:01.222760 13759 raft_consensus.cc:1081] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:01.222345 13803 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.225445 13803 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:01.225919 13804 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:01.226457 13804 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.228538 13804 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:01.235997 13233 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:24:01.236599 13233 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.236937 13233 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.237906 13803 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:01.238165 12626 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:24:01.238708 12626 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.238611 13803 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.240759 13803 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:01.239094 12626 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.244972 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:01.249166 12626 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.250145 13828 ts_tablet_manager.cc:933] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:01.251389 12626 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.253829 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.254139 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.254223 13759 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:01.254691 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.257781 13759 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.259691 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:01.260346 12559 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.260715 12559 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:01.261458 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.261688 12559 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.264431 12559 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.266155 13794 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:01.266680 13794 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.269804 13794 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.271449 13828 tablet_copy_client.cc:323] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:24:01.271183 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.269919 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:01.273733 12523 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:01.263012 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:01.275137 13794 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.262084 13759 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.276443 12523 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:01.277992 13759 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.280797 13759 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:01.281399 13759 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.284794 13759 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.268859 13233 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.286069 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:01.289229 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.292346 12523 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:01.293708 13759 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.296079 13759 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:01.296649 13759 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.297899 12703 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:01.299335 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:01.302850 12704 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.311378 13794 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:01.315416 13822 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:01.316015 13822 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.318321 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:01.318713 13822 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.318909 12702 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.312098 13794 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.320895 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.325661 13794 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.326694 13233 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.329653 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.345191 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:01.348937 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:01.350478 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:01.351163 13805 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:01.352255 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:01.352671 13805 tablet_bootstrap.cc:492] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:01.353470 13805 ts_tablet_manager.cc:1403] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.294s	user 0.041s	sys 0.029s
I20260709 12:24:01.354853 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:01.356408 12702 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:01.358361 12704 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:01.359706 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:01.363092 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:01.364902 13766 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.364897 12559 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:01.365538 13766 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:01.368577 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:01.369338 13656 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.370057 12523 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:01.371361 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:01.373944 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:01.378414 13808 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 12:24:01.382835 12703 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:01.366809 13759 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:01.366500 13766 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.391832 13802 raft_consensus.cc:993] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:01.392575 13802 raft_consensus.cc:1081] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:01.373764 13794 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.375226 13822 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.376336 13817 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.405478 13813 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
W20260709 12:24:01.430390 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 61127.8us
I20260709 12:24:01.438864 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:01.439472 12559 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.437575 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:01.439757 12559 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:01.458706 12569 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 0afb49cf962a46388bf387ad7b344c39 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:24:01.459211 12559 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.468379 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 228) took 1276 ms. Trace:
I20260709 12:24:01.472602 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:01.475234 12674 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:01.476208 13804 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.417781 13805 raft_consensus.cc:359] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:01.463452 12569 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 0afb49cf962a46388bf387ad7b344c39 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-0afb49cf962a46388bf387ad7b344c39
I20260709 12:24:01.484114 12559 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.486702 12454 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:01.521780 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 94065.9us
I20260709 12:24:01.482111 13804 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:01.523619 12558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:01.479285 13805 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:01.524163 12558 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.524575 12558 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.530594 13805 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:01.497841 13809 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.468990 12455 rpcz_store.cc:276] 0709 12:24:00.191592 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.191734 (+   142us) service_pool.cc:224] Handling call
0709 12:24:01.468270 (+1276536us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:01.001537 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:01.021958 (+ 20421us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:01.022346 (+   388us) write_op.cc:435] Acquired schema lock
0709 12:24:01.022941 (+   595us) tablet.cc:662] Decoding operations
0709 12:24:01.039030 (+ 16089us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:01.039081 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:01.039112 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:01.039315 (+   203us) tablet.cc:701] Row locks acquired
0709 12:24:01.039333 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:01.039477 (+   144us) write_op.cc:270] Start()
0709 12:24:01.039586 (+   109us) write_op.cc:276] Timestamp: P: 1783599841039436 usec, L: 0
0709 12:24:01.039609 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:01.040263 (+   654us) log.cc:844] Serialized 591 byte log entry
0709 12:24:01.359647 (+319384us) op_driver.cc:464] REPLICATION: finished
0709 12:24:01.422944 (+ 63297us) write_op.cc:301] APPLY: starting
0709 12:24:01.423052 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:01.423185 (+   133us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:01.423328 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:01.423624 (+   296us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:01.423836 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:01.423911 (+    75us) write_op.cc:312] APPLY: finished
0709 12:24:01.424170 (+   259us) log.cc:844] Serialized 23 byte log entry
0709 12:24:01.432075 (+  7905us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:01.437855 (+  5780us) write_op.cc:454] Released schema lock
0709 12:24:01.440109 (+  2254us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":53259,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":63012,"apply.run_cpu_time_us":6128,"apply.run_wall_time_us":42963,"num_ops":1,"prepare.queue_time_us":57397,"prepare.run_cpu_time_us":16098,"prepare.run_wall_time_us":115067,"raft.queue_time_us":112504,"raft.run_cpu_time_us":14160,"raft.run_wall_time_us":40763,"replication_time_us":319903,"thread_start_us":256137,"threads_started":4,"wal-append.queue_time_us":158813}]]}
I20260709 12:24:01.542378 12559 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:01.552883 12558 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:01.553820 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08000eddc0 after lost signal to thread 11395
I20260709 12:24:01.572902 12569 tablet_copy_source_session.cc:215] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:01.574265 12457 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 248) took 1369 ms. Trace:
I20260709 12:24:01.574712 12457 rpcz_store.cc:276] 0709 12:24:00.205156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:00.205298 (+   142us) service_pool.cc:224] Handling call
0709 12:24:01.574208 (+1368910us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":686476,"reported_tablets":1}
I20260709 12:24:01.580673 13656 raft_consensus.cc:993] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:01.581138 13656 raft_consensus.cc:1081] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:01.581568 12558 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.583717 13828 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0afb49cf962a46388bf387ad7b344c39. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:01.585876 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080008a960 after lost signal to thread 12491
I20260709 12:24:01.552206 13809 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:01.584291 13805 ts_tablet_manager.cc:1434] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.231s	user 0.010s	sys 0.000s
I20260709 12:24:01.624167 12626 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:01.636878 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0280 after lost signal to thread 12583
I20260709 12:24:01.663350 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:01.664227 12628 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.666319 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-e072821343d84e57b593eb6bc58c585a received from {username='slave'} at 127.0.0.1:33230
W20260709 12:24:01.668083 13837 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:01.668376 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-e072821343d84e57b593eb6bc58c585a on tablet e072821343d84e57b593eb6bc58c585a with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:01.659446 13809 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:01.694469 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08002b3c00 after lost signal to thread 12658
W20260709 12:24:01.695629 13839 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:01.692517 12456 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:01.730029 12488 debug-util.cc:398] Leaking SignalData structure 0x7b0800216b60 after lost signal to thread 12732
I20260709 12:24:01.731261 12628 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:01.737056 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:01.738591 13798 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.739279 13798 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:01.740285 13798 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:01.731277 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08000c6e80 after lost signal to thread 13259
I20260709 12:24:01.742545 13814 raft_consensus.cc:993] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:01.743034 13814 raft_consensus.cc:1081] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:01.747828 13226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:24:01.748560 13226 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.748980 13226 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.756939 13233 raft_consensus.cc:1217] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 12:24:01.759146 13844 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:01.778654 13226 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.785367 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:01.786254 12628 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.786684 12628 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:01.792105 12628 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.795485 12553 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:01.797019 12558 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:01.800668 12628 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.801501 12558 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:01.801971 12558 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.805824 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:01.806416 12704 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.806684 12704 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:01.807142 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:01.807682 12703 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.810096 13804 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:01.810608 13804 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.812729 13804 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:01.814615 12559 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:01.815192 12703 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:01.815505 12628 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:01.817528 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:01.823487 13847 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.824040 13847 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:01.822118 12704 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.825927 12704 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.804351 13226 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:01.847074 12456 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.854027 12558 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.854777 12702 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:01.848639 12457 catalog_manager.cc:5697] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.862380 12704 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:01.870754 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:01.876065 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:01.876773 12628 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.884366 13846 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 12:24:01.891088 12628 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:01.892138 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:01.901714 12558 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:01.903995 12671 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e19c569fe6e34f969a722bd2495c3a89. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:01.907791 13820 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:01.909684 13820 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:01.910581 13820 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.913733 12628 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:01.915357 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:01.824924 13847 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:01.923270 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:01.923950 12707 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:01.924265 12707 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:01.925172 12707 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:01.957551 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:01.969211 12700 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:01.975452 12707 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:01.978681 12554 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:01.981168 13656 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:01.985643 13848 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:01.986174 12557 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:01.973076 13833 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:24:01.996168 13828 tablet_copy_client.cc:806] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:01.996853 13828 tablet_copy_client.cc:670] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:02.006096 12556 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:02.013751 13828 tablet_copy_client.cc:538] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:02.014411 12454 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.013970 12554 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:02.021852 12456 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:02.023578 13752 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:02.027508 12634 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:02.060253 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:02.080983 12703 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:02.080500 12522 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 52ac1951d6d64447869208058e8755b6. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:02.088712 13805 ts_tablet_manager.cc:933] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:02.114163 12703 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.115947 12455 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.098572 13794 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.021s
I20260709 12:24:02.118181 13814 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.126142 12629 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:02.132544 13798 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.158725 13828 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:02.194730 12558 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.154899 13805 tablet_copy_client.cc:323] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:24:02.209477 13836 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:24:02.229444 12708 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.234304 13817 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:02.234915 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet e19c569fe6e34f969a722bd2495c3a89 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:24:02.235495 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet e19c569fe6e34f969a722bd2495c3a89 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-e19c569fe6e34f969a722bd2495c3a89
I20260709 12:24:02.302057 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.320240 13848 raft_consensus.cc:1064] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:02.322896 13848 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:02.348909 12718 tablet_copy_source_session.cc:215] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:02.405061 13226 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:02.416942 12629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a769018c454aa685eae73d74c89abb"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:02.417817 12629 raft_consensus.cc:606] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:02.456641 12553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:02.464059 12633 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:02.467280 13805 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e19c569fe6e34f969a722bd2495c3a89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:02.470683 12554 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:02.474960 12553 raft_consensus.cc:606] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:02.446080 13875 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:02.491895 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 77673.7us
I20260709 12:24:02.492525 12708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:02.502810 12708 raft_consensus.cc:606] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:02.506479 12634 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.510927 12629 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.518515 12634 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:02.523331 12554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:02.488572 13873 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:02.530313 12554 raft_consensus.cc:606] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:02.552850 12703 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:02.557147 12704 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:02.534770 13878 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:02.573565 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 212397us
I20260709 12:24:02.551780 13798 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:24:02.580632 12702 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:02.564980 13759 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:02.565972 13833 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:24:02.578161 13804 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:24:02.587877 13820 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
W20260709 12:24:02.649344 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 88104.1us
I20260709 12:24:02.717680 12702 raft_consensus.cc:606] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:02.725975 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 138057us
I20260709 12:24:02.744292 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:02.606431 12700 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:02.764170 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:02.765282 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:02.791756 12455 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:02.886098 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 103619us
I20260709 12:24:02.892858 12633 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:03.011633 13862 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:24:03.034642 13888 raft_consensus.cc:993] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:02.972796 13880 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
W20260709 12:24:03.043989 13828 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:24:03.042817 13805 tablet_copy_client.cc:806] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:03.097558 13892 ts_tablet_manager.cc:933] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:03.083205 13805 tablet_copy_client.cc:670] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:03.151451 13871 raft_consensus.cc:993] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:03.152225 13871 raft_consensus.cc:1081] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:03.152249 13828 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:03.206301 13894 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:24:03.206436 13849 raft_consensus.cc:1081] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:03.218552 13828 tablet_bootstrap.cc:492] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:03.219640 13828 ts_tablet_manager.cc:1403] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 1.061s	user 0.033s	sys 0.019s
I20260709 12:24:03.268754 13828 raft_consensus.cc:359] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:03.269858 13828 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:03.270663 13828 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:03.273396 13828 ts_tablet_manager.cc:1434] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
W20260709 12:24:03.278345 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62945.7us
W20260709 12:24:03.279734 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 60999.2us
W20260709 12:24:03.281555 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 398897us
W20260709 12:24:03.299121 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 288858us
I20260709 12:24:03.301146 13228 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:24:03.301970 13228 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.302421 13228 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.304657 13805 tablet_copy_client.cc:538] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:03.345796 12628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:03.645550 13896 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:03.644636 13892 tablet_copy_client.cc:323] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:24:03.448689 13228 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:03.687234 12628 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:03.688632 13228 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:03.656359 13826 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.000s	sys 0.016s
W20260709 12:24:03.382967 12634 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.017s
I20260709 12:24:03.688723 12628 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:03.441948 12703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.003s	sys 0.025s
W20260709 12:24:03.709872 12703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.003s	sys 0.033s
W20260709 12:24:03.689539 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 124800us
W20260709 12:24:03.711597 12634 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.000s	sys 0.038s
W20260709 12:24:03.719544 13905 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.264s	user 0.000s	sys 0.001s
I20260709 12:24:03.686558 13896 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:03.472012 13877 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.020s
W20260709 12:24:03.711401 13826 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.019s
I20260709 12:24:03.693249 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:03.734027 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1138) took 1009 ms. Trace:
I20260709 12:24:03.738487 12634 rpcz_store.cc:276] 0709 12:24:02.724807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.724916 (+   109us) service_pool.cc:224] Handling call
0709 12:24:02.725220 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:02.729154 (+  3934us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:02.729180 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:02.731217 (+  2037us) log.cc:844] Serialized 26 byte log entry
0709 12:24:02.818216 (+ 86999us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:03.712018 (+893802us) log.cc:844] Serialized 14 byte log entry
0709 12:24:03.733606 (+ 21588us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:03.733713 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:03.733775 (+    62us) raft_consensus.cc:1685] finished
0709 12:24:03.733795 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:03.733952 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22097,"prepare.queue_time_us":874987,"prepare.run_cpu_time_us":86,"prepare.run_wall_time_us":9017,"raft.queue_time_us":27234,"raft.run_cpu_time_us":238,"raft.run_wall_time_us":2317,"thread_start_us":957216,"threads_started":2,"wal-append.queue_time_us":69845}
I20260709 12:24:03.741235 13842 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:03.731346 13877 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.014s	sys 0.023s
I20260709 12:24:03.741931 12569 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-0afb49cf962a46388bf387ad7b344c39 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:24:03.749289 12625 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.777040 12628 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:03.770915 12569 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-0afb49cf962a46388bf387ad7b344c39 on tablet 0afb49cf962a46388bf387ad7b344c39 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:03.787535 12628 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:03.797040 13896 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:03.797520 13228 raft_consensus.cc:1217] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:03.774758 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:03.798563 12554 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.798885 12554 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:03.804288 13915 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:03.804018 12554 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:03.804862 13915 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:03.807075 13915 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:03.805236 12554 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:03.769484 13842 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:03.830302 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 75564.6us
I20260709 12:24:03.846815 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:03.851364 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:03.812323 13843 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:03.879002 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:03.879805 12706 raft_consensus.cc:3055] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:03.880167 12706 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:24:03.874698 13886 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.010s	sys 0.038s
I20260709 12:24:03.890800 12706 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:03.893043 13656 raft_consensus.cc:993] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:03.894129 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:03.897495 13914 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:03.901237 13656 raft_consensus.cc:1081] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:03.898043 13914 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:03.909305 13908 raft_consensus.cc:993] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:03.891683 12568 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 52ac1951d6d64447869208058e8755b6 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
W20260709 12:24:03.908615 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62698us
I20260709 12:24:03.926491 13805 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:03.953037 13798 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:03.953682 13798 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:03.943104 13877 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:03.959123 13917 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:24:03.961196 12625 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
W20260709 12:24:03.967545 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 119896us
I20260709 12:24:03.939325 12568 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 52ac1951d6d64447869208058e8755b6 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-52ac1951d6d64447869208058e8755b6
I20260709 12:24:03.958490 13914 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:03.961961 13798 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:03.971410 13891 raft_consensus.cc:1081] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:03.982636 12632 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:03.994274 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:03.970538 13877 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:03.989880 12554 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:04.000356 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.002594 13877 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.009368 13842 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:04.017220 13813 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.019412 12634 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:04.019323 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.017104 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.023773 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.017916 13813 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.035230 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:04.036144 13813 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.026867 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:03.980327 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:04.018345 12629 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:04.057106 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 54080.7us
I20260709 12:24:04.059264 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:04.061535 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 255) took 1281 ms. Trace:
I20260709 12:24:04.070034 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:04.073303 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51301.1us
I20260709 12:24:04.081115 13930 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.081890 13930 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:04.083127 13930 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:04.041880 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:04.085906 12554 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.086300 12554 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.089890 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.089993 12634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
W20260709 12:24:04.090802 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 96905.7us
I20260709 12:24:04.091001 12634 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:04.091562 12634 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:04.091848 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:04.092396 13234 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.086701 12556 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:04.079272 13844 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:04.060964 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 84798us
I20260709 12:24:04.073675 13871 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.061933 12455 rpcz_store.cc:276] 0709 12:24:02.779714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.779832 (+   118us) service_pool.cc:224] Handling call
0709 12:24:02.807240 (+ 27408us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b5400036028. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e98455161 00007f0e984df3af 00007f0e984e0b11 00007f0e9a9e0fa1 00007f0e9a9e17ff 00007f0e9a8a0a1b 00007f0e9a9a890e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc
0709 12:24:04.061475 (+1254235us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:03.106913 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:03.107515 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:03.107550 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:03.107568 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:03.107890 (+   322us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:03.107964 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:03.107991 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:03.108167 (+   176us) tablet.cc:701] Row locks acquired
0709 12:24:03.108180 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:24:03.108317 (+   137us) write_op.cc:270] Start()
0709 12:24:03.108426 (+   109us) write_op.cc:276] Timestamp: P: 1783599843108273 usec, L: 0
0709 12:24:03.108458 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:24:03.109189 (+   731us) log.cc:844] Serialized 591 byte log entry
0709 12:24:03.783346 (+674157us) op_driver.cc:464] REPLICATION: finished
0709 12:24:03.871754 (+ 88408us) write_op.cc:301] APPLY: starting
0709 12:24:03.871888 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:03.872038 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:03.872213 (+   175us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:03.872490 (+   277us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:03.872717 (+   227us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:03.872797 (+    80us) write_op.cc:312] APPLY: finished
0709 12:24:03.873041 (+   244us) log.cc:844] Serialized 23 byte log entry
0709 12:24:03.873254 (+   213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.873363 (+   109us) write_op.cc:454] Released schema lock
0709 12:24:03.879515 (+  6152us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:03.907796 (+ 28281us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:03.910948 (+  3152us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":26634496,"child_traces":[["op",{"apply.queue_time_us":81196,"apply.run_cpu_time_us":2169,"apply.run_wall_time_us":23957,"num_ops":1,"prepare.queue_time_us":281463,"prepare.run_cpu_time_us":2606,"prepare.run_wall_time_us":2607,"replication_time_us":660168,"spinlock_wait_cycles":76160,"thread_start_us":235179,"threads_started":2}]]}
I20260709 12:24:04.099511 13846 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.123148 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:04.109676 13231 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:04.143651 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 102312us
I20260709 12:24:04.146638 12568 tablet_copy_source_session.cc:215] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:04.155512 12706 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.131034 13889 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:04.156561 12634 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.114068 13871 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.253937 12705 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:24:04.254366 12634 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.122184 13846 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.278147 13892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52ac1951d6d64447869208058e8755b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:04.279574 12706 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:04.283396 13234 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:04.290573 13903 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:04.349167 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.157783 13889 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.355149 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:04.357266 13814 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.358021 13814 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:04.368355 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.375849 13889 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.297753 12554 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:04.389294 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 112855us
I20260709 12:24:04.291361 13903 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:04.394486 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45945.9us
I20260709 12:24:04.386936 13871 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:04.359270 13814 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:04.402945 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46610.5us
I20260709 12:24:04.436695 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:04.431741 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:04.397589 13934 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:04.439366 13913 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.442750 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:04.444620 13912 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.446656 13876 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:04.448470 13896 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.434397 12554 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.451982 13838 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:04.453835 13843 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.510s	user 0.010s	sys 0.002s
I20260709 12:24:04.463869 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.464659 12632 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:24:04.450147 13913 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.447270 13876 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.506235 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.529222 13876 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:04.527984 13903 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.538007 12671 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:04.541350 13913 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.554095 12598 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:04.556954 13838 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:04.557209 13834 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:04.557499 13838 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.557713 13834 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.558009 13838 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.558179 13834 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:04.568909 13892 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50962 (request call id 336) took 1796 ms. Trace:
I20260709 12:24:04.569448 13892 rpcz_store.cc:276] 0709 12:24:02.772896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.773001 (+   105us) service_pool.cc:224] Handling call
0709 12:24:03.097970 (+324969us) ts_tablet_manager.cc:934] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
0709 12:24:04.276752 (+1178782us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:04.547402 (+270650us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:04.547566 (+   164us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:04.567833 (+ 20267us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:04.568151 (+   318us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:04.568747 (+   596us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:04.568817 (+    70us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":218458,"tablet-copy.queue_time_us":233290,"thread_start_us":427229,"threads_started":2}
I20260709 12:24:04.571478 13892 tablet_copy_client.cc:806] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:04.572038 13892 tablet_copy_client.cc:670] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:04.585894 13846 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:04.574841 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.602617 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.604738 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:04.610173 12522 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.619545 13834 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.629395 13834 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.630192 13942 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:04.630613 13942 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.637640 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 143) took 1359 ms. Trace:
I20260709 12:24:04.638072 12454 rpcz_store.cc:276] 0709 12:24:03.278476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:03.278654 (+   178us) service_pool.cc:224] Handling call
0709 12:24:04.637543 (+1358889us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46954,"reported_tablets":1}
I20260709 12:24:04.647403 13925 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:04.647926 13925 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.648923 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.650415 13925 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.650548 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.629134 12457 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 236) took 1694 ms. Trace:
I20260709 12:24:04.653410 12457 rpcz_store.cc:276] 0709 12:24:02.935175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:02.935333 (+   158us) service_pool.cc:224] Handling call
0709 12:24:03.025394 (+ 90061us) spinlock_profiling.cc:243] Waited 3.18 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a55090 00007f0e94af3f3a 00007f0e9a8a9e9c 00007f0e9a9a804e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc 00007f0e98e68392 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:04.629072 (+1603678us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":110082,"reported_tablets":4,"spinlock_wait_cycles":7321472}
I20260709 12:24:04.655153 13942 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.607054 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.625726 13817 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.626515 13908 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.582005 13838 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.670127 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.656284 12707 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:04.674446 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:04.678879 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:04.680202 13838 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:04.680913 12550 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:04.681314 12550 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:04.682087 13908 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:04.682348 12629 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:04.684415 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:04.682904 13908 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.671382 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.689914 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.690973 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.698336 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.681398 13805 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:04.736552 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:04.754943 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.756304 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.753679 12625 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:04.764101 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:04.765727 13805 tablet_bootstrap.cc:492] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:04.766522 13805 ts_tablet_manager.cc:1403] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.858s	user 0.021s	sys 0.013s
I20260709 12:24:04.768916 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.765134 13925 raft_consensus.cc:1064] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:04.771482 12556 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:04.774442 13935 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.781666 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:04.782342 12629 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:04.788506 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 161580us
I20260709 12:24:04.796895 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:04.805986 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.807456 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.808717 12626 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 2: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:04.814167 13926 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:04.814783 13805 raft_consensus.cc:359] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.815640 13805 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:04.816304 13825 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:04.816828 13825 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.827723 12626 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:04.829751 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.833817 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:04.834146 13825 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.836836 13822 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:04.832629 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.838091 13908 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:04.689011 12550 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.824780 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:04.816305 13805 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:04.851596 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.855851 12629 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:04.859591 12634 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:04.857126 13892 tablet_copy_client.cc:538] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:04.858332 12707 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:04.861114 12707 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:04.864575 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:04.861075 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:04.866777 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.863716 13887 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:24:04.866420 13880 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:04.857143 12551 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:04.895752 13805 ts_tablet_manager.cc:1434] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.129s	user 0.006s	sys 0.001s
I20260709 12:24:04.902842 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.861308 13908 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:04.906739 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47598us
W20260709 12:24:04.946580 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.947395 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:04.866731 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:04.914433 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47716.7us
I20260709 12:24:04.949285 12598 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.950068 13940 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.950416 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:04.951148 13940 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:04.951503 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.951659 13940 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:04.954211 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:04.915136 13808 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:04.957615 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 90932.7us
I20260709 12:24:04.866290 12707 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.953190 13834 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.962267 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:04.963951 13656 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.952654 13940 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:04.960567 13794 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:04.968976 13846 consensus_queue.cc:1059] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.966830 12674 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:04.968217 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:04.958081 13914 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.970216 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-e19c569fe6e34f969a722bd2495c3a89 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:24:04.970657 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-e19c569fe6e34f969a722bd2495c3a89 on tablet e19c569fe6e34f969a722bd2495c3a89 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:04.972553 13902 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:04.974671 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:04.958758 13931 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:04.975761 13892 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:04.912921 13925 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:04.969018 13794 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:05.134161 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 86726.5us
I20260709 12:24:05.127446 13794 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:05.152645 12703 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:05.279376 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:05.297013 12550 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:05.305315 12457 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:05.308285 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:05.322485 13940 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:05.324234 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a769018c454aa685eae73d74c89abb"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:05.324952 12634 raft_consensus.cc:606] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:05.325541 13893 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.337777 12707 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.346462 12707 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:05.346716 13234 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:05.321115 12457 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:05.352382 13942 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:05.366484 13231 raft_consensus.cc:1217] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:05.368628 12703 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:05.385633 12551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:05.386289 12551 raft_consensus.cc:606] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:05.400017 13226 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:05.401535 13913 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:05.402900 12707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:05.403806 12707 raft_consensus.cc:606] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:05.409310 12559 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:05.410097 12559 raft_consensus.cc:606] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:05.412644 12629 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:05.412716 12550 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:05.417769 12703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:05.418320 12703 raft_consensus.cc:606] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:05.421960 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:05.427323 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:05.428303 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:05.439706 13887 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:05.458359 13891 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:05.458782 13891 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:05.466440 13891 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:05.458757 13892 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:05.474267 13891 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:05.520432 13892 tablet_bootstrap.cc:492] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:05.521463 13892 ts_tablet_manager.cc:1403] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.548s	user 0.022s	sys 0.009s
I20260709 12:24:05.535398 13892 raft_consensus.cc:359] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:05.582291 13892 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:05.583178 13892 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:05.611930 13892 ts_tablet_manager.cc:1434] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.089s	user 0.006s	sys 0.001s
I20260709 12:24:06.028941 12457 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 144) took 1356 ms. Trace:
I20260709 12:24:06.029264 12457 rpcz_store.cc:276] 0709 12:24:04.672582 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.678098 (+  5516us) service_pool.cc:224] Handling call
0709 12:24:06.028892 (+1350794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:05.429632 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:05.430295 (+   663us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:05.430326 (+    31us) write_op.cc:435] Acquired schema lock
0709 12:24:05.430348 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:05.430817 (+   469us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:05.430911 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:05.430941 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:05.431323 (+   382us) tablet.cc:701] Row locks acquired
0709 12:24:05.431344 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:24:05.431501 (+   157us) write_op.cc:270] Start()
0709 12:24:05.431627 (+   126us) write_op.cc:276] Timestamp: P: 1783599845431454 usec, L: 0
0709 12:24:05.431652 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:05.432519 (+   867us) log.cc:844] Serialized 968 byte log entry
0709 12:24:05.928602 (+496083us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b18002b9600. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:05.933106 (+  4504us) op_driver.cc:464] REPLICATION: finished
0709 12:24:05.934595 (+  1489us) write_op.cc:301] APPLY: starting
0709 12:24:05.934661 (+    66us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:05.934816 (+   155us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:05.934838 (+    22us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:05.935235 (+   397us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:05.935449 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:05.935502 (+    53us) write_op.cc:312] APPLY: finished
0709 12:24:05.935726 (+   224us) log.cc:844] Serialized 29 byte log entry
0709 12:24:05.938123 (+  2397us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.938213 (+    90us) write_op.cc:454] Released schema lock
0709 12:24:05.938260 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:05.938585 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:05.938613 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":7,"spinlock_wait_cycles":17024,"child_traces":[["op",{"apply.queue_time_us":1249,"apply.run_cpu_time_us":1793,"apply.run_wall_time_us":3971,"num_ops":2,"prepare.queue_time_us":74602,"prepare.run_cpu_time_us":18682,"prepare.run_wall_time_us":100827,"raft.queue_time_us":1423,"raft.run_cpu_time_us":1410,"raft.run_wall_time_us":1425,"replication_time_us":501286,"spinlock_wait_cycles":6543232,"thread_start_us":169137,"threads_started":4,"wal-append.queue_time_us":98726}]]}
I20260709 12:24:06.068207 12634 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.072956 13891 raft_consensus.cc:993] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:06.073520 13976 raft_consensus.cc:1081] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:06.074148 13891 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.096944 13842 raft_consensus.cc:993] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:06.097712 13842 raft_consensus.cc:1081] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:06.099586 13231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04a769018c454aa685eae73d74c89abb"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:24:06.100252 13231 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.100679 13231 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.105113 12700 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.116401 13231 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.123034 13935 raft_consensus.cc:993] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:06.124836 12703 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:06.126118 13231 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:06.123543 13935 raft_consensus.cc:1081] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:06.136296 12629 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:24:06.136873 12629 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.137192 12629 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.153932 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:06.154927 12633 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.155469 12633 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:06.155957 13227 raft_consensus.cc:1217] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:06.156708 12633 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.158316 12633 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.164374 13231 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:06.105113 12455 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.197993 13887 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:06.198724 13231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:24:06.205646 13231 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.206660 13231 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.212167 12633 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:06.213560 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:06.214777 13926 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.215546 13926 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:06.224486 12559 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:06.238281 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45703.2us
I20260709 12:24:06.240063 12629 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:06.241254 13926 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.242744 12629 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:06.243810 13977 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.245843 13231 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.253862 13231 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:06.265378 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:06.266265 12700 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.274724 12700 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:06.275970 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:06.276805 13932 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.277280 13932 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:06.278239 13932 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.291364 13897 raft_consensus.cc:1064] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:06.295198 13897 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.310025 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:06.310673 12700 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.321676 12568 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-52ac1951d6d64447869208058e8755b6 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:24:06.322242 12568 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-52ac1951d6d64447869208058e8755b6 on tablet 52ac1951d6d64447869208058e8755b6 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:06.321666 12700 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:06.324906 12453 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.327634 12453 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.333712 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:06.334298 12559 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.334602 12559 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:06.335296 12559 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.336439 12559 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.338316 13842 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.344398 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:06.345080 12550 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.348173 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:06.348815 12551 raft_consensus.cc:3055] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.349125 12551 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:06.349690 13947 raft_consensus.cc:993] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:06.350168 13947 raft_consensus.cc:1081] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:06.349838 12551 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:06.351223 12551 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.359513 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:06.360127 12554 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.360522 12554 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.370234 13846 raft_consensus.cc:993] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:06.370769 13846 raft_consensus.cc:1081] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:06.376960 12551 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:06.378436 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 237) took 1549 ms. Trace:
I20260709 12:24:06.380398 12598 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:06.380620 12701 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.383630 12550 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:06.388652 13842 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.384425 12554 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:06.389201 13842 raft_consensus.cc:697] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:06.390130 13842 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:06.392872 12554 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:06.394393 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:06.397326 12700 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.397719 12700 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:06.399526 12700 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:06.400715 12700 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:06.402984 13958 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.115s	user 0.007s	sys 0.000s
I20260709 12:24:06.421037 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:06.386005 12552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:06.385232 12559 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:06.440238 12552 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:06.388075 12454 rpcz_store.cc:276] 0709 12:24:04.828574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.829240 (+   666us) service_pool.cc:224] Handling call
0709 12:24:06.378374 (+1549134us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":7}
I20260709 12:24:06.440750 12552 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.422346 13231 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:06.434330 12700 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:06.440204 12629 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.387866 12457 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.384819 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 256) took 1481 ms. Trace:
I20260709 12:24:06.504595 12523 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:06.508673 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 62486.2us
I20260709 12:24:06.511708 13656 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.514667 13876 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:06.515269 13876 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:06.520597 13976 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.521193 13976 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:06.522163 13876 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:06.522192 13976 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:06.524333 13979 raft_consensus.cc:1064] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:06.527463 13979 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.532577 13228 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.533306 12630 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.534338 12627 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:06.535857 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:06.537449 12627 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:06.473191 12552 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.547256 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:06.547897 13228 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.486670 12455 rpcz_store.cc:276] 0709 12:24:04.903596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:04.903757 (+   161us) service_pool.cc:224] Handling call
0709 12:24:06.384757 (+1481000us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:06.257471 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:06.258057 (+   586us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:06.258090 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:24:06.258110 (+    20us) tablet.cc:662] Decoding operations
0709 12:24:06.258449 (+   339us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:06.258529 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:06.258565 (+    36us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:06.258740 (+   175us) tablet.cc:701] Row locks acquired
0709 12:24:06.258757 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:24:06.258887 (+   130us) write_op.cc:270] Start()
0709 12:24:06.258995 (+   108us) write_op.cc:276] Timestamp: P: 1783599846258849 usec, L: 0
0709 12:24:06.259015 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:06.259671 (+   656us) log.cc:844] Serialized 530 byte log entry
0709 12:24:06.262045 (+  2374us) op_driver.cc:464] REPLICATION: finished
0709 12:24:06.262440 (+   395us) write_op.cc:301] APPLY: starting
0709 12:24:06.262516 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:06.262619 (+   103us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:06.262715 (+    96us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:06.262914 (+   199us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:06.263079 (+   165us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:06.263130 (+    51us) write_op.cc:312] APPLY: finished
0709 12:24:06.263308 (+   178us) log.cc:844] Serialized 23 byte log entry
0709 12:24:06.263454 (+   146us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:06.263536 (+    82us) write_op.cc:454] Released schema lock
0709 12:24:06.263576 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:06.263873 (+   297us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:06.263903 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":8,"spinlock_wait_cycles":2432,"child_traces":[["op",{"apply.queue_time_us":219,"apply.run_cpu_time_us":1398,"apply.run_wall_time_us":1398,"num_ops":1,"prepare.queue_time_us":74710,"prepare.run_cpu_time_us":2489,"prepare.run_wall_time_us":2491,"replication_time_us":2914,"thread_start_us":56453,"threads_started":1}]]}
I20260709 12:24:06.558164 13227 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.561515 12552 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:06.561795 13979 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:06.563556 12627 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.564778 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:06.565353 12701 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:06.565726 12701 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:06.565512 13656 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.566592 13982 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.568899 12629 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:06.567776 12701 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.570557 12701 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:06.573606 13846 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.576809 13846 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.578956 12671 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:06.583745 13846 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:06.556309 13228 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:06.584152 13846 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:06.584551 13846 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.587428 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:06.588894 13935 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:06.589515 13935 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:06.598472 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:06.590379 13935 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.607367 12553 raft_consensus.cc:2410] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:06.610816 12553 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.615706 12706 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.619513 13982 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:06.626703 13897 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.640053 13871 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.642071 13846 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:06.670248 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e072821343d84e57b593eb6bc58c585a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.671586 13935 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.674971 13231 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.680881 12701 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:06.693768 13846 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:06.698603 13227 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.702766 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:06.703532 12634 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.704536 12457 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:24:06.708169 12701 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.714136 13972 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.716949 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:06.717645 12553 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.712471 12634 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:06.728885 12634 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.732204 13897 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.735025 12454 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.746798 12559 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.746924 12627 raft_consensus.cc:2955] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.750483 12671 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:06.751322 13656 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:06.750639 12455 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.751796 13656 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:06.752660 13656 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:06.759104 12633 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.766806 12453 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.772701 12701 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.781875 13972 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:06.782460 13972 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:06.794344 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:06.792142 13972 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:06.804004 12554 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.805536 13913 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.794340 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:06.813661 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:06.816217 12633 raft_consensus.cc:2368] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3.
I20260709 12:24:06.817899 13198 leader_election.cc:400] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3.
I20260709 12:24:06.818202 13198 leader_election.cc:403] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:06.805568 12455 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.823650 13926 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:06.823532 13227 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.825562 12700 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:06.827176 13983 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:06.832223 12454 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:06.842679 12552 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.842862 13926 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3.
I20260709 12:24:06.878270 12454 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.851199 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet e072821343d84e57b593eb6bc58c585a with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:24:06.854595 12550 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.865545 12553 raft_consensus.cc:2410] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 3 because replica has last-logged OpId of term: 1 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 2.
I20260709 12:24:06.867787 12627 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:06.906622 13932 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:06.948040 12627 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:06.965492 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002eefe0 after lost signal to thread 11395
W20260709 12:24:06.967761 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef6c0 after lost signal to thread 12491
W20260709 12:24:06.969086 13256 debug-util.cc:398] Leaking SignalData structure 0x7b0800349aa0 after lost signal to thread 12583
I20260709 12:24:06.968258 12453 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:06.970254 13256 debug-util.cc:398] Leaking SignalData structure 0x7b0800325300 after lost signal to thread 12658
W20260709 12:24:06.971390 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba860 after lost signal to thread 12732
W20260709 12:24:06.978219 13256 debug-util.cc:398] Leaking SignalData structure 0x7b080034ada0 after lost signal to thread 13259
W20260709 12:24:06.983182 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002933a0 after lost signal to thread 13914
I20260709 12:24:06.984479 12550 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:07.009276 13227 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:07.016499 13982 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:07.016813 12708 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.994234 13979 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:24:06.921650 13972 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 12:24:06.996001 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002918a0 after lost signal to thread 13929
W20260709 12:24:07.019588 13256 debug-util.cc:398] Leaking SignalData structure 0x7b0800385120 after lost signal to thread 13945
I20260709 12:24:07.019239 13926 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:07.020711 13982 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:07.022054 13227 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 12:24:07.029667 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 113280us
I20260709 12:24:07.063789 12708 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:07.046550 14012 tablet_replica.cc:333] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:24:07.039168 13982 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:07.042189 12700 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:07.078732 12700 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:07.097738 12708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:07.098297 12708 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:07.105356 14012 raft_consensus.cc:2243] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:07.106209 14012 raft_consensus.cc:2272] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:07.107326 13226 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:07.108958 14012 ts_tablet_manager.cc:1916] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:07.109179 12442 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 0afb49cf962a46388bf387ad7b344c39 already in progress [suppressed 3 similar messages]
I20260709 12:24:07.111186 12708 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:07.114555 13876 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:07.116829 13982 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:07.146328 13232 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:07.154294 13231 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:24:07.154736 13231 pending_rounds.cc:85] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 2
I20260709 12:24:07.154964 13231 pending_rounds.cc:107] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:24:07.155256 13231 raft_consensus.cc:2917] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:24:07.155637 13231 raft_consensus.cc:2889] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:07.157464 13897 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:07.204456 12701 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:07.208530 12552 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:07.168262 13979 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:07.210181 13871 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:07.247037 12703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:07.248795 12703 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:07.280083 13982 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.055s
I20260709 12:24:07.331544 13794 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:07.179623 12700 raft_consensus.cc:2955] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:07.337598 14012 ts_tablet_manager.cc:1929] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 12:24:07.351468 13794 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:07.371243 14012 log.cc:1199] T e072821343d84e57b593eb6bc58c585a P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/e072821343d84e57b593eb6bc58c585a
I20260709 12:24:07.367892 13974 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:07.378260 13232 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:07.384521 13897 raft_consensus.cc:1064] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
W20260709 12:24:07.385038 13897 raft_consensus.cc:1068] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Unable to promote non-voter 155b5b0a0b6d4b499edfe2797ffa5b91: Service unavailable: leader transfer in progress
I20260709 12:24:07.379160 13794 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:07.431577 12505 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:07.432703 12505 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 0afb49cf962a46388bf387ad7b344c39 already in progress
W20260709 12:24:07.449335 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 354867us
I20260709 12:24:07.471207 12633 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:07.481834 12554 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 12:24:07.482430 12554 pending_rounds.cc:85] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 2
I20260709 12:24:07.482777 12554 pending_rounds.cc:107] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:24:07.505484 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e19c569fe6e34f969a722bd2495c3a89 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:24:07.433290 12505 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 0afb49cf962a46388bf387ad7b344c39 already in progress
I20260709 12:24:07.528337 13947 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:07.531913 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet e072821343d84e57b593eb6bc58c585a (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:07.533380 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 52ac1951d6d64447869208058e8755b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:07.536681 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:07.549688 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:07.554716 12625 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:07.559514 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:07.488116 12554 raft_consensus.cc:2917] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:24:07.580302 12551 raft_consensus.cc:2955] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:07.630898 12554 raft_consensus.cc:2889] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:07.697897 14037 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.123s	user 0.004s	sys 0.000s
I20260709 12:24:07.716464 12523 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:07.718000 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 74741.6us
I20260709 12:24:07.719746 13979 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:07.728826 13871 raft_consensus.cc:993] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:07.729476 13871 raft_consensus.cc:1081] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:07.737864 14034 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:07.783401 12634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:07.788371 12634 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:07.788863 12634 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.801445 12455 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:07.815625 13846 raft_consensus.cc:1064] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
W20260709 12:24:07.816231 13846 raft_consensus.cc:1068] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Unable to promote non-voter 155b5b0a0b6d4b499edfe2797ffa5b91: Service unavailable: leader transfer in progress
I20260709 12:24:07.821831 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:07.844930 12634 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:07.847851 12631 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:07.869336 14034 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:07.870337 14034 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:07.870695 14034 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:07.875124 14034 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:07.883713 14034 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.902863 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:07.900367 12634 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:07.915868 12708 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:07.919711 12598 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:07.920815 13951 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:07.921389 13951 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:07.922518 13951 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:07.943625 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:07.950047 12551 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:07.974608 12457 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 4, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.998435 12551 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:08.008735 12453 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.030177 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 52ac1951d6d64447869208058e8755b6 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:24:08.073701 12619 tablet_service.cc:1558] Processing DeleteTablet for tablet e19c569fe6e34f969a722bd2495c3a89 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55074
I20260709 12:24:08.099910 14047 tablet_replica.cc:333] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:24:08.110443 14047 raft_consensus.cc:2243] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:08.111511 14047 raft_consensus.cc:2272] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:08.114944 14047 ts_tablet_manager.cc:1916] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:08.151753 12701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:08.152570 12701 raft_consensus.cc:606] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:08.156946 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:08.157516 12631 raft_consensus.cc:606] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:08.162190 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:08.162668 12631 raft_consensus.cc:606] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:08.166285 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:08.172529 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:08.172556 14047 ts_tablet_manager.cc:1929] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:08.173377 14047 log.cc:1199] T 52ac1951d6d64447869208058e8755b6 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/52ac1951d6d64447869208058e8755b6
I20260709 12:24:08.175704 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 52ac1951d6d64447869208058e8755b6 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:08.177610 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:08.180984 14047 tablet_replica.cc:333] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:24:08.186307 14047 raft_consensus.cc:2243] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:08.192061 14047 raft_consensus.cc:2272] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:08.207147 14047 ts_tablet_manager.cc:1916] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:08.212090 13975 raft_consensus.cc:993] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:08.226225 13975 raft_consensus.cc:1081] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:08.230376 12551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:08.230957 12551 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.231313 12551 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.252429 14047 ts_tablet_manager.cc:1929] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:08.252946 14047 log.cc:1199] T e19c569fe6e34f969a722bd2495c3a89 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/e19c569fe6e34f969a722bd2495c3a89
I20260709 12:24:08.254566 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet e19c569fe6e34f969a722bd2495c3a89 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:08.282275 12551 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.285588 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:08.286216 12632 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:08.286535 12632 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:08.287426 12632 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.288722 12632 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.312197 13975 raft_consensus.cc:993] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:08.312813 13975 raft_consensus.cc:1081] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:08.319702 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:08.320446 12554 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.320932 12554 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.332358 12632 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:08.336669 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:08.337553 12551 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:08.345367 12701 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.348997 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:08.349472 13876 raft_consensus.cc:993] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:08.350011 13876 raft_consensus.cc:1081] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:08.350914 14036 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.351438 14036 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:08.352411 14036 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.356015 12701 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:08.360458 12554 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.362313 12632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:08.364542 12554 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:08.367161 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:08.367786 12707 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.367835 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:08.368495 12634 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:08.368808 12634 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:08.369575 12634 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.370545 12634 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.372546 12632 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:08.374671 12632 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.375660 12707 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:08.377899 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:08.380764 13794 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.381281 13794 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:08.383004 13794 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.395414 12632 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.400292 12632 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:08.407150 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:08.407804 12701 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:08.408100 12701 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:08.410873 12634 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:08.408887 12701 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.417287 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:08.419679 12559 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.420609 12701 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:08.427860 12559 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:08.427805 12701 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:08.429183 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:08.430258 13842 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:08.433825 13842 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:08.434899 13842 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:08.454496 12453 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.463589 13232 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Advancing to term 4
I20260709 12:24:08.471869 13232 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:08.473613 13977 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:08.473497 12453 catalog_manager.cc:5697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.485134 12701 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:08.485335 13975 raft_consensus.cc:1064] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
W20260709 12:24:08.486720 13975 raft_consensus.cc:1068] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Unable to promote non-voter 155b5b0a0b6d4b499edfe2797ffa5b91: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:08.487720 13975 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.487581 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.545007 12559 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:08.547190 13975 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:08.597604 13842 raft_consensus.cc:1064] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:08.600052 13842 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:08.607117 13232 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:08.607972 12701 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:08.609313 12551 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:08.609766 13977 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.612315 13951 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.613794 13951 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:08.633937 12708 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.635757 13975 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.642943 12550 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.713912 13229 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 2 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.718998 12454 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 2 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.759771 12634 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:08.790656 12550 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:08.793709 13975 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:08.808145 13232 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:08.807835 13951 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.809391 12551 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.812824 13977 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:08.822892 12550 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.825563 13975 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.826414 13232 raft_consensus.cc:2955] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Committing config change with OpId 4.6: config changed from index 5 to 6, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:08.829538 12634 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.829994 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0afb49cf962a46388bf387ad7b344c39 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:08.838670 14050 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.857197 12708 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.859956 14050 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.853315 12457 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 5 to 6, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.905054 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet 0afb49cf962a46388bf387ad7b344c39 with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:08.912534 12708 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:08.918263 14036 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 12:24:08.993288 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 57353.5us
I20260709 12:24:09.018179 14060 tablet_replica.cc:333] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:24:09.047829 12701 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:09.050010 14060 raft_consensus.cc:2243] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:09.050976 14060 raft_consensus.cc:2272] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:09.044163 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 70738.3us
W20260709 12:24:09.069523 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 51624.7us
I20260709 12:24:09.096539 14060 ts_tablet_manager.cc:1916] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:09.090689 14064 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:09.150274 12630 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:09.184154 14073 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:09.201864 14060 ts_tablet_manager.cc:1929] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 4.5
I20260709 12:24:09.202517 14060 log.cc:1199] T 0afb49cf962a46388bf387ad7b344c39 P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/0afb49cf962a46388bf387ad7b344c39
I20260709 12:24:09.223060 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet 0afb49cf962a46388bf387ad7b344c39 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:09.256780 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.338058 12550 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:09.374172 12554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:09.374891 12554 raft_consensus.cc:606] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:09.378541 12522 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d5554b3483384c14898b46be0dbd5ae5. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.381620 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:09.382169 12708 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:09.382258 12634 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:09.386610 14065 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:09.394219 12630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:09.394953 12630 raft_consensus.cc:606] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:09.400411 12551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:09.401089 12551 raft_consensus.cc:606] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:09.408365 12630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:09.409085 12630 raft_consensus.cc:606] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:09.410703 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:09.412448 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:09.413187 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:09.439694 14073 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:09.444234 12630 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:09.445888 13794 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.458458 12707 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:09.494837 12634 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:09.505321 12454 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.550055 12630 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:09.579674 14080 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:24:09.600468 12707 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:24:09.605032 12597 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c8dc26a51db24f54ad0e0272c06d9306. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:09.609522 13977 raft_consensus.cc:993] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:09.610754 14073 raft_consensus.cc:993] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:09.623095 14073 raft_consensus.cc:1081] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:09.623852 13977 raft_consensus.cc:1081] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:09.625957 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:09.626585 12554 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.626982 12554 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.620324 12550 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:09.632340 12708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45144
I20260709 12:24:09.632961 12708 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.633301 12708 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.639948 12554 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:09.640080 14067 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:09.654911 12554 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:09.654506 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:09.656066 12701 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.656666 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:09.657219 12632 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:09.657527 12632 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:09.658275 12632 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:09.659294 12632 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.663434 12701 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:09.670311 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:09.672266 14063 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:09.672798 14063 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:09.673740 14063 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:09.730154 14073 raft_consensus.cc:993] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:09.730683 14073 raft_consensus.cc:1081] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:09.739315 13226 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:24:09.739980 13226 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.740417 13226 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:09.743762 14080 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260709 12:24:09.753211 13226 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:09.760584 13226 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:09.761704 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:09.762339 12634 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.771525 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:09.772275 12550 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:09.772635 12550 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:09.783794 12634 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:09.785197 13198 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:09.786278 14056 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:09.786825 14056 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:09.793771 14056 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:09.797250 13842 raft_consensus.cc:993] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:09.797861 13842 raft_consensus.cc:1081] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:09.806439 12550 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:09.808426 12550 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:09.818899 12454 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:09.831297 12524 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.11.32.62:45335, user_credentials={real_user=slave}} blocked reactor thread for 54610.6us
I20260709 12:24:09.844316 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:09.844879 12554 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:09.845196 12554 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:09.857352 12708 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:09.860718 12708 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:09.863709 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:09.864521 12630 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:09.757309 12632 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:09.886368 12554 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:09.913218 12454 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:09.928627 12550 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:09.934304 14071 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:09.950843 14090 ts_tablet_manager.cc:933] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:09.980163 14067 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:09.994517 14092 ts_tablet_manager.cc:933] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:09.998798 14092 tablet_copy_client.cc:323] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:24:10.002149 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet c8dc26a51db24f54ad0e0272c06d9306 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:24:10.003050 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet c8dc26a51db24f54ad0e0272c06d9306 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-c8dc26a51db24f54ad0e0272c06d9306
I20260709 12:24:10.016110 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:10.015429 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:10.018211 14090 tablet_copy_client.cc:323] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:24:10.018575 12631 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:10.018906 12631 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:10.019635 12631 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:10.020774 12631 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.029690 12708 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.030300 12554 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:10.031461 12559 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.034759 14071 raft_consensus.cc:993] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:10.035233 14071 raft_consensus.cc:1081] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:10.036772 12701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:24:10.037300 12701 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.037691 12701 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.042186 12631 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:10.058698 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:10.063570 14088 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:10.064128 14088 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:10.065012 14088 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:10.070808 12708 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:10.071682 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:10.059604 12630 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:10.077620 12550 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:10.077682 12701 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:10.078329 12550 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:10.079171 12550 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:10.079907 12701 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:10.080312 12550 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:10.080905 12632 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:10.081218 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:10.082145 13229 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.085028 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:10.086143 14074 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:10.086621 14074 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:10.087471 14074 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:10.089251 12550 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:10.094437 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:10.095185 12630 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:10.095523 12630 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:10.095886 13229 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:10.097931 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:10.098513 12630 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:10.100932 12707 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.099783 14075 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:10.105137 12630 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:10.111317 12630 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:10.109520 14075 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:10.173712 14075 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:10.177748 12568 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet d5554b3483384c14898b46be0dbd5ae5 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:24:10.178649 12568 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet d5554b3483384c14898b46be0dbd5ae5 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-d5554b3483384c14898b46be0dbd5ae5
I20260709 12:24:10.183195 12454 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.185233 12454 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 3 to 4, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 4 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.186866 12644 tablet_copy_source_session.cc:215] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:24:10.201561 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 61620us
I20260709 12:24:10.207724 12701 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:10.211520 12630 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:10.207746 14092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8dc26a51db24f54ad0e0272c06d9306. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:10.228350 14088 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:10.262281 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 151969us
I20260709 12:24:10.259473 12568 tablet_copy_source_session.cc:215] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:10.280646 12454 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.319968 14092 tablet_copy_client.cc:806] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.320675 14092 tablet_copy_client.cc:670] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
W20260709 12:24:10.340939 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 74495.8us
I20260709 12:24:10.352092 12708 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:10.359195 14102 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:10.365195 14090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d5554b3483384c14898b46be0dbd5ae5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:10.366698 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8cad0ce0b1e4401c95e8abd3bbbdd60b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:10.370906 12550 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:10.384155 14106 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:10.395639 12454 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 4, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 4 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.402837 14092 tablet_copy_client.cc:538] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:10.426517 12632 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:10.435578 14113 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:10.459203 12625 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:10.461030 12553 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:10.461922 14106 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:10.480501 14087 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:10.484403 12631 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:10.487572 13794 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:10.505599 14092 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:10.511673 14090 tablet_copy_client.cc:806] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:10.527215 14090 tablet_copy_client.cc:670] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:10.532547 12634 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:10.535859 14104 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.538443 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.550887 12701 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:10.556308 14090 tablet_copy_client.cc:538] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:10.567421 14103 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:10.572618 14121 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:24:10.568437 12631 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.578008 14065 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:10.602293 12550 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.707527 12552 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ac1951d6d64447869208058e8755b6"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:10.709178 12552 raft_consensus.cc:606] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
W20260709 12:24:10.726663 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet c12120af627b4866b9f483d6cd9f30f5: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:10.730352 12553 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:10.748324 12634 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:10.769960 12550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:10.735667 14087 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:10.772125 12550 raft_consensus.cc:606] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:10.788380 14074 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:10.823904 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48564.5us
I20260709 12:24:10.850234 14090 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
W20260709 12:24:10.883409 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 117751us
I20260709 12:24:10.901889 12457 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:10.903463 12699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:10.911075 12699 raft_consensus.cc:606] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:10.913172 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 122117us
I20260709 12:24:10.918231 12701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:10.918892 12701 raft_consensus.cc:606] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:10.921591 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 85703.5us
I20260709 12:24:10.930986 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:10.932879 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:10.933774 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.960217 13227 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:10.994701 14113 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:11.095366 14134 raft_consensus.cc:993] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:11.095863 14134 raft_consensus.cc:993] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:11.096275 14134 raft_consensus.cc:1081] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:11.096705 14073 raft_consensus.cc:1081] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:11.108270 14139 ts_tablet_manager.cc:933] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:11.152418 14090 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:11.153443 14090 tablet_bootstrap.cc:492] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:11.154155 14090 ts_tablet_manager.cc:1403] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.304s	user 0.038s	sys 0.018s
W20260709 12:24:11.169144 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 95308.2us
I20260709 12:24:11.173573 12632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:24:11.174190 12632 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.174567 12632 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.189620 12708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "52ac1951d6d64447869208058e8755b6"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45144
I20260709 12:24:11.267755 12708 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.268148 12708 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.266871 14112 raft_consensus.cc:993] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:11.270089 14112 raft_consensus.cc:1081] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:11.193967 14092 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:11.273877 14092 tablet_bootstrap.cc:492] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:11.275315 14092 ts_tablet_manager.cc:1403] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.770s	user 0.032s	sys 0.032s
W20260709 12:24:11.283581 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 126136us
I20260709 12:24:11.297912 12632 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:11.298842 14092 raft_consensus.cc:359] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:11.299507 14092 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:11.299769 12632 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:11.315703 14139 tablet_copy_client.cc:323] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:24:11.305558 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:11.325824 12700 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.310030 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:11.329664 12554 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.330029 12554 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.313102 14132 raft_consensus.cc:993] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:11.295905 14090 raft_consensus.cc:359] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:11.333815 14090 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:11.333909 14132 raft_consensus.cc:1081] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:11.301882 14092 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:11.311868 12708 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:11.338104 12708 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:11.338842 12554 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:11.340164 14092 ts_tablet_manager.cc:1434] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.064s	user 0.002s	sys 0.004s
I20260709 12:24:11.334529 14090 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:11.358444 14090 ts_tablet_manager.cc:1434] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.204s	user 0.005s	sys 0.002s
I20260709 12:24:11.359596 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-c8dc26a51db24f54ad0e0272c06d9306 received from {username='slave'} at 127.0.0.1:40560
I20260709 12:24:11.360129 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-c8dc26a51db24f54ad0e0272c06d9306 on tablet c8dc26a51db24f54ad0e0272c06d9306 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:11.363359 12554 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:11.367080 12625 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:11.372051 12568 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-d5554b3483384c14898b46be0dbd5ae5 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:24:11.372548 12568 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-d5554b3483384c14898b46be0dbd5ae5 on tablet d5554b3483384c14898b46be0dbd5ae5 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:11.344621 12700 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:11.350677 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:24:11.352391 12551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:24:11.374301 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-8cad0ce0b1e4401c95e8abd3bbbdd60b
I20260709 12:24:11.374384 12551 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.353103 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:11.374871 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:11.374898 12551 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.375527 12625 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.375123 12553 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:11.381604 12553 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:11.382411 12553 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:11.383543 12553 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.387115 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:11.388002 12718 tablet_copy_source_session.cc:215] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:11.388486 13977 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:11.390331 13977 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:11.390422 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:11.390992 12550 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:11.391275 12550 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:11.391170 13977 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:11.391763 12551 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:11.394202 12551 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:11.395042 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:11.389923 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:11.405603 13226 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.399224 14139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:11.412220 13226 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:11.415026 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:11.415872 14110 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:11.416391 14110 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:11.417240 14110 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:11.392479 12550 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:11.390349 12553 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:11.419597 14143 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:11.419682 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:11.421064 14132 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:11.421526 14132 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:11.422334 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:11.422436 14132 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:11.423072 12701 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:11.423655 12701 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:11.401780 12625 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:11.427726 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:11.428305 12699 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:11.428608 12699 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:11.429158 12701 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:11.429337 12699 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:11.430342 12701 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.430531 12699 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.436640 12550 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:11.449395 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:11.450042 13226 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.458298 12701 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:11.462857 12625 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:11.465942 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:11.466334 13226 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:11.466831 14133 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:11.467500 14133 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:11.468154 12550 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:11.469290 14133 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:11.496660 12453 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.485261 12699 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:11.522903 12454 catalog_manager.cc:5697] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.529889 13232 raft_consensus.cc:1217] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 12:24:11.559831 14150 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:24:11.561368 14151 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:11.648465 14139 tablet_copy_client.cc:806] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:11.649088 14139 tablet_copy_client.cc:670] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:11.650321 12455 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.652045 13226 raft_consensus.cc:1217] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 12:24:11.669991 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 48383us
I20260709 12:24:11.682211 14139 tablet_copy_client.cc:538] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:11.695787 14139 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:11.799418 12708 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:11.807960 14131 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:11.812496 13226 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.816025 14133 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:11.827383 12455 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:11.858034 12554 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.860497 14109 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:11.867010 12700 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.868952 12553 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:11.874428 14131 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:11.876682 14142 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.887475 12630 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.895566 14063 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 12:24:11.930593 14139 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:11.935642 13226 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.940186 14132 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:24:11.958446 14139 tablet_bootstrap.cc:492] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:11.991390 14139 ts_tablet_manager.cc:1403] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.296s	user 0.014s	sys 0.012s
I20260709 12:24:12.000515 14131 raft_consensus.cc:1064] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:12.007547 12699 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:12.014930 14063 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:12.062573 14131 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:12.113256 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 123382us
I20260709 12:24:12.143265 13226 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:12.109508 14139 raft_consensus.cc:359] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:12.169140 14139 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:12.182288 14139 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:12.152908 14170 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260709 12:24:12.198845 12554 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:12.203624 14135 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:24:12.223294 14139 ts_tablet_manager.cc:1434] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.227s	user 0.004s	sys 0.004s
I20260709 12:24:12.225373 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-8cad0ce0b1e4401c95e8abd3bbbdd60b received from {username='slave'} at 127.0.0.1:33230
I20260709 12:24:12.225879 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-8cad0ce0b1e4401c95e8abd3bbbdd60b on tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b with peer 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:12.264101 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 115863us
I20260709 12:24:12.264698 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:12.284471 12700 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:12.313902 13977 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:12.317845 13227 raft_consensus.cc:1217] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 12:24:12.351850 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49387.6us
W20260709 12:24:12.366091 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 68572.5us
I20260709 12:24:12.406384 14186 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.443742 14142 raft_consensus.cc:1064] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:12.453464 14142 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.476544 12554 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.501927 13232 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.512611 12454 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:12.516021 12700 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.531502 13232 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:12.532017 12632 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:12.536439 14110 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:24:12.549849 14142 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:12.567461 12701 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:12.589972 14110 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:24:12.615526 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0116b2408a7241828256061551a36f1c"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:12.616173 12634 raft_consensus.cc:606] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:12.628185 12554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793f816912494728bf76dd612942dc4c"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:12.628789 12554 raft_consensus.cc:606] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:12.631951 12708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:12.632547 12708 raft_consensus.cc:606] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:12.634054 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:12.635649 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:12.636384 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:12.649201 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 83379.3us
I20260709 12:24:12.648658 14142 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.652079 13226 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:12.687114 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 96428.8us
I20260709 12:24:12.694095 12634 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.722512 12708 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.733088 12453 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.742738 14132 raft_consensus.cc:1064] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:12.746380 14132 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.781847 14174 raft_consensus.cc:993] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:12.782362 14174 raft_consensus.cc:1081] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:12.786120 12625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:12.786782 12625 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:12.787178 12625 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.791626 14142 raft_consensus.cc:993] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:12.792116 14188 raft_consensus.cc:1081] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:12.793646 12699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793f816912494728bf76dd612942dc4c"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45144
I20260709 12:24:12.794111 12699 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:12.794415 12699 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.802811 12699 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.807487 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:12.807551 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:12.808179 13226 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.808272 12554 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.808749 12554 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:12.809515 12699 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:12.809583 12554 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.810868 12554 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.805598 12550 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.817368 12630 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.822968 12554 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:12.825297 13232 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:12.826725 13977 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:12.804941 12625 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:12.834636 14187 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.825480 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:12.838340 12634 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:12.838786 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:12.839375 14132 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:12.841871 12553 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:12.839398 12551 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.842317 14112 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:12.841998 13229 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.843869 14174 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:12.848430 12634 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:12.851159 14188 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:12.851507 13227 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:12.843869 13226 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:12.867633 13232 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:12.859370 14132 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:12.868413 14188 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:12.874200 14132 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:12.884415 14174 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:12.886837 14203 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:12.888057 12625 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:12.895548 12551 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:12.896134 14182 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.899618 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c8dc26a51db24f54ad0e0272c06d9306 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:12.911238 12634 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.908944 12600 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:12.916574 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:12.917368 12699 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:12.917793 12699 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:12.918680 12699 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:12.919725 12699 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:12.920168 12456 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 4 to 5, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:12.922632 12701 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:12.926455 12553 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:12.938045 14155 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:12.938882 14155 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:12.940137 14155 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:12.936969 13977 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:24:12.970216 13227 raft_consensus.cc:2955] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:13.032501 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 99088.7us
I20260709 12:24:13.049350 14074 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.054010 12701 raft_consensus.cc:2955] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.074120 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet c8dc26a51db24f54ad0e0272c06d9306 with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:38704
I20260709 12:24:13.077832 14099 raft_consensus.cc:993] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:13.078533 14099 raft_consensus.cc:1081] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:13.083958 12550 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0116b2408a7241828256061551a36f1c"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:13.084467 12550 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.084762 12550 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.082193 12455 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.102205 12550 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:13.104346 12550 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:13.104622 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:13.105170 12634 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:13.106019 12634 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:13.106809 12634 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:13.108011 12634 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.115455 12553 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.136042 12634 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:13.142431 12456 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.141067 12522 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:13.141485 12453 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.154330 14063 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:13.160526 14063 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:13.161525 14063 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:13.179190 12699 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:13.203811 14209 tablet_replica.cc:333] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:24:13.205080 14209 raft_consensus.cc:2243] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:13.206696 14209 raft_consensus.cc:2272] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:13.211618 12456 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:13.215415 14209 ts_tablet_manager.cc:1916] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:13.219008 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 73802.4us
I20260709 12:24:13.221942 13227 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.229269 12634 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.231220 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet d5554b3483384c14898b46be0dbd5ae5 with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:13.242341 14213 tablet_replica.cc:333] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:24:13.243381 14213 raft_consensus.cc:2243] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:13.245774 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:13.246433 12699 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:13.248236 14213 raft_consensus.cc:2272] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:13.251266 12707 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:13.256533 14213 ts_tablet_manager.cc:1916] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:13.260931 14209 ts_tablet_manager.cc:1929] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:13.261471 14209 log.cc:1199] T c8dc26a51db24f54ad0e0272c06d9306 P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/c8dc26a51db24f54ad0e0272c06d9306
I20260709 12:24:13.263756 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet c8dc26a51db24f54ad0e0272c06d9306 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:13.282847 12634 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:13.290726 12699 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:13.298458 14113 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:13.309340 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d5554b3483384c14898b46be0dbd5ae5 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:13.310241 14213 ts_tablet_manager.cc:1929] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:13.310812 14213 log.cc:1199] T d5554b3483384c14898b46be0dbd5ae5 P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/d5554b3483384c14898b46be0dbd5ae5
I20260709 12:24:13.321730 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet d5554b3483384c14898b46be0dbd5ae5 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:13.325109 14113 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.335223 13229 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:13.334874 12456 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.356643 12625 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.362615 12453 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:13.366236 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:13.370025 14113 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:13.381603 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:24:13.382690 14209 tablet_replica.cc:333] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:24:13.392318 13227 raft_consensus.cc:2955] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:13.407006 13229 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:13.410925 14209 raft_consensus.cc:2243] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:13.411891 14209 raft_consensus.cc:2272] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:13.412748 14112 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:13.415591 14209 ts_tablet_manager.cc:1916] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:13.419778 12551 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:13.421011 14112 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:13.449030 12701 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.452246 14155 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.502208 14209 ts_tablet_manager.cc:1929] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:13.502758 14209 log.cc:1199] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/8cad0ce0b1e4401c95e8abd3bbbdd60b
I20260709 12:24:13.523738 12551 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.530829 14155 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.531138 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 8cad0ce0b1e4401c95e8abd3bbbdd60b (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:13.634373 12701 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.639065 12625 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:13.637341 14142 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:13.642452 14193 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:13.861042 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.966358 12701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:13.967000 12701 raft_consensus.cc:606] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:13.973699 12551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:13.974340 12551 raft_consensus.cc:606] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:13.979281 12634 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:13.979861 12634 raft_consensus.cc:606] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:13.984769 12551 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:13.985355 12551 raft_consensus.cc:606] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:13.986564 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:13.988293 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:13.989048 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:13.991642 13977 raft_consensus.cc:993] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:13.992136 14187 raft_consensus.cc:1081] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:13.995637 13227 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:24:13.996327 13227 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:13.996734 13227 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.065261 13227 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:14.070889 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:14.071810 12634 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:14.072423 12634 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:14.073797 12634 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:14.075023 12634 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.087448 12634 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:14.089399 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:14.088820 13227 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:14.090484 12707 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.096366 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:14.097373 14195 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:14.097867 14195 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:14.098697 14195 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:14.103576 12707 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:14.232713 12455 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.259414 14142 raft_consensus.cc:993] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:14.259905 14142 raft_consensus.cc:1081] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:14.263118 12625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:24:14.263659 12625 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.263991 12625 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.273563 14182 raft_consensus.cc:993] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:14.274084 14182 raft_consensus.cc:1081] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:14.275868 12699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45144
I20260709 12:24:14.276414 12699 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.276765 12699 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.287504 14226 raft_consensus.cc:993] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:14.288053 14226 raft_consensus.cc:1081] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:14.284339 12699 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:14.289888 12632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:14.291759 12632 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.291795 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:14.292292 12632 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.292487 12551 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:14.292888 12551 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:14.293608 12551 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:14.294763 12551 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.298151 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:14.298755 12634 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:14.315259 12625 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:14.291240 12699 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:14.318331 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:14.318914 12553 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:14.319197 12553 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:14.319563 12632 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:14.319900 12553 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:14.320957 12553 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.321580 12632 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:14.322611 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:14.322777 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:14.323218 12699 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:14.323335 13227 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.323588 12699 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:14.324530 12699 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:14.325999 12699 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.332815 13227 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:14.332922 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:14.337221 12699 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:14.333616 12634 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:14.337775 12701 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.338672 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:14.339745 14112 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:14.340372 14112 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:14.341377 14112 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:14.346588 12701 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:14.348423 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:14.348739 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:14.349370 14099 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:14.349705 14155 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:14.349926 14099 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:14.350320 14155 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:14.350977 14099 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:14.351310 14155 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:14.334328 12551 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:14.333462 12625 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:14.365227 12553 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:14.396044 12455 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.398487 12455 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:14.411585 12453 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:14.598738 12634 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:14.601511 14189 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:14.653120 12699 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:14.664448 14225 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:14.740159 12550 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:14.753849 14227 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:14.780864 13229 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:14.785486 14099 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:14.814998 12634 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:14.822268 14227 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:14.830976 12553 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.834124 12699 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:14.835323 14099 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:14.837435 14187 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:14.867386 12699 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:14.872144 12707 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:14.878726 14187 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:14.954437 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 70481.8us
W20260709 12:24:14.994349 12671 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 91e9b98dfcc94a4f87b33617aa6df487. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:14.997838 12634 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:15.009435 12553 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:15.015260 14248 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:15.039397 14251 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:15.053120 14247 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.061554 12550 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.071594 12634 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.080240 12553 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:15.090728 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.087477 12453 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 4, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:15.135423 12522 consensus_peers.cc:597] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8bd8b4df5594ab89b5028f708332757. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.136497 12699 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:15.137996 12634 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:15.140132 14188 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:15.147431 14182 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:15.199847 14188 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.207614 12701 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.235350 12453 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.240446 12634 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.262467 12630 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:15.280813 12707 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:15.281467 12707 raft_consensus.cc:606] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:15.290756 12632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:15.291401 12632 raft_consensus.cc:606] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:15.297065 12632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:15.297700 12632 raft_consensus.cc:606] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:15.299029 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:15.301703 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:15.302467 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:15.348223 12699 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:15.351562 12553 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:15.352624 13977 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:15.351665 12597 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: df7bcc0f7c2a4fc0a36e8605f87a3a0b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.358013 14252 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:15.384368 14252 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.391562 12699 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.433030 12553 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.429216 14262 ts_tablet_manager.cc:933] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:15.473328 14262 tablet_copy_client.cc:323] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:24:15.492481 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 91e9b98dfcc94a4f87b33617aa6df487 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:24:15.493049 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 91e9b98dfcc94a4f87b33617aa6df487 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-91e9b98dfcc94a4f87b33617aa6df487
I20260709 12:24:15.505661 12456 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.506806 12718 tablet_copy_source_session.cc:215] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:15.510159 14262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 91e9b98dfcc94a4f87b33617aa6df487. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:15.545790 14262 tablet_copy_client.cc:806] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:15.546536 14262 tablet_copy_client.cc:670] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:15.554641 14262 tablet_copy_client.cc:538] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:15.555107 12699 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:15.580399 14262 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:15.611083 14226 raft_consensus.cc:993] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:15.612206 14248 raft_consensus.cc:1081] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:15.619761 14187 raft_consensus.cc:993] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:15.620402 14187 raft_consensus.cc:1081] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:15.619683 12634 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:15.621747 12634 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:15.621981 12701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:24:15.622517 12701 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:15.622824 12701 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.622150 12634 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.642997 12701 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:15.645740 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:15.646342 12551 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.652814 12634 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:15.653565 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:15.645781 12701 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:15.654083 12630 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:15.654399 12630 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:15.655107 12630 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:15.655944 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:15.656469 13229 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.657384 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:15.657934 12707 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.658215 12707 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:15.658895 12707 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:15.659874 12707 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.653074 12551 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:15.656091 12630 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.663573 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:15.665067 14226 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:15.665594 14226 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:15.667162 14226 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:15.667990 13229 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:15.669454 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:15.671083 13977 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.671502 13977 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:15.672222 13977 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:15.676431 12707 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:15.685627 12634 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:15.681258 12630 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:15.710479 12453 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:15.706442 12456 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.717960 14262 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.724095 14262 tablet_bootstrap.cc:492] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:15.724884 14262 ts_tablet_manager.cc:1403] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.160s	user 0.023s	sys 0.008s
I20260709 12:24:15.734983 14262 raft_consensus.cc:359] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:15.735895 14262 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
W20260709 12:24:15.737756 12671 consensus_peers.cc:597] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 902b0c6b28a040c9902fea6547ffaa9f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.737588 14262 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:15.739439 12554 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:15.740751 12634 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:15.741945 14251 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.744655 14262 ts_tablet_manager.cc:1434] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.003s
I20260709 12:24:15.747526 14251 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.748708 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-91e9b98dfcc94a4f87b33617aa6df487 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:24:15.749192 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-91e9b98dfcc94a4f87b33617aa6df487 on tablet 91e9b98dfcc94a4f87b33617aa6df487 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:15.763437 14262 ts_tablet_manager.cc:933] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:15.776793 14251 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.789891 12634 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.810676 12453 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.822532 12554 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:15.828919 13977 raft_consensus.cc:993] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:15.829496 14099 raft_consensus.cc:1081] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:15.831195 12551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:15.831749 12551 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:15.832147 12551 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.835120 14262 tablet_copy_client.cc:323] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
W20260709 12:24:15.839965 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49406us
I20260709 12:24:15.851971 14269 ts_tablet_manager.cc:933] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:15.862701 12568 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet f8bd8b4df5594ab89b5028f708332757 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:24:15.863379 12568 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet f8bd8b4df5594ab89b5028f708332757 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-f8bd8b4df5594ab89b5028f708332757
I20260709 12:24:15.874503 13229 raft_consensus.cc:1217] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:24:15.882995 14269 tablet_copy_client.cc:323] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:24:15.885221 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:24:15.885862 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-df7bcc0f7c2a4fc0a36e8605f87a3a0b
I20260709 12:24:15.890578 12568 tablet_copy_source_session.cc:215] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:15.898542 12644 tablet_copy_source_session.cc:215] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:15.910211 14262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8bd8b4df5594ab89b5028f708332757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:15.919107 14269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:15.904942 12551 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:15.933049 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:15.933799 12707 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.939911 14262 tablet_copy_client.cc:806] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:15.940570 14262 tablet_copy_client.cc:670] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:15.949247 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:15.950626 12634 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:15.950941 12634 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:15.953063 12634 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:15.954275 12634 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:15.959046 12707 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:15.960587 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:15.961689 14272 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:15.962225 14272 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:15.963227 14272 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:15.976576 12551 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:15.993070 14262 tablet_copy_client.cc:538] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:16.009877 12455 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:16.026556 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 56493us
I20260709 12:24:16.031256 12634 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:16.042964 14262 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:16.050503 12551 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:16.051999 14251 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:16.052369 14269 tablet_copy_client.cc:806] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:16.053036 14269 tablet_copy_client.cc:670] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:16.064983 14269 tablet_copy_client.cc:538] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:16.094631 14269 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:16.114530 12632 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:16.117714 14248 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:16.241534 14262 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:16.242530 14262 tablet_bootstrap.cc:492] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:16.255533 14262 ts_tablet_manager.cc:1403] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.213s	user 0.035s	sys 0.026s
I20260709 12:24:16.258700 14262 raft_consensus.cc:359] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:16.262270 14269 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:16.268790 14269 tablet_bootstrap.cc:492] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:16.269606 14269 ts_tablet_manager.cc:1403] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.175s	user 0.016s	sys 0.013s
W20260709 12:24:16.263962 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 107498us
I20260709 12:24:16.277308 14269 raft_consensus.cc:359] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:16.289573 14269 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:16.285274 13229 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:16.290431 14269 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:16.292974 14252 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:16.294365 12699 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:16.293478 14269 ts_tablet_manager.cc:1434] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:24:16.304217 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-df7bcc0f7c2a4fc0a36e8605f87a3a0b received from {username='slave'} at 127.0.0.1:40560
I20260709 12:24:16.304656 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-df7bcc0f7c2a4fc0a36e8605f87a3a0b on tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:16.308003 13977 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:16.350107 13234 raft_consensus.cc:1217] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:16.351537 14269 ts_tablet_manager.cc:933] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:16.378473 14269 tablet_copy_client.cc:323] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:24:16.381176 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 902b0c6b28a040c9902fea6547ffaa9f from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:24:16.381825 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 902b0c6b28a040c9902fea6547ffaa9f from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-902b0c6b28a040c9902fea6547ffaa9f
I20260709 12:24:16.259581 14262 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:16.391337 14262 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:16.397899 12718 tablet_copy_source_session.cc:215] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:16.402110 14269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 902b0c6b28a040c9902fea6547ffaa9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:16.411978 12632 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:16.413502 14182 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:16.402127 14262 ts_tablet_manager.cc:1434] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.146s	user 0.002s	sys 0.005s
I20260709 12:24:16.420935 12568 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-f8bd8b4df5594ab89b5028f708332757 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:24:16.421370 12568 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-f8bd8b4df5594ab89b5028f708332757 on tablet f8bd8b4df5594ab89b5028f708332757 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:16.442883 14248 raft_consensus.cc:1064] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:16.447085 12699 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:16.450663 14273 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:16.447620 14248 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:16.460667 14269 tablet_copy_client.cc:806] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:16.472631 13232 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:16.473670 12554 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:16.478425 14269 tablet_copy_client.cc:670] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:16.479048 14248 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:16.483037 12632 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:16.484208 14269 tablet_copy_client.cc:538] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:16.492074 14249 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:16.494053 14249 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:16.511596 14269 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
W20260709 12:24:16.539095 14293 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 12:24:16.563158 14249 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.566150 13232 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.621551 12632 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.622186 12551 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.640626 12456 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 4 to 5, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.679454 14269 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:16.680657 14269 tablet_bootstrap.cc:492] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:16.687567 14269 ts_tablet_manager.cc:1403] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.176s	user 0.018s	sys 0.007s
I20260709 12:24:16.690835 14269 raft_consensus.cc:359] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:16.697821 14269 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:16.698688 14269 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:16.712169 14269 ts_tablet_manager.cc:1434] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:24:16.722488 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-902b0c6b28a040c9902fea6547ffaa9f received from {username='slave'} at 127.0.0.1:33230
I20260709 12:24:16.722973 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-902b0c6b28a040c9902fea6547ffaa9f on tablet 902b0c6b28a040c9902fea6547ffaa9f with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:16.732731 13232 raft_consensus.cc:1217] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:16.734081 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.768428 12699 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:16.806532 14252 raft_consensus.cc:1064] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:16.809165 14252 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:16.824949 13232 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:16.826642 14249 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:16.830235 12551 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:16.831710 14282 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:16.836251 13229 raft_consensus.cc:1217] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:16.841156 12554 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:16.845629 13227 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:16.849852 12707 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:16.861649 12554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:16.862397 12554 raft_consensus.cc:606] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:16.875308 14252 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:16.889212 14251 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.883036 14099 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:24:16.892354 13227 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:16.904940 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 65223us
I20260709 12:24:16.930058 12554 raft_consensus.cc:2955] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:16.943274 12699 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:16.943970 12699 raft_consensus.cc:606] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:16.956398 12632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:16.957062 12632 raft_consensus.cc:606] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:16.958451 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:16.960419 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:16.962322 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:16.981653 12455 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 5 to 6, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:17.013348 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66728us
I20260709 12:24:16.914633 14304 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:24:17.051308 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 91e9b98dfcc94a4f87b33617aa6df487 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:17.065994 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 91e9b98dfcc94a4f87b33617aa6df487 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:55074
I20260709 12:24:17.072028 14303 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.078044 12551 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.102684 14313 tablet_replica.cc:333] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:24:17.105500 12707 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.130831 14313 raft_consensus.cc:2243] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.130465 13232 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.131722 14313 raft_consensus.cc:2272] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.137857 12455 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.139133 14313 ts_tablet_manager.cc:1916] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:17.151963 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 128562us
I20260709 12:24:17.161852 14226 raft_consensus.cc:1064] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:17.164347 14272 raft_consensus.cc:993] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:17.164861 14273 raft_consensus.cc:1081] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:17.169582 12630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:24:17.170185 12630 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.170526 12630 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.172449 14226 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.177829 12630 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:17.180601 14249 raft_consensus.cc:993] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:17.197021 14249 raft_consensus.cc:1081] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:17.187150 12632 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.200415 12625 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55082
I20260709 12:24:17.201016 12625 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.201344 12625 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.201905 12630 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:17.218768 13232 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:17.221459 12625 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:17.226202 12551 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:17.226379 14313 ts_tablet_manager.cc:1929] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:24:17.226791 14313 log.cc:1199] T 91e9b98dfcc94a4f87b33617aa6df487 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/91e9b98dfcc94a4f87b33617aa6df487
I20260709 12:24:17.223783 12632 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:17.224480 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:17.227312 12554 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.227589 12554 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:17.221832 14251 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:17.227814 12625 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:17.228293 12554 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:17.229560 12554 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.231060 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:17.231629 12701 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.231537 14303 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:17.232044 12701 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:17.232805 12701 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:17.234746 12701 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.236284 12554 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:17.241068 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 91e9b98dfcc94a4f87b33617aa6df487 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:17.241365 14251 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:17.246222 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:17.248492 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:17.250986 12707 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.251031 14099 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.252691 14099 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:17.253705 14099 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:17.268630 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:17.269357 12551 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.274585 13229 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:17.286828 14303 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:17.288223 14248 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.296422 14306 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.301215 13232 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.242805 12701 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:17.305707 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:17.306761 14309 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.308390 12554 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:17.309024 14309 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:17.310087 14307 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:17.310346 14309 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:17.317173 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:17.317476 12455 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.324079 12630 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.331316 12554 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.333962 12551 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:17.330435 12454 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.337037 12707 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:17.358372 12707 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.359709 13227 raft_consensus.cc:2955] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.378748 12455 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.431008 12551 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:24:17.453855 14315 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 12:24:17.496759 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 92469.3us
I20260709 12:24:17.526158 12630 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:17.551122 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:17.563843 13232 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:17.560783 12454 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:17.567674 14248 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.570173 14248 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.573434 14272 raft_consensus.cc:1064] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:17.578550 14272 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.582199 14226 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.600270 13232 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.606067 12630 raft_consensus.cc:2955] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.622056 14330 tablet_replica.cc:333] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:24:17.627318 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 902b0c6b28a040c9902fea6547ffaa9f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:17.635375 13232 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:17.641207 14322 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:17.645452 12708 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:17.646695 14322 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:17.635876 12455 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 3 to 4, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.663453 12634 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:17.672163 14306 raft_consensus.cc:993] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:17.672619 14306 raft_consensus.cc:1081] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:17.672905 14329 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:17.682257 12551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:17.682921 12551 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:17.683300 12551 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.707012 12551 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.709895 12551 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:17.710487 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:17.711071 13227 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.711063 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:17.718565 12630 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.719199 12630 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:17.722483 13227 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:17.723644 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:17.723831 12701 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.724439 14322 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:17.724892 14322 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:17.725744 14322 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.730537 14272 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.734349 12701 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.732810 14330 raft_consensus.cc:2243] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.734896 14306 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:24:17.735332 12708 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.735404 12630 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:17.745752 14328 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:17.736734 14330 raft_consensus.cc:2272] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.748080 12630 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.759114 14330 ts_tablet_manager.cc:1916] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:17.806422 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 902b0c6b28a040c9902fea6547ffaa9f with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:38704
I20260709 12:24:17.865279 14339 tablet_replica.cc:333] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:24:17.874264 12632 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:17.877091 12550 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.882378 12559 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.893347 14339 raft_consensus.cc:2243] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:17.901398 14339 raft_consensus.cc:2272] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:17.915822 14252 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:17.927752 12630 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:17.928274 14099 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 12:24:17.926410 14330 ts_tablet_manager.cc:1929] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:17.932052 14330 log.cc:1199] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/df7bcc0f7c2a4fc0a36e8605f87a3a0b
I20260709 12:24:17.943480 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet df7bcc0f7c2a4fc0a36e8605f87a3a0b (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:17.957237 14339 ts_tablet_manager.cc:1916] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.022713 12454 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.058693 13227 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:18.096752 12453 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:18.143520 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:18.172083 12554 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:18.205214 12632 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.215596 13227 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.218581 14272 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:18.230221 14339 ts_tablet_manager.cc:1929] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:18.241797 14339 log.cc:1199] T 902b0c6b28a040c9902fea6547ffaa9f P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/902b0c6b28a040c9902fea6547ffaa9f
I20260709 12:24:18.263517 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 902b0c6b28a040c9902fea6547ffaa9f (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:18.265142 14272 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:18.275108 12630 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.281306 14322 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:18.307869 14188 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:18.326130 12630 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:18.339391 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f8bd8b4df5594ab89b5028f708332757 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:18.349236 13232 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:18.360760 13232 raft_consensus.cc:2955] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:18.373394 14188 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:18.375187 12453 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.418700 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet f8bd8b4df5594ab89b5028f708332757 with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45128
I20260709 12:24:18.419730 14330 tablet_replica.cc:333] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:24:18.421058 14330 raft_consensus.cc:2243] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:18.422006 14330 raft_consensus.cc:2272] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:18.448758 14330 ts_tablet_manager.cc:1916] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:18.514221 14330 ts_tablet_manager.cc:1929] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:24:18.514657 14330 log.cc:1199] T f8bd8b4df5594ab89b5028f708332757 P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/f8bd8b4df5594ab89b5028f708332757
I20260709 12:24:18.517907 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet f8bd8b4df5594ab89b5028f708332757 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:24:18.562733 12630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:18.563475 12630 raft_consensus.cc:606] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:18.576869 12630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:18.577703 12630 raft_consensus.cc:606] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:18.582738 12554 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:18.583413 12554 raft_consensus.cc:606] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:18.585783 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:18.587529 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:18.588605 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:19.027406 14327 raft_consensus.cc:993] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:19.028074 14327 raft_consensus.cc:1081] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:19.031037 13232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:24:19.031718 13232 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.032100 13232 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.063902 14306 raft_consensus.cc:993] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:19.064487 14306 raft_consensus.cc:1081] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:19.067691 12552 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:19.068297 12552 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.068677 12552 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.077348 12552 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:19.091837 12552 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:19.131196 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:19.132091 12632 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.132447 12632 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:19.137313 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:19.138019 12701 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.200568 12632 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:19.202375 12632 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.244339 14311 raft_consensus.cc:993] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:19.244933 14322 raft_consensus.cc:1081] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:19.417054 13232 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:19.454005 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:19.454787 12625 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:19.455154 12625 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:19.456087 12625 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:19.457756 12625 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.468091 12625 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:19.483814 12701 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:19.487232 12701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45144
I20260709 12:24:19.487792 12701 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.488174 12701 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.489076 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:19.490262 14311 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.490744 14311 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:19.491691 14311 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:19.488090 13198 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:19.496694 14352 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.497191 14352 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:19.497993 12701 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:19.498129 14352 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:19.500106 12701 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:19.501477 12699 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.482901 12632 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
W20260709 12:24:20.803013 12632 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1532) took 1673 ms (client timeout 2115 ms). Trace:
W20260709 12:24:20.803568 12632 rpcz_store.cc:269] 0709 12:24:19.129795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.130921 (+  1126us) service_pool.cc:224] Handling call
0709 12:24:20.802912 (+1671991us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:19.841223 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:19.962894 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48127.1us
I20260709 12:24:19.470611 13232 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:20.684480 14352 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.003s	sys 0.014s
W20260709 12:24:20.877069 14352 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.003s	sys 0.015s
W20260709 12:24:20.685505 12525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.000s	sys 0.017s
W20260709 12:24:20.877889 12525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.037s	user 0.000s	sys 0.018s
W20260709 12:24:20.696915 12523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.005s	sys 0.016s
W20260709 12:24:20.880230 12523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.005s	sys 0.016s
W20260709 12:24:20.880590 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 1.36785e+06us
I20260709 12:24:20.884160 14272 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.884750 14272 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.699373 14354 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.886155 14354 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.888548 14354 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.705883 14360 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.709946 14099 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.889356 14099 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.889287 14360 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.889503 14272 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.891403 14099 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.720662 14361 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.892105 14360 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.709575 14358 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.892243 14361 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.893304 14358 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.895177 14361 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.895357 14358 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.725206 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 190) took 1222 ms. Trace:
I20260709 12:24:20.743862 14364 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.746989 14311 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.747601 14363 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.896592 14363 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.898811 14363 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.899389 14311 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.901508 14311 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:20.732172 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.769641 14365 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:20.902784 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.902720 14365 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.772689 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:20.896052 12701 rpcz_store.cc:276] 0709 12:24:19.502474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.724182 (+1221708us) service_pool.cc:224] Handling call
0709 12:24:20.724576 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:20.724789 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:20.724839 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:20.724893 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:20.724936 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.725007 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:20.725135 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:20.905704 12551 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.908051 14359 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.909920 14365 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.845121 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:20.851809 14342 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.852376 14369 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.910694 14099 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.910776 12555 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.911064 14369 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.911366 12555 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:20.911317 14099 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.912364 12555 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.913347 14369 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:20.913369 12555 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.914288 14360 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.914839 14360 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.916777 14360 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.908663 14359 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.919412 14361 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.919945 14361 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.920681 14359 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.921052 14365 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.867010 14322 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.925729 14322 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.926890 14356 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.927371 14356 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.927889 14322 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.866425 14362 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.877127 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50978 (request call id 512) took 1847 ms. Trace:
I20260709 12:24:20.928525 13232 rpcz_store.cc:276] 0709 12:24:19.030176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.030885 (+   709us) service_pool.cc:224] Handling call
0709 12:24:20.877040 (+1846155us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":247}
I20260709 12:24:20.928576 14362 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.864151 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1335) took 1460 ms. Trace:
I20260709 12:24:20.929811 12699 rpcz_store.cc:276] 0709 12:24:19.403420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.444421 (+ 41001us) service_pool.cc:224] Handling call
0709 12:24:19.501155 (+ 56734us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:19.501894 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:20.863846 (+1361952us) spinlock_profiling.cc:243] Waited 56.4 ms on lock 0x7b54002a2450. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:20.864040 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":129744256}
I20260709 12:24:20.930783 14356 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:20.778301 12598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.335s	user 0.079s	sys 0.174s
I20260709 12:24:20.931056 14362 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:20.931327 12598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.489s	user 0.080s	sys 0.175s
W20260709 12:24:20.931761 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 1.48917e+06us
I20260709 12:24:20.915516 14369 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.924127 14373 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.910830 14342 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.913537 14354 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.933696 14373 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.934181 14354 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.934720 14365 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.935279 14342 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:20.935884 14342 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.936187 14373 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.936324 14354 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.933637 14350 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.937608 14365 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.937453 14350 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.938215 14369 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.753659 14188 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.939810 14188 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.940196 14350 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:20.936439 14342 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:20.940572 14369 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.942366 14342 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.942242 14327 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.943138 14327 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.944464 14306 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.944679 14188 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.945194 14306 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.947934 14306 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.950214 14099 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:20.951860 14099 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.952461 14099 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:20.956602 12555 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:20.957324 14359 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.957823 14365 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.959229 12551 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:20.959673 14306 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:20.945340 14327 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:20.962996 12580 debug-util.cc:398] Leaking SignalData structure 0x7b080022d520 after lost signal to thread 11395
I20260709 12:24:20.917212 14360 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:20.962647 12455 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:20.955700 14354 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:20.922575 14361 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.987537 14342 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.990043 14327 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.028081 14099 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.977871 14365 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.045147 14099 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.047659 14350 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.047209 14342 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.015659 14369 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:20.977814 14359 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:21.054406 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08003422e0 after lost signal to thread 12491
I20260709 12:24:21.055459 14099 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:21.061096 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08001d1fa0 after lost signal to thread 12583
I20260709 12:24:21.061510 14099 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.062022 14099 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:21.062201 12580 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba520 after lost signal to thread 12658
I20260709 12:24:21.062510 14099 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:21.063349 12580 debug-util.cc:398] Leaking SignalData structure 0x7b080029eb40 after lost signal to thread 12732
I20260709 12:24:21.064358 14099 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:20.987280 14364 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.013428 14354 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.042694 14352 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.016081 14360 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.066505 14099 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:21.064486 12580 debug-util.cc:398] Leaking SignalData structure 0x7b0800383220 after lost signal to thread 13259
I20260709 12:24:21.012473 14306 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:21.071014 12580 debug-util.cc:398] Leaking SignalData structure 0x7b0800377b00 after lost signal to thread 14348
I20260709 12:24:21.070156 14099 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.079679 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:21.083961 12625 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:21.084345 12454 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 3 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.044111 14327 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.094825 14099 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.097046 14376 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.097826 14380 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.057391 14350 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.097806 14376 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.098523 14380 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:21.109086 11397 debug-util.cc:398] Leaking SignalData structure 0x7b080000f800 after lost signal to thread 12598
I20260709 12:24:21.105665 14342 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.066455 14369 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.099583 12699 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:21.130995 14350 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.131281 14381 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.131785 14382 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:21.132256 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 72405.9us
I20260709 12:24:21.133908 14376 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.130995 14360 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.140347 14342 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.145130 14380 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.146507 14368 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.149488 12625 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
W20260709 12:24:21.151125 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 58498.9us
I20260709 12:24:21.078913 14352 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.154515 14359 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.155532 14354 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.155824 14306 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.172732 14327 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.172873 14350 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.173503 14386 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.174185 14099 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.182054 14377 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.182236 14385 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.182776 14364 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.183671 14369 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.184139 14352 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.182066 14368 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.168115 14376 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.190686 14099 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.177114 14380 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.176095 14342 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.157923 14382 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.158423 14381 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.191628 14359 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.248499 12625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:21.250574 12625 raft_consensus.cc:606] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:21.235399 14376 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.196842 14365 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:21.253559 12522 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.2:34669 timed out after 2.115s (SENT)
I20260709 12:24:21.237447 14379 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:21.253485 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 58479.6us
I20260709 12:24:21.226166 14369 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.235544 14367 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.256906 14374 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.257045 14383 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.247355 14327 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.237699 14380 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.258249 14376 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.261052 14099 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.227487 14350 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.248687 14354 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:21.278393 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 86560.3us
I20260709 12:24:21.272850 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.281198 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.252511 14359 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.277542 14365 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.289258 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.194561 14377 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.290657 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.258870 14381 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.291844 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.297089 12632 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:21.295498 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.295481 12550 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:21.302002 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.274802 14369 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.304867 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.283890 14367 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.281391 14383 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.196898 14386 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.226493 14385 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.288218 14354 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.290719 14327 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.295400 14365 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.287714 14374 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.268599 14379 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:21.594223 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.388484 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:21.313684 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.309152 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.532193 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:21.484719 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.531386 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.297128 14392 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:21.309151 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 56958.9us
I20260709 12:24:21.598606 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.621235 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.626089 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.524561 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.366101 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:21.628547 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.524751 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.600576 12626 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:21.610649 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.633217 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.634265 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.635106 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.629359 12627 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:21.633998 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.640015 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.611249 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.641516 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.309304 14399 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.385903 14387 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.371045 14382 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.309829 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.613124 14406 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.360956 14400 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.309072 14370 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.594488 14369 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.386376 14342 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.323875 14393 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.427047 14398 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.370162 14359 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.370517 14380 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.324424 14396 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:21.647401 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.648607 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.323803 14366 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.323622 14378 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.404059 14352 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.642261 14392 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.368607 14350 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.427754 14376 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.413250 14390 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.361073 14377 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.367347 14368 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.648509 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.653005 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.642793 14405 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.661453 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.655225 14406 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.665818 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.666281 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.667629 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.661378 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.665892 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.660918 14370 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.668726 14393 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.671113 14354 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.652565 14404 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:21.671599 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 82946.5us
I20260709 12:24:21.324373 14391 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.829149 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.728612 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.702929 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.844703 12634 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:21.672976 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.672520 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.771090 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.783591 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.703825 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.666342 14400 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.849112 12633 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:21.660076 14387 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.850127 14327 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.851306 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.660989 14369 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:21.851919 14405 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.866439 14404 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:21.851946 12671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.006s	sys 0.017s
I20260709 12:24:21.900213 14385 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.872231 14378 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.901151 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.906703 12707 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:21.703663 14367 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.831552 14382 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:21.906801 12671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.008s	sys 0.018s
I20260709 12:24:21.944079 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.842692 14374 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.941835 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.871794 14380 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.731770 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.782766 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.887737 14376 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.831959 14409 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.830286 14402 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.842790 14379 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.872324 14366 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.831702 14395 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:21.882318 14383 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.872025 14352 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.653074 14399 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:21.866595 14401 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:21.676929 14398 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.904808 12701 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:21.867069 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.946638 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.994588 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.995107 14380 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.995867 14387 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.997308 14380 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:21.962296 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.949225 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:21.959239 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.999558 12704 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
W20260709 12:24:22.001219 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52067.4us
I20260709 12:24:22.006475 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.008028 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:21.992602 14407 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.016201 12627 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:22.016690 12631 raft_consensus.cc:606] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.016640 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:21.965210 14374 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:22.015817 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:21.904855 14390 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.946640 14369 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.943624 14393 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:21.962492 14386 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.017490 12708 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:22.017202 12631 raft_consensus.cc:614] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:22.070029 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.070647 14369 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.070729 13226 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:22.004407 12552 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:22.074749 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.075003 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.998478 14405 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.075534 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:22.075573 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:22.076442 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.076625 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.076797 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.078070 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.078310 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.078720 13231 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:22.079074 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.079519 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.079905 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.080091 12707 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:22.080516 12700 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:24:21.983762 14410 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.080778 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.084007 12552 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:22.083019 12699 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:22.076678 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.081173 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:21.998977 14379 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.007405 14327 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:21.958495 14382 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.091251 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.091243 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.001003 14365 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:21.964680 14413 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:22.090234 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.899052 14391 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.938004 14396 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.000591 14409 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.202800 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.206111 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.120157 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:22.149073 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.070709 14376 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.209116 12702 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:24:22.212399 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.060847 14398 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.062819 14399 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.219471 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:22.091866 14327 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:22.093511 14406 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.217300 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.091301 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.157979 14404 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.156791 14400 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.015202 14402 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.250097 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:21.998704 14401 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:21.999902 14395 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.251564 14402 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.242702 14327 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.208509 14413 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.268587 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.251859 14370 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.144222 14374 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.237632 14415 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:24:22.263051 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.092309 14379 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.269827 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.238381 12633 raft_consensus.cc:2376] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3. Re-sending same reply.
I20260709 12:24:22.243873 14366 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.081115 14407 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.119442 14410 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.281384 14401 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.282598 14396 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.318909 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.318743 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.283519 14378 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.284138 14409 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.285919 14413 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.287698 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:22.288754 14414 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:24:22.291208 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.291605 14327 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.293617 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.299983 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.301017 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.245946 14382 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.305400 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.313748 14417 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:22.308571 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 146384us
I20260709 12:24:22.310237 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.318050 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.318688 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.327860 13232 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
W20260709 12:24:22.333425 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 87814.7us
I20260709 12:24:22.337133 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.338732 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.319904 14352 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.341308 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.341584 12631 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:22.342196 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.345491 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.346333 12553 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:24:22.349153 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.352099 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.357570 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.358573 12558 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:22.361572 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.362223 13229 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:22.362982 14419 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.363670 14420 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.363560 14419 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.364188 14420 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.344301 14413 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:22.366020 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.364763 14407 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.340128 14382 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.349448 14383 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.346246 14378 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.380193 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.340564 14398 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:24:22.362884 14379 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.370718 12674 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:22.368829 14419 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:22.387238 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:22.385774 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 47146.8us
I20260709 12:24:22.389724 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.389804 14418 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.392016 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.381466 14413 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:22.393658 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.394158 14413 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.394685 14409 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.395579 14420 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.396306 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.347494 14417 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.398561 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.400290 14410 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:22.403692 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 115320us
I20260709 12:24:22.404917 14391 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.400336 14390 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.405251 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.391184 14399 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.412010 14422 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.411193 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.400990 14386 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.414234 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.415766 14404 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:22.415932 14420 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:22.417274 14420 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.418063 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.418331 14327 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.419234 14365 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:22.409638 14399 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:22.419287 14426 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.420280 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.401249 14419 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.411095 14350 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.427822 14426 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.401834 14418 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.420178 14399 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.408954 14392 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:22.420289 14374 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:22.455235 14395 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.454134 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.464178 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.413997 14422 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.435902 14419 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.469648 12552 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 1.
I20260709 12:24:22.489054 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:22.501271 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 87085.5us
I20260709 12:24:22.502877 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:22.501399 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 90318us
I20260709 12:24:22.504165 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.504492 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.511662 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.516700 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.520831 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:22.526643 14306 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:22.527086 14306 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.527645 14354 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.528124 14354 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.524334 12550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:22.527458 12600 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:22.527468 14306 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.529117 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.531190 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.528534 14354 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.534535 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.535022 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.537007 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.536723 13201 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:22.529038 12550 raft_consensus.cc:606] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:22.539330 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.539934 12707 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:22.540006 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.541025 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.541314 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.519603 14422 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.542095 14396 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:22.542752 14370 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.542939 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.543648 12556 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:22.545841 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.547943 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.549633 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.549911 14416 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:22.550493 14390 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:22.551010 14390 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.551424 14390 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.552595 12554 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:22.554116 14426 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.539497 14368 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.550452 14416 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.555732 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.556308 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.559557 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.560201 12551 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:22.518321 14366 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.562124 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.558617 14421 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.562723 14374 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.563279 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.563803 14370 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:24:22.565366 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.565685 12707 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:22.568847 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.569329 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.564430 14413 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.567946 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.567946 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.574265 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:22.576829 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.577119 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:22.577697 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.577996 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.578832 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.563781 14417 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.577018 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.580621 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:22.582237 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.578776 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.566187 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.588198 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:22.599642 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.600695 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.604736 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.566337 14386 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:22.570206 14396 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.611083 14391 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:22.578028 14420 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.574029 14367 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.629689 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.565424 14366 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.613042 14427 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.607229 13201 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.566984 14421 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.621538 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.566514 14416 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:22.625777 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 242627us
I20260709 12:24:22.605449 14368 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.607517 14398 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.632434 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.638036 12706 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:22.661892 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 93337.4us
I20260709 12:24:22.641336 14418 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.638147 14419 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.620055 14327 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.619095 14386 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.638933 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.666345 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.648932 14399 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.638638 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.659601 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.668933 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.654543 14427 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.662410 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.669963 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:22.664937 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:22.664120 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 98830.9us
I20260709 12:24:22.657099 14366 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.674655 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.640226 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:22.655902 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48772.9us
I20260709 12:24:22.667546 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.640453 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.671145 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.660336 14415 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.678850 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.663571 14398 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.623582 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:22.674050 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.669605 14386 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:22.677131 14419 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:22.677834 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.671768 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.682243 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.677085 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:22.676036 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:22.660516 14421 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.691359 14427 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.664510 14306 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.695367 14306 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.701289 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:22.686738 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 71380.3us
I20260709 12:24:22.696924 14419 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.685513 12708 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:22.688041 12701 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 1.
I20260709 12:24:22.684727 14398 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.705615 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.705855 12598 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:22.706499 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.708035 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.750602 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.701464 14432 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.702473 14419 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.751621 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.751561 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.751863 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.701373 14352 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:22.750043 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44255.6us
I20260709 12:24:22.759264 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.758440 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.708293 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:22.697547 14390 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.751638 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.844046 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.807016 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.703799 14427 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.842993 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.882449 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.770080 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.774282 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.857928 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.773886 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:22.891607 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 183367us
I20260709 12:24:22.894235 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.898190 14418 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.898615 14418 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:22.811568 12633 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:22.898846 14367 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:22.893339 12704 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:22.903949 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.904042 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.906571 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:22.750363 14306 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.899037 14418 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.813562 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.933319 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:22.919262 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:22.844512 14421 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.920838 14327 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.924099 14429 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:22.845853 14399 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:22.891227 14352 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:22.813532 14439 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.902581 14367 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.846305 14386 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.902212 14427 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:22.937793 12701 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:22.825385 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:22.934717 14306 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:22.944468 14366 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.947206 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.966183 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.807276 14432 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.837076 14433 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:22.950695 13199 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.974164 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.975414 14421 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:22.975596 14392 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:22.953824 14352 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.976328 14392 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.976751 14392 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:22.977144 14392 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.968387 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:22.969234 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:22.978999 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 45666.4us
I20260709 12:24:22.975418 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.836814 14354 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:22.984604 12553 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:22.986852 13199 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:22.990000 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 89463.6us
I20260709 12:24:22.990541 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.990969 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.992522 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:22.994079 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:22.994742 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.964500 14427 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.997116 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:22.997893 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.002209 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.002487 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.002830 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.004348 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.005023 12627 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:22.978626 14401 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.980379 14399 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.010010 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:22.969952 14439 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:23.012023 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:22.989588 14410 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:22.990350 14416 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.022504 12633 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:23.024977 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.033949 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:23.024587 12671 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 54ae52ca0f5e4e988dcd22a9651ec1bd. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:24:23.037463 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 48144.9us
W20260709 12:24:23.006361 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 102403us
I20260709 12:24:23.007071 14409 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.030149 14444 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.003100 14421 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.003448 14380 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.028239 14306 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.044673 14327 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:23.056407 14327 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.056811 14327 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.023587 14445 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:23.057778 14445 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.058172 14445 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:23.039522 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 93118.4us
I20260709 12:24:23.041301 12632 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
W20260709 12:24:23.042444 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54679.9us
I20260709 12:24:23.042833 14452 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.043905 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.023699 14439 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.037719 14417 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:23.052531 12629 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:23.050333 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53310.9us
I20260709 12:24:23.010387 14399 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:23.039258 14425 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.066748 14398 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.070261 12671 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.077608 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.078336 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.051069 14421 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.073613 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.087821 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.069171 14354 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.070129 14400 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.094262 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.097213 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:23.099330 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58773.5us
I20260709 12:24:23.071446 14417 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:23.074338 14399 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.106168 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.103194 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.102005 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.061015 14446 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.091362 14391 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.111270 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.091727 14416 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.092752 14421 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.118235 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.109781 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.105726 14405 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.121282 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.124058 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.124653 14410 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.121927 14446 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.113829 12523 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.116456 14425 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.126233 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.128152 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.128446 14419 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.129334 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 314) took 2172 ms. Trace:
I20260709 12:24:23.100117 14396 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.092272 14390 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.114573 14417 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.100479 14400 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:23.120985 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.138111 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.139000 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.162987 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.115629 14409 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.122390 14370 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.153540 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.130486 14416 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.152043 14446 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.140892 14444 raft_consensus.cc:993] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:23.164969 12453 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:23.183440 13199 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.167726 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.169265 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 210) took 2096 ms. Trace:
I20260709 12:24:23.110540 14423 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:24:23.191574 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.192296 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.192955 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.199627 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.193630 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.147938 14452 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.195214 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.151196 14386 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.202461 12553 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:23.200388 12634 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:23.201336 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.204324 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.204957 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.164458 14400 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.196885 14440 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.206511 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.207607 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.164849 14366 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.169711 14361 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:23.209347 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 43680.6us
I20260709 12:24:23.166325 14378 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.193769 14416 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.212484 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:23.197045 12454 rpcz_store.cc:276] 0709 12:24:21.068311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.068456 (+   145us) service_pool.cc:224] Handling call
0709 12:24:23.164252 (+2095796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:21.998882 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:22.081071 (+ 82189us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:22.081104 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:24:22.081118 (+    14us) tablet.cc:662] Decoding operations
0709 12:24:22.081521 (+   403us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:22.081586 (+    65us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:22.081627 (+    41us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:22.081858 (+   231us) tablet.cc:701] Row locks acquired
0709 12:24:22.081883 (+    25us) write_op.cc:260] PREPARE: finished
0709 12:24:22.082037 (+   154us) write_op.cc:270] Start()
0709 12:24:22.082168 (+   131us) write_op.cc:276] Timestamp: P: 1783599862081985 usec, L: 0
0709 12:24:22.082197 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:24:22.082868 (+   671us) log.cc:844] Serialized 530 byte log entry
0709 12:24:22.881037 (+798169us) op_driver.cc:464] REPLICATION: finished
0709 12:24:23.052032 (+170995us) write_op.cc:301] APPLY: starting
0709 12:24:23.052140 (+   108us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:23.052259 (+   119us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:23.052410 (+   151us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:23.052710 (+   300us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:23.052902 (+   192us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:23.052957 (+    55us) write_op.cc:312] APPLY: finished
0709 12:24:23.053151 (+   194us) log.cc:844] Serialized 23 byte log entry
0709 12:24:23.053383 (+   232us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.053511 (+   128us) write_op.cc:454] Released schema lock
0709 12:24:23.053556 (+    45us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.053949 (+   393us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.053982 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":70619,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":152316,"apply.run_cpu_time_us":1957,"apply.run_wall_time_us":6193,"mutex_wait_us":6279,"num_ops":1,"prepare.queue_time_us":903112,"prepare.run_cpu_time_us":2818,"prepare.run_wall_time_us":85863,"replication_time_us":798679,"thread_start_us":83562,"threads_started":1}]]}
I20260709 12:24:23.193882 14390 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:23.194516 14422 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.222564 13199 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.241111 14423 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:23.244149 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.219825 14411 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.249462 14399 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.250818 14449 raft_consensus.cc:993] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:23.236797 14409 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:23.237668 14366 raft_consensus.cc:1081] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:23.252344 14409 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:23.252799 14409 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.149955 12455 rpcz_store.cc:276] 0709 12:24:20.956894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:20.957055 (+   161us) service_pool.cc:224] Handling call
0709 12:24:23.129206 (+2172151us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:21.303642 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:21.364849 (+ 61207us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:21.364913 (+    64us) write_op.cc:435] Acquired schema lock
0709 12:24:21.364942 (+    29us) tablet.cc:662] Decoding operations
0709 12:24:21.412857 (+ 47915us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:21.428838 (+ 15981us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:21.436384 (+  7546us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:21.515997 (+ 79613us) tablet.cc:701] Row locks acquired
0709 12:24:21.521134 (+  5137us) write_op.cc:260] PREPARE: finished
0709 12:24:21.574820 (+ 53686us) write_op.cc:270] Start()
0709 12:24:21.586193 (+ 11373us) write_op.cc:276] Timestamp: P: 1783599861574112 usec, L: 0
0709 12:24:21.590817 (+  4624us) op_driver.cc:348] REPLICATION: starting
0709 12:24:21.729521 (+138704us) log.cc:844] Serialized 535 byte log entry
0709 12:24:22.671118 (+941597us) op_driver.cc:464] REPLICATION: finished
0709 12:24:22.880407 (+209289us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b1800228460. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e91a00a40 00007f0e919fb4e4 00007f0e919fb455 00007f0e94a68190 00007f0e94a61ae7 00007f0e94a60dd9 00007f0e94a6b930
0709 12:24:22.898642 (+ 18235us) write_op.cc:301] APPLY: starting
0709 12:24:22.898738 (+    96us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:22.898853 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:22.898890 (+    37us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:22.899140 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:22.908289 (+  9149us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:22.929759 (+ 21470us) write_op.cc:312] APPLY: finished
0709 12:24:22.946012 (+ 16253us) log.cc:844] Serialized 23 byte log entry
0709 12:24:22.977854 (+ 31842us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:22.979542 (+  1688us) write_op.cc:454] Released schema lock
0709 12:24:22.982975 (+  3433us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.037147 (+ 54172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.038976 (+  1829us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":88919,"apply.run_cpu_time_us":2202,"apply.run_wall_time_us":115453,"mutex_wait_us":184612,"num_ops":1,"prepare.queue_time_us":271633,"prepare.run_cpu_time_us":46200,"prepare.run_wall_time_us":701861,"raft.queue_time_us":490725,"raft.run_cpu_time_us":50982,"raft.run_wall_time_us":171306,"replication_time_us":1069657,"spinlock_wait_cycles":4906368,"thread_start_us":594832,"threads_started":4,"wal-append.queue_time_us":467455}]]}
I20260709 12:24:23.229893 14410 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:23.258685 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53834.2us
I20260709 12:24:23.224263 14390 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.263391 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.264585 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.265070 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.265877 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.260720 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.267379 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.267901 14449 raft_consensus.cc:1081] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:24:23.268940 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.269794 14459 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.270548 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.258152 14378 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.270560 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.274719 14378 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:23.272187 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.275662 14378 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.237636 14432 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.271351 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:23.277937 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 237840us
I20260709 12:24:23.213219 14418 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.281032 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.257853 14411 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.287585 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.288543 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.213997 14440 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.276614 14378 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.272354 14426 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.255916 14447 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.273249 14390 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.294209 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.261619 14410 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:23.274748 14399 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.298972 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.255429 14439 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.289191 14432 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.258358 14327 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.289714 14398 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.304788 12597 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.310461 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:23.307633 12674 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.295629 14365 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.279270 14392 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.318620 12631 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:23.299623 14306 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.321441 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.325904 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.328510 12629 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.333156 12625 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:23.334581 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.336774 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.334663 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.316745 14429 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.345827 12631 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.348567 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.321072 14399 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.352173 14464 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:23.352010 14462 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:24:23.352734 14365 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.325907 14419 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.353302 14418 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.369978 14457 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.372044 14440 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.369495 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.383327 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.374814 14439 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.381145 14466 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.381853 12557 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.386571 12556 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.388597 12557 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.350503 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.389986 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:23.388661 12556 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:23.393769 14446 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.396653 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:23.398545 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 184262us
I20260709 12:24:23.399293 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.400214 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.408414 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.409323 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.410471 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.412127 14405 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.415875 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.417194 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.420491 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.421394 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.422818 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.423823 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.428215 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.410144 14350 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.410195 14411 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.407632 14464 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:23.455796 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.436425 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.432893 14368 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.425022 14401 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.422585 14396 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.425336 14370 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.428222 14413 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.469834 14306 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.470301 14306 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.470562 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.424779 14405 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.474783 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.428087 14447 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:23.425266 14374 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.431957 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:23.429243 14459 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:23.458302 14446 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.435333 14419 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.485672 14461 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.485867 14419 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:23.486320 14419 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.459458 14327 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.457149 14360 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.460474 14417 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.460863 14445 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.463256 14409 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:23.501096 14367 consensus_meta.cc:287] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.523s	user 0.005s	sys 0.005s
I20260709 12:24:23.501555 14367 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.502753 12627 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:23.503993 14390 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.505483 14413 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.466288 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.506631 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.507514 14421 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.434162 14432 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:24:23.509903 12628 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.510488 14432 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.510847 14432 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:23.511529 14367 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.511662 14432 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.467630 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.512312 14445 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.446779 14398 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:24:23.360716 14410 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.513609 14410 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.513747 14398 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.465142 14392 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.426427 14418 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:23.478477 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.481216 14366 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.482260 14447 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:23.523743 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 95540us
I20260709 12:24:23.512897 14432 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:23.485184 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 53299.1us
I20260709 12:24:23.520565 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:23.488144 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.475858 14365 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.493692 14391 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:24:23.498485 14352 consensus_meta.cc:287] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.522s	user 0.012s	sys 0.000s
I20260709 12:24:23.585275 14352 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.585753 14392 consensus_queue.cc:1059] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:23.585987 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.586805 14392 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:23.506584 14464 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.509218 12704 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.470412 14427 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.595997 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.516336 13201 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.521739 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.477174 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.499876 14462 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:23.580106 14457 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:23.524941 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.514215 14398 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:23.529677 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.530207 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.522969 14447 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:23.516909 12550 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:23.517190 12597 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.583108 13232 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.530539 12559 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.584187 13235 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:24:23.584515 13226 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.523218 14445 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.592944 12633 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:23.595080 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:23.598960 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 82777.4us
I20260709 12:24:23.599354 14421 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.599484 14378 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.600437 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.601640 12554 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.605566 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.619529 14471 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.620290 13235 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:23.619699 14447 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.517616 12700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:24:23.620707 13235 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.620986 12700 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:23.621331 12700 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.621356 14447 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:23.608928 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 84061.4us
I20260709 12:24:23.612488 12625 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.613831 12626 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:23.614014 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 96869.7us
I20260709 12:24:23.587234 14392 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:23.625093 12597 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.603571 14462 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:23.626078 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.626181 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.615272 14327 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.626852 14306 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.578675 14416 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.629702 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.634563 14350 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.635263 14462 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.635501 14409 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:23.637882 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.638329 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.632695 14392 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.608167 14457 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:23.616402 14390 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.643071 13201 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.632030 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.648167 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.649035 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.650538 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.652247 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.656587 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.657590 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.659276 14398 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.659991 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.660542 14306 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.661464 12699 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.650537 14418 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:23.663546 14418 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.663733 14327 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.664578 14327 consensus_queue.cc:1059] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:23.665735 14327 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.666085 14327 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:23.666774 14416 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.667035 14327 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.666730 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.651593 12700 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.671885 12522 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.673465 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.651837 14350 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.648597 14352 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.676541 13230 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:23.678382 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.668684 14327 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.681764 13229 raft_consensus.cc:1240] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.682355 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.683627 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.683719 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.688232 12700 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.652797 14411 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.692168 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.689183 12522 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.693356 12597 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.692199 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.695148 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.693360 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.645470 14419 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.699534 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.700541 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.700034 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.679875 14422 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.704690 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.686481 14445 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.707221 13229 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.699687 14421 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.707616 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.704671 14370 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:24:23.691152 14392 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:23.717159 14448 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.712926 14468 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.713281 14413 consensus_queue.cc:1059] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:23.716969 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.697103 14426 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.712023 14455 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.701202 14365 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.727911 12626 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.740510 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.731720 14419 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.732167 14469 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:23.733839 14400 consensus_meta.cc:287] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.007s
I20260709 12:24:23.719128 14417 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.740712 12626 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:23.717031 14470 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:24:23.746052 12631 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:23.746289 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 89630us
I20260709 12:24:23.760946 13229 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:23.765875 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.720624 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:23.767621 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:23.777009 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 71527.7us
I20260709 12:24:23.752066 14368 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260709 12:24:23.783932 14368 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.784435 14368 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:23.786164 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:23.784443 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:23.798171 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.802630 13233 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:23.751156 14418 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:23.806888 13232 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.807125 13201 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.807447 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:23.747521 14404 raft_consensus.cc:3055] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.811203 14478 ts_tablet_manager.cc:933] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.816031 14427 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.816133 14457 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.818856 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.820847 14386 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:23.780112 14439 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.808276 14306 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.812676 14404 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:23.823969 14418 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.824671 14404 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.826159 14404 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.793500 13235 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.828806 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:23.831238 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 121857us
I20260709 12:24:23.751405 14396 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.063s
I20260709 12:24:23.834443 12557 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:23.812728 14352 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.836261 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.769042 14401 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.063s
I20260709 12:24:23.767746 14400 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.814054 14413 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.828001 14468 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:23.832034 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 54172.4us
I20260709 12:24:23.837268 13234 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:23.817317 14457 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:23.843674 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.847913 13235 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:23.849738 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.850451 12634 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:23.514601 14423 consensus_queue.cc:1175] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a2a8d71f644447218c1afc3e5f7716cd" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:24:23.845080 14360 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 12:24:23.854676 14439 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.841728 14366 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.889875 12634 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:23.855871 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.808447 14368 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.833868 14370 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:23.858995 14405 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.844672 14462 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:23.868587 14400 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:23.869091 12707 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.893584 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.885133 12626 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.887789 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:23.894840 12557 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.891161 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:23.835634 14469 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:24:23.895090 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.896605 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.895143 12557 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:23.900264 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.900590 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:23.928598 14459 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:23.937158 12626 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.939493 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:23.942523 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 66054.9us
I20260709 12:24:23.938140 12557 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.944123 12557 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.931116 14367 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.930953 14468 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:23.947238 12556 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:23.930369 14421 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.928718 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.951943 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:23.928491 14452 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:23.949301 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:23.940466 14354 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.948390 14370 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:23.939738 14386 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.944278 14368 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.944093 14444 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:23.965319 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:23.961041 14452 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.955751 14468 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:23.978070 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:23.963155 14426 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.985611 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.990175 12553 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:23.993036 12704 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:23.998018 14462 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:23.999029 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:23.987419 14455 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:24:24.016499 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.006444 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:24.007180 14458 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:24:23.976013 14452 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:23.963253 14419 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:24.018337 12626 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:23.977731 14459 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 12:24:23.961791 14449 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:24:23.959579 14370 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:23.996122 14361 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:24:24.035934 12453 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 313) took 1364 ms. Trace:
I20260709 12:24:24.037214 13229 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:24.026448 14416 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.008s
I20260709 12:24:24.050043 14448 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.050494 14448 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.051304 14448 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.052700 14448 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.036288 12453 rpcz_store.cc:276] 0709 12:24:22.671158 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.675991 (+  4833us) service_pool.cc:224] Handling call
0709 12:24:22.951112 (+275121us) spinlock_profiling.cc:243] Waited 5.92 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a55090 00007f0e94af3f3a 00007f0e9a8a9e9c 00007f0e9a9a804e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc 00007f0e98e68392 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:24.035868 (+1084756us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:23.379965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:23.438659 (+ 58694us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:23.438694 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:23.438711 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:23.467121 (+ 28410us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:23.472478 (+  5357us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:23.477893 (+  5415us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:23.490874 (+ 12981us) tablet.cc:701] Row locks acquired
0709 12:24:23.492079 (+  1205us) write_op.cc:260] PREPARE: finished
0709 12:24:23.503641 (+ 11562us) write_op.cc:270] Start()
0709 12:24:23.503753 (+   112us) write_op.cc:276] Timestamp: P: 1783599863503597 usec, L: 0
0709 12:24:23.503772 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:24:23.504399 (+   627us) log.cc:844] Serialized 535 byte log entry
0709 12:24:23.720805 (+216406us) op_driver.cc:464] REPLICATION: finished
0709 12:24:23.954052 (+233247us) write_op.cc:301] APPLY: starting
0709 12:24:23.954145 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:23.954250 (+   105us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:23.954390 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:23.977198 (+ 22808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:23.992961 (+ 15763us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:23.993042 (+    81us) write_op.cc:312] APPLY: finished
0709 12:24:23.993263 (+   221us) log.cc:844] Serialized 23 byte log entry
0709 12:24:23.993463 (+   200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.993539 (+    76us) write_op.cc:454] Released schema lock
0709 12:24:23.993576 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.993931 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.993964 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":108199,"reported_tablets":1,"spinlock_wait_cycles":13620608,"child_traces":[["op",{"apply.queue_time_us":219284,"apply.run_cpu_time_us":2277,"apply.run_wall_time_us":39881,"num_ops":1,"prepare.queue_time_us":131060,"prepare.run_cpu_time_us":3257,"prepare.run_wall_time_us":144429,"replication_time_us":196206,"thread_start_us":286683,"threads_started":2}]]}
W20260709 12:24:24.062819 14479 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260709 12:24:24.066721 14399 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:24.067109 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:24.068558 14399 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:24.068665 14416 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.068939 14399 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.075698 12557 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:24.061802 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:24.040827 14478 tablet_copy_client.cc:323] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:24:24.079182 13226 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:24.080659 14399 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.081779 14480 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.086431 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:24.087299 12634 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.035550 14468 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.089704 12634 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.090536 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:24.091090 12632 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:24.091620 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:24.092463 12628 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:24.093240 14398 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.104490 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:24.105327 12626 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:24.091128 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:24.090207 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:24.097905 14480 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:24.122323 12633 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:24.122817 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.061972 14391 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:33228 (request call id 14) took 3006 ms. Trace:
I20260709 12:24:24.118140 14399 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.121600 14464 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:24.129020 14449 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.122651 14480 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.133577 14374 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.133982 14374 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.134055 14464 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.134434 14464 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.099599 14447 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:24.122176 12626 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.134860 14374 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.135136 14464 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.136225 14464 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.093901 14417 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.139511 14417 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.140344 14417 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.141693 14417 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.141906 14421 consensus_queue.cc:1059] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:24.143052 14365 raft_consensus.cc:3055] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.143518 14365 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.144287 14365 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.145314 14457 consensus_queue.cc:1059] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.146344 14361 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.146517 14429 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.146776 14361 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.146950 14429 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.124316 12706 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:24.100294 12455 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.151782 12626 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:24.156140 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:24.157868 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:24.158066 14386 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.162815 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:24.125609 14391 rpcz_store.cc:276] 0709 12:24:21.053537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:21.053747 (+   210us) service_pool.cc:224] Handling call
0709 12:24:21.155643 (+101896us) log.cc:844] Serialized 492 byte log entry
0709 12:24:21.703258 (+547615us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b4c00548a40. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e92db7a20 00007f0e92dc8a29 00007f0e92dc913f 00007f0e92d8d2ab 00007f0e92dbaf3c 00007f0e92dbb3fe 00007f0e9304850b 00007f0e94a47381 00007f0e94a4526b 00007f0e94a4bd53 00007f0e94a4bcd9
0709 12:24:24.059691 (+2356433us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62812,"raft.queue_time_us":681433,"raft.run_cpu_time_us":4679,"raft.run_wall_time_us":330487,"spinlock_wait_cycles":413817216,"thread_start_us":654433,"threads_started":3,"wal-append.queue_time_us":131054,"wal-append.run_cpu_time_us":2145,"wal-append.run_wall_time_us":1053853}
I20260709 12:24:24.168606 14432 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.169570 14426 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.136240 14374 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.147733 14365 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.180397 12633 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.172629 14457 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.177321 14427 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.213581 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.217705 13227 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.224997 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:24.226229 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:24.236948 12631 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:24.205004 14471 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.213593 14405 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:24.275512 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 89277.9us
I20260709 12:24:24.233556 14395 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:24.236763 14327 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:24.279062 13233 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.240007 14386 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:24.240924 14471 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.190219 14361 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.294575 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:24:24.295281 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 54ae52ca0f5e4e988dcd22a9651ec1bd from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-54ae52ca0f5e4e988dcd22a9651ec1bd
I20260709 12:24:24.285842 14386 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:24.297945 14386 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.245949 14405 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.302558 14405 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:24.310171 14405 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.315877 14445 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.316341 14445 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.318058 14413 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:24.242184 14429 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.319940 14429 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.325227 13228 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:24.313010 14401 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:24.326560 14401 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.327402 14401 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.328754 14401 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.286327 14395 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.336632 14395 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:24.311623 14327 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.337908 14327 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.339406 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:24.340129 12557 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 2: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:24.341602 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:24.342460 12626 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 2: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:24.357131 13201 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:24.358398 14392 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.364744 14462 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.391337 14420 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:24.391821 14420 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.392704 14420 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.393998 14420 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.402259 12556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4719532adf46473495ced717a908a078"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:24.402951 12556 raft_consensus.cc:606] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
W20260709 12:24:24.409601 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.415132 14386 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.417258 14425 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.417769 14425 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.418828 14480 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.419981 14480 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.420172 14386 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:24.423791 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:24.434088 12556 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:24.387847 14462 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.430387 14455 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.424253 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:24.434612 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:24.436786 12703 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.439450 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:24.441201 12631 raft_consensus.cc:606] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:24.443472 14456 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.444324 12550 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:24.448990 14360 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.449534 14360 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.453500 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:24.436267 14417 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:24.456702 13226 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:24.459856 14417 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.457168 14418 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.457652 14422 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:24.457988 14445 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.445703 14429 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:24.450379 14360 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.475535 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:24.441010 14455 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.486274 14455 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.487725 14455 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.460969 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:24.473949 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:24:24.452334 14469 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.026s
I20260709 12:24:24.479686 12628 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:24.480523 14445 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.480983 12555 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:24:24.481768 14471 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.490978 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:24.498505 14421 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.498699 14471 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.499078 14421 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.499218 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.469547 13226 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:24.497957 12718 tablet_copy_source_session.cc:215] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:24.491602 12703 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:24.508225 14421 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.508402 14462 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.509775 14462 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.510826 14417 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:24.513749 14427 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.514127 14427 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.504242 14448 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.514920 14448 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.515170 14469 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.515769 14448 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.488972 14422 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.521601 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:24.521067 12453 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.528558 13227 raft_consensus.cc:2393] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:24.525117 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:24.528580 12456 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 3 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.531518 14425 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.530750 14361 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.532934 14425 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.505074 14392 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:24.523000 12453 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index -1 to 2, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 1 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.541944 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:24.549783 14449 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:24.567934 12597 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d9812250f15d4075a3c8831ca5f3ed41. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:24.581509 14478 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:24.573714 14417 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:24.592024 12703 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:24.561296 14422 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.600621 12555 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:24.558285 14427 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.603397 13227 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:24.589980 14327 raft_consensus.cc:993] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:24.607668 14350 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:24.607750 14327 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.609592 14327 raft_consensus.cc:1081] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:24.610464 12633 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:24.591266 14417 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.611428 14417 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.612672 14417 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.619995 12553 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:24.620882 12553 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.619114 14386 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.621312 12553 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.622992 14405 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
W20260709 12:24:24.656047 14498 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:24:24.650012 12553 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.670502 12553 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:24.672216 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:24.672878 12706 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.665345 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:24.674234 12633 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.674609 12633 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:24.678218 14449 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:24.678478 12633 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.680050 12633 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.690891 14449 raft_consensus.cc:993] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:24.691538 14449 raft_consensus.cc:1081] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:24:24.693233 12626 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:24.693280 12707 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4719532adf46473495ced717a908a078"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45144
I20260709 12:24:24.694342 12553 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:24.694553 12707 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.695006 12707 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.696062 14415 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:24.702762 12633 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:24.704190 12522 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:24.705142 14469 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.706022 14468 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:24:24.728156 14427 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.732236 12455 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 4, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.735368 12455 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 3, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.713058 14469 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.756538 12706 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
W20260709 12:24:24.771049 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:24.780422 14469 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:24.770092 12707 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.821301 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:24.821926 12553 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.822206 12553 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:24.822948 12553 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.824009 12553 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.828096 12707 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:24.829088 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:24.829689 13227 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.845182 14392 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:24.845831 14392 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.848349 14392 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:24.849437 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:24.850163 12707 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:24.851368 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:24.852275 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:24.855906 14478 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50990 (request call id 529) took 1126 ms. Trace:
I20260709 12:24:24.856338 14478 rpcz_store.cc:276] 0709 12:24:23.729115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.733492 (+  4377us) service_pool.cc:224] Handling call
0709 12:24:23.811666 (+ 78174us) ts_tablet_manager.cc:934] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
0709 12:24:24.554776 (+743110us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:24.629204 (+ 74428us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:24.629317 (+   113us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:24.841422 (+212105us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:24.855458 (+ 14036us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:24.855774 (+   316us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:24.855836 (+    62us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":16073,"tablet-copy.queue_time_us":76809,"thread_start_us":211286,"threads_started":2}
I20260709 12:24:24.868364 14478 tablet_copy_client.cc:806] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:24.840034 14427 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:24.867501 14392 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.869506 14478 tablet_copy_client.cc:670] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:24.872356 13227 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:24.873364 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:24.869762 14427 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.875799 14413 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:24.876267 14413 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:24.876412 12550 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:24.879781 14478 tablet_copy_client.cc:538] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:24.879338 14464 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:24.884649 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:24.869828 14392 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.885318 14427 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:24.885814 14392 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.886034 12553 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:24.886073 12556 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:24.887243 12700 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.887075 12706 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:24.891552 14360 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:24.893874 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:24.894609 12703 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:24.895119 14478 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:24.877197 14413 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:24.906545 12700 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:24.915074 13227 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:24.911053 12453 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 3, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.918025 12550 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:24:24.925297 14445 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:24.915251 14386 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:24:24.932119 13226 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:24.946170 14427 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:24:24.950608 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet f768a2094f5744cfa0dec019647ccb13: Illegal state: Replica c6795b140b3247279a2231c6b9360d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:24:24.956418 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet 28c65936613f4ee89e3dc89d06a91776: Illegal state: Replica c6795b140b3247279a2231c6b9360d24 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 2 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:24:24.975831 12455 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.983125 12455 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 2, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.987442 12455 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 3, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.981973 14427 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.003894 14427 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.006090 14427 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.008491 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.009238 12631 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:25.008540 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.020145 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:25.030696 14427 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.033782 14427 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.034256 14427 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.007658 14392 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.039666 13228 raft_consensus.cc:2368] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:25.041531 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:25.042838 12556 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.043505 12555 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:25.043206 13228 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:25.045388 12522 leader_election.cc:400] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:25.045714 12522 leader_election.cc:403] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.048590 14386 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:25.049975 14386 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:25.050298 12631 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:25.053049 12556 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:25.053143 14469 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:25.053637 14417 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:25.054281 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:25.055155 14423 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.055650 14423 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:25.056476 14423 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.059559 14392 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.059190 12453 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 3, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.066493 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:25.067242 12706 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.098556 12706 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:25.096342 14365 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.099745 14365 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.105291 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.106112 12703 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:25.110286 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.082196 14447 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.107111 14365 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.112342 13226 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:25.112782 14386 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.119939 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.120627 12550 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:25.118322 14386 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.119535 14464 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:24:25.118947 14447 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.138207 14386 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.143285 12453 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 2, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.184144 14447 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.186421 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.187232 12706 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:25.189853 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.190459 12550 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:25.197058 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:25.218856 12628 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.201968 14395 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.219077 14392 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.220027 14404 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.241134 14404 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.226809 14395 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.243351 14404 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.243454 14395 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.204607 14413 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.224646 14469 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:25.238706 14405 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.244529 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.247154 12706 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:25.234680 14392 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.251112 14392 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.253468 14405 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.213320 14427 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.255769 14405 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.256546 14427 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.244089 14413 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.260027 14413 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.262023 14516 ts_tablet_manager.cc:933] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.264418 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:25.261725 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.278102 12555 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:25.250046 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.287222 13228 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.265153 12628 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.301904 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.302798 12553 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:25.304046 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.305011 12556 raft_consensus.cc:2368] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:25.308516 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:25.309224 12706 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.311201 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.312199 12626 raft_consensus.cc:2393] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:25.313236 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.314175 12633 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:25.315161 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.316521 14464 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.317198 14464 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.317771 14447 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.318455 14447 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.320755 14447 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.320900 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:25.322187 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.322384 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.322762 12556 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:25.323786 13201 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:25.323846 13226 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:25.294654 14415 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.326155 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.326155 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:25.327683 12454 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.298938 14516 tablet_copy_client.cc:323] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:24:25.335827 12706 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:25.336347 12674 leader_election.cc:400] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:25.336660 12674 leader_election.cc:403] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.337612 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.341924 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.324627 14447 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.338797 14469 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.295317 14417 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:24:25.330612 14415 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.396664 12628 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:25.402992 14415 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.409602 14395 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.410193 14395 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.412346 14395 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.413842 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.393549 14468 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.335737 14365 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.415547 14468 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.416074 14365 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.416512 14365 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.358116 14350 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:25.416083 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.417974 12703 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:25.419520 12628 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:25.330767 14464 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.335639 14413 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:25.432772 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.433430 12557 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 1.
I20260709 12:24:25.433995 14520 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.388392 14447 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.370352 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.434043 14404 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.438340 13201 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:25.343986 14386 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.456239 13199 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:25.425482 14469 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:25.431185 14413 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.371827 14392 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.443032 14447 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.450538 14524 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.475206 12703 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:25.434710 14417 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:24:25.457437 14456 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:25.456924 12555 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:25.485037 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.471016 14413 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.483273 14524 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.486965 14528 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:25.487368 14528 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.487710 14528 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.486068 12703 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:25.492589 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.493194 12557 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:25.449509 14520 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.495885 14520 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.496924 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:25.497841 14520 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.498297 14520 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.501427 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.502902 14386 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.503285 14520 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.453291 14404 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.505012 12600 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:25.505971 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:25.510501 12557 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.477654 14423 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.514380 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:25.516152 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 77860.1us
I20260709 12:24:25.516306 12706 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.484006 14468 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.525388 12557 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:25.519280 14423 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.532254 14423 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.534106 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet d9812250f15d4075a3c8831ca5f3ed41 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:24:25.534915 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet d9812250f15d4075a3c8831ca5f3ed41 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-d9812250f15d4075a3c8831ca5f3ed41
I20260709 12:24:25.542657 12706 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:25.506362 14456 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.547331 14456 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.517701 14386 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:25.557487 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.558176 12553 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:25.558022 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.558987 12557 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:25.548861 14365 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.537235 14520 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.565325 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.555706 14456 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.526973 14469 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.507630 14449 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:24:25.566174 14456 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.573041 14456 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.560729 14405 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.573792 14405 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:25.576138 14405 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.558792 14386 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.577445 14386 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.580081 14445 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.580654 14445 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:25.580897 12555 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.581517 14445 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.582116 14350 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.582638 14350 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.584599 14350 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.588567 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:25.588779 14462 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.589236 14462 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.590284 13226 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:25.591202 14462 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.587742 14365 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.595207 12644 tablet_copy_source_session.cc:215] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:25.595973 14365 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.560336 14524 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.600530 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.602208 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.603786 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:25.619179 12706 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:25.619582 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:25.621760 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.642547 12553 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:25.644057 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:25.651852 14537 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:25.652311 14524 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:25.652597 14537 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:25.653234 12553 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:25.652940 14524 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:25.653888 14537 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.655823 14524 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.658990 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.659864 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.660436 12557 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:25.662160 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.662884 12550 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 2: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:25.663028 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.663547 12631 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:25.664968 14519 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:25.665764 14392 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.666364 14519 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:25.666461 14392 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:25.666935 14519 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.669117 14519 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.670832 14417 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:25.629841 14478 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:25.677244 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.684026 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:25.687371 12631 raft_consensus.cc:2368] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:25.688107 13228 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:25.688861 12671 leader_election.cc:400] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:25.689283 12671 leader_election.cc:403] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:25.692253 12600 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:25.567060 14520 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:25.694787 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 175227us
I20260709 12:24:25.676061 14425 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:25.646689 14529 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.617179 14365 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.681056 14525 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:25.702476 14500 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:25.716993 14386 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.711479 14350 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.719234 14386 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.710242 14518 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.721872 14518 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.723497 14415 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.723963 14518 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.705447 14425 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.724694 14425 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:25.706610 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52205.6us
I20260709 12:24:25.709263 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:25.730854 13229 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.684902 14449 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.734290 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:25.762008 12553 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.739254 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.703915 14532 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:25.768512 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66718.1us
I20260709 12:24:25.769033 12631 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:25.728821 14423 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.689807 14417 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.772109 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.783959 12556 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:25.785131 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.785847 12550 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:25.780953 12553 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:24:25.782326 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 172441us
I20260709 12:24:25.802016 14404 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.803545 14520 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.770390 14532 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:25.809537 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.810138 12628 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:25.810761 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:25.811481 12631 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:25.768553 14449 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.814713 13229 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:25.812924 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:25.730357 14525 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.805814 14532 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.822580 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:25.823190 12553 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:25.827872 14360 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.828384 14360 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.830643 14360 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.837674 14423 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.841147 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:25.841522 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:25.841150 12703 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:25.842259 12707 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:25.850044 12707 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:25.856012 14366 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:25.856621 14366 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.857555 12550 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:25.859246 14366 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.860780 14366 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.861259 14366 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.779543 14415 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.873179 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:25.811949 14519 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.886998 12550 raft_consensus.cc:606] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:25.806165 14535 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.878299 12553 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:25.883445 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:25.713514 14528 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.711614 14529 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.887516 12550 raft_consensus.cc:614] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:25.887898 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.891705 12556 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:25.889612 12707 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.904842 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.907223 12556 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:25.907732 12707 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:25.915424 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.916460 12557 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:25.917631 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.917889 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.918437 12559 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:25.823264 14520 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:25.823882 14524 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.820312 14525 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.880826 14427 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:25.944568 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:25.945218 12551 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:25.884781 14366 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.921780 14535 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.955363 14417 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.922518 14464 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:25.936017 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:25.959342 12556 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:25.940341 14392 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:25.990239 14392 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.992478 14392 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.995450 14529 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.998802 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:26.000931 14447 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.000s
I20260709 12:24:25.962738 14405 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.004362 14405 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.004773 14405 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.938683 14413 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.007755 14413 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.939131 14520 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.958379 14545 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:26.009855 14520 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:26.010221 14545 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.981074 14432 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.011766 14432 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.012521 14545 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:25.981341 14528 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.982342 14537 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:26.015488 14533 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:26.015398 14537 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.016158 14533 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:25.956673 14427 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.982738 14425 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.018107 12558 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:26.020077 14427 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.956508 14535 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.984190 14516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9812250f15d4075a3c8831ca5f3ed41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:25.945950 14524 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:25.985211 14365 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:25.986320 14464 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:25.987528 14478 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:26.044689 14478 tablet_bootstrap.cc:492] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:26.045521 14478 ts_tablet_manager.cc:1403] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 1.151s	user 0.054s	sys 0.047s
I20260709 12:24:25.988658 14449 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:25.898968 14519 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.020260 12456 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 4, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:26.024972 12556 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:26.013974 14432 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.057904 14519 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:26.058706 12700 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:26.058555 14532 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.001394 14447 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.062547 13227 raft_consensus.cc:2368] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:26.063657 14447 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.038954 14464 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.042676 14350 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:26.042987 14524 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.035985 14537 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.038638 12555 raft_consensus.cc:2368] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3.
I20260709 12:24:26.072999 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.073557 14404 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:26.074384 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:26.074679 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.075044 12550 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.075197 12707 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:26.076560 14425 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.076707 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:26.077764 12600 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.078600 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.079169 12703 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:26.079211 14360 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:26.073657 12700 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:26.079814 14360 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:26.074404 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.080889 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.074419 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:26.081230 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:26.081488 12702 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.081651 12558 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:26.082070 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:26.082190 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.082840 12707 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:26.082963 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:26.083176 12556 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:26.085175 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:26.080700 14360 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.087137 14449 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.087529 14449 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.087862 14449 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.085161 14404 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.085053 14427 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.089668 12706 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:26.089936 14427 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.090359 14427 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.091720 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:26.095216 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.096045 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.096776 12629 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 2: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:26.097350 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.098083 12628 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:26.061116 14532 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.101207 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:26.099983 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.104377 12600 leader_election.cc:400] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3.
I20260709 12:24:26.104651 12600 leader_election.cc:403] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:26.090932 14425 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.106844 14425 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.107141 12600 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.108034 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.108173 14548 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.109481 14456 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.109903 14456 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.110263 14456 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.111485 12550 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:26.120049 12600 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.089674 14462 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.110376 14405 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.021330 14533 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:26.105265 14535 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.129769 12702 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:26.122834 14445 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.107187 14425 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.251699 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:26.111506 14469 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.271925 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.273905 12702 raft_consensus.cc:2368] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3.
I20260709 12:24:26.274894 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.275688 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:26.124217 14552 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:26.126922 14462 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:26.127053 14404 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:26.216995 12555 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:26.248354 14540 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.218073 14524 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:26.295133 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.295830 12707 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:26.250946 14535 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.265856 14445 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.267221 14469 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.283245 14552 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:26.284687 14462 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.152513 14526 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:26.305667 14535 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.306668 14445 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.307650 14469 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.340826 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.341128 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.341655 12633 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:26.341955 12632 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:26.298610 14524 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.314957 14552 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.345710 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:26.369694 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.336566 14526 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:26.378151 14478 raft_consensus.cc:359] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:26.386215 13198 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:26.365505 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 482589us
I20260709 12:24:26.407444 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.408207 12702 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:26.403110 14478 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:26.411224 14478 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:26.413338 14478 ts_tablet_manager.cc:1434] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.367s	user 0.006s	sys 0.002s
I20260709 12:24:26.422652 14526 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.425485 14395 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.426005 14395 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:26.426457 14395 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.429787 12707 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:26.430052 14539 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.431358 12702 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:26.321398 14540 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.404948 14531 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:26.457058 14405 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:26.459555 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.460158 12707 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:26.460500 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.461082 12702 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:26.461903 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.462476 12701 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:24:26.462713 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.463279 12700 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:26.465277 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.465937 12699 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:26.442806 14531 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:26.443964 14539 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:26.479754 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.480916 12704 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:26.439150 14449 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.486266 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.486871 12699 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
W20260709 12:24:26.491323 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.008s	sys 0.061s
W20260709 12:24:26.491673 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.008s	sys 0.061s
I20260709 12:24:26.496285 12671 leader_election.cc:400] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:26.496609 12671 leader_election.cc:403] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:26.497061 13201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.050s	sys 0.075s
I20260709 12:24:26.480379 14531 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:26.497613 13201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.050s	sys 0.075s
I20260709 12:24:26.499698 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:26.502914 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:26.500312 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.503717 12703 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:26.503544 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:26.510118 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.510855 12703 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:26.507421 13201 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:24:26.513489 12553 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.023s	sys 0.047s
W20260709 12:24:26.534144 12553 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.023s	sys 0.048s
I20260709 12:24:26.505927 12455 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 3 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:26.535152 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:26.535925 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:26.517935 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:26.532810 12454 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.509s	user 0.026s	sys 0.047s
W20260709 12:24:26.541450 12454 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.518s	user 0.026s	sys 0.048s
W20260709 12:24:26.543203 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.017s	sys 0.049s
I20260709 12:24:26.563933 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:26.565536 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.018s	sys 0.049s
I20260709 12:24:26.575834 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.501564 14404 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.524040 14554 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.174s
I20260709 12:24:26.868201 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:26.858392 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 340551us
I20260709 12:24:26.871683 12559 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:26.828313 12597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.021s
W20260709 12:24:26.872506 12597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.000s	sys 0.022s
I20260709 12:24:26.870357 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:26.716060 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 129257us
I20260709 12:24:26.519784 14528 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:26.657828 12598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.011s	sys 0.007s
W20260709 12:24:26.890697 12598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.011s	sys 0.017s
I20260709 12:24:26.849267 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.893316 12707 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.718401 14415 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.176s
W20260709 12:24:26.657619 14464 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.008s
I20260709 12:24:26.896803 14559 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:26.897145 14464 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.012s	sys 0.021s
I20260709 12:24:26.897531 14559 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.897876 14464 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:26.875034 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:26.872360 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:26.903851 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.904714 12699 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.876762 12556 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:26.880131 14518 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:26.882633 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.913318 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.914251 12700 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:26.882859 12626 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:26.883977 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:26.916064 13228 raft_consensus.cc:2393] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 2: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:26.887233 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:26.556707 14537 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.920513 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:26.921391 12701 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 1.
I20260709 12:24:26.586208 14533 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:26.922001 12559 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:26.921365 12707 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:26.615566 14524 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.688772 14432 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:26.761806 14545 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:26.874334 14449 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:26.935178 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:26.938725 13234 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:26.571152 14539 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.925624 14518 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:26.997936 14405 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:26.998925 14469 consensus_meta.cc:287] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.651s	user 0.018s	sys 0.008s
I20260709 12:24:26.933037 14533 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:26.941116 14545 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.035255 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:26.992738 14415 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.025137 12699 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:26.956493 14432 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:27.039170 14552 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.634s	user 0.010s	sys 0.000s
I20260709 12:24:27.066175 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:27.378235 14552 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.379465 12626 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.380391 12628 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:27.148459 14462 consensus_meta.cc:287] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.818s	user 0.004s	sys 0.008s
I20260709 12:24:27.267655 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:27.381692 14552 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:27.113942 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 226232us
W20260709 12:24:27.272843 14425 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.991s	user 0.009s	sys 0.003s
I20260709 12:24:27.079056 14528 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:27.394153 14425 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.383399 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.383977 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1608) took 1555 ms. Trace:
I20260709 12:24:27.373214 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:27.398787 12706 raft_consensus.cc:2368] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:27.376358 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:27.170935 12522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.754s	user 0.017s	sys 0.022s
W20260709 12:24:27.244270 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 344480us
W20260709 12:24:27.401356 12522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.985s	user 0.026s	sys 0.024s
I20260709 12:24:27.273272 14422 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.396169 12631 rpcz_store.cc:276] 0709 12:24:25.828362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.828504 (+   142us) service_pool.cc:224] Handling call
0709 12:24:25.828808 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.199364 (+370556us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.199413 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.200002 (+   589us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.539694 (+339692us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:26.539748 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.539854 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.000108 (+460254us) raft_consensus.cc:1685] finished
0709 12:24:27.000130 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.383889 (+383759us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8323,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":145,"thread_start_us":709376,"threads_started":2,"wal-append.queue_time_us":740219}
W20260709 12:24:27.302525 12703 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.001s
I20260709 12:24:27.426566 12703 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
W20260709 12:24:27.095623 14395 consensus_meta.cc:287] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.669s	user 0.009s	sys 0.001s
I20260709 12:24:27.230310 14549 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.424737 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 430) took 1475 ms. Trace:
W20260709 12:24:27.099570 14456 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.989s	user 0.006s	sys 0.007s
W20260709 12:24:27.365214 14445 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.020s	user 0.022s	sys 0.008s
I20260709 12:24:27.382822 14405 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:27.422901 14569 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:27.038036 14546 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 12:24:27.109040 14427 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.004s	user 0.021s	sys 0.006s
I20260709 12:24:27.430588 14582 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.445191 14427 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.445662 14582 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.447430 14427 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:27.042985 14548 consensus_meta.cc:287] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.934s	user 0.014s	sys 0.014s
I20260709 12:24:27.448482 14548 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3.
I20260709 12:24:27.373445 14468 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.449235 14468 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:27.189361 14526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.006s	sys 0.035s
W20260709 12:24:27.450112 14526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.012s	sys 0.035s
I20260709 12:24:27.424302 14462 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.023614 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:27.428346 14558 raft_consensus.cc:2764] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:27.451031 13231 raft_consensus.cc:2368] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:27.451493 14579 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:27.451980 14579 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.452308 14462 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.453032 14462 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.438086 14432 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.438465 14456 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.349156 14554 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.439407 14405 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:27.441530 14445 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.444435 14574 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.448526 14447 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.406087 14415 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.038192 14559 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:27.454916 14535 consensus_meta.cc:287] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.124s	user 0.022s	sys 0.007s
I20260709 12:24:27.448033 14427 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.434252 14395 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.429247 12626 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:27.459811 12627 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:27.453577 12558 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.431061 12553 rpcz_store.cc:276] 0709 12:24:25.909883 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.909995 (+   112us) service_pool.cc:224] Handling call
0709 12:24:25.910306 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:26.534595 (+624289us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:26.534640 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:26.667895 (+133255us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.931070 (+263175us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:26.931142 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.931256 (+   114us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:27.041479 (+110223us) raft_consensus.cc:1685] finished
0709 12:24:27.041504 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:27.385090 (+343586us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70189,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":149,"thread_start_us":846431,"threads_started":2,"wal-append.queue_time_us":293522}
I20260709 12:24:27.406055 14556 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.103936 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-54ae52ca0f5e4e988dcd22a9651ec1bd received from {username='slave'} at 127.0.0.1:33230
W20260709 12:24:27.465492 12674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.014s	sys 0.032s
I20260709 12:24:27.478302 12701 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:27.480685 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:27.489861 12674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.015s	sys 0.032s
I20260709 12:24:27.467813 14560 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:27.477144 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.484526 12633 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:27.484099 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 91250us
W20260709 12:24:27.462054 14537 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.004s	sys 0.021s
W20260709 12:24:27.490432 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 618123us
I20260709 12:24:27.424191 14469 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.508087 12632 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:27.430972 14422 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.468266 14557 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:27.637691 14557 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.638267 14415 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.490626 14535 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.640808 12550 raft_consensus.cc:2393] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:27.506875 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-54ae52ca0f5e4e988dcd22a9651ec1bd on tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with peer 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:27.635068 12598 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.598s (SENT) [suppressed 8 similar messages]
I20260709 12:24:27.473541 14462 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:27.578387 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 171332us
I20260709 12:24:27.518595 13229 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
W20260709 12:24:27.518136 14547 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.028s	sys 0.036s
I20260709 12:24:27.464298 14549 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.617781 14533 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:27.518520 14537 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.005s	sys 0.021s
W20260709 12:24:27.620162 14404 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.738s	user 0.000s	sys 0.008s
I20260709 12:24:27.465687 14528 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.477768 14569 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.482811 14574 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.621033 14422 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.621256 14445 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.622334 14590 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:27.625836 14531 consensus_meta.cc:287] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.103s	user 0.021s	sys 0.008s
I20260709 12:24:27.475921 14554 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:27.579388 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 203111us
W20260709 12:24:27.623315 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 221542us
W20260709 12:24:27.796499 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 152292us
I20260709 12:24:27.506703 14427 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.483876 14447 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.634637 12558 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:27.507690 14560 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:27.635464 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 241226us
I20260709 12:24:27.803321 13201 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:27.637081 14469 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:27.644738 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 74973.7us
I20260709 12:24:27.806473 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:27.804198 14560 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:27.808056 14567 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.766s	user 0.004s	sys 0.005s
I20260709 12:24:27.447664 14582 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:27.454402 14579 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:27.427944 14540 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.613806 14464 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.613221 14589 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.614065 14550 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.633824 14545 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.640312 14535 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.514721 14556 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:27.649346 14547 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.054s	user 0.029s	sys 0.038s
I20260709 12:24:27.637081 14395 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.657136 14518 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.665880 14404 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:27.753895 14468 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.719607 14583 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:27.739823 14599 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.771324 14574 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.767258 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:27.723198 14577 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:27.766394 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:27.754221 14456 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.755681 14554 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.670768 14588 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.650154 14557 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:27.761874 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:27.927605 13233 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:27.669286 14449 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.928893 14449 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:27.931869 14449 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.656229 14537 raft_consensus.cc:697] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:27.660841 14533 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.933307 14537 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.655349 14425 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.695298 14590 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.665772 14595 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:27.723532 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 88475.6us
I20260709 12:24:27.760506 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:27.792047 14600 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.696015 14593 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 12:24:27.790153 14571 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 12:24:27.973960 14554 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:27.974745 14554 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.977628 14554 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:27.978919 14590 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.794813 13199 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:27.708910 14531 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.832026 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:27.980453 12627 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:27.856477 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:27.831840 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.831069 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:27.832580 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:27.812958 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.856477 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.900954 14464 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:27.896243 12550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36566 (request call id 433) took 1298 ms (client timeout 1711 ms). Trace:
I20260709 12:24:27.897166 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.987385 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:27.981981 12553 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:27.982966 12633 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:24:27.899811 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 382539us
I20260709 12:24:27.902339 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:27.982944 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:27.793955 14549 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:27.904923 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:27.907137 14516 consensus_meta.cc:287] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.403s	user 0.004s	sys 0.019s
I20260709 12:24:27.857790 14596 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.897914 14469 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.913653 14462 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.828094 14564 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:27.938575 14447 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:27.900549 14589 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.926512 14577 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.915014 14599 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.925035 14518 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.828140 14580 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.085s
I20260709 12:24:27.900003 14594 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:27.899839 14603 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.904233 14578 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:27.904486 14569 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.932843 14533 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.020691 14469 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:28.021629 14605 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.114s	user 0.000s	sys 0.001s
I20260709 12:24:27.981575 13227 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:27.990761 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.004966 12702 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:27.981575 14531 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.944000 14588 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.902168 14550 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:27.925148 14583 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.014303 14516 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50978 (request call id 576) took 2866 ms. Trace:
I20260709 12:24:28.014724 14556 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.015185 14596 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:27.982452 14449 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:28.016393 14427 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.005288 14595 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.944577 14405 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.995702 14540 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.054987 14540 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.045445 14547 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.056171 14595 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:27.986999 14600 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.028416 14447 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.051420 14586 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:28.024587 14518 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.024428 14564 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.060786 14586 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.050201 14577 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.023650 14607 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:27.971400 14582 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.038357 14594 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.042886 14603 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:27.985396 12631 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:27.986605 12550 rpcz_store.cc:269] 0709 12:24:26.563357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.563578 (+   221us) service_pool.cc:224] Handling call
0709 12:24:27.861526 (+1297948us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54001d15d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:27.861740 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2473191808}
I20260709 12:24:27.997890 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:27.969296 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 208871us
W20260709 12:24:28.041801 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 51150us
I20260709 12:24:27.991119 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36566 (request call id 431) took 1455 ms. Trace:
I20260709 12:24:27.988653 12674 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:27.891217 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 585) took 1255 ms. Trace:
I20260709 12:24:27.983651 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.981380 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.056201 14405 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:27.982137 12630 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:27.990026 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.892443 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:27.982628 14404 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.067309 14582 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.132790 14404 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.118506 12555 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:28.116778 13229 rpcz_store.cc:276] 0709 12:24:26.582170 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.582321 (+   151us) service_pool.cc:224] Handling call
0709 12:24:26.616934 (+ 34613us) spinlock_profiling.cc:243] Waited 4.15 ms on lock 0x7b5800126c98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:26.870231 (+253297us) spinlock_profiling.cc:243] Waited 10.7 ms on lock 0x7b5800126c98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6e9c 00007f0e919c6a5b 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:27.829995 (+959764us) spinlock_profiling.cc:243] Waited 645 ms on lock 0x7b54006f63d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:27.830115 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1518449152}
I20260709 12:24:28.135919 14404 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:27.988065 12632 raft_consensus.cc:2368] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:28.105893 12558 rpcz_store.cc:276] 0709 12:24:26.535453 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.535608 (+   155us) service_pool.cc:224] Handling call
0709 12:24:27.990968 (+1455360us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b540035f554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:27.991063 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2108640000}
I20260709 12:24:28.100991 12553 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.126677 14600 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:28.022359 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 227899us
I20260709 12:24:28.098093 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.066093 14596 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.099160 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.149928 12626 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 1.
I20260709 12:24:28.122079 14449 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:28.100102 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 327285us
I20260709 12:24:28.066601 14599 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.117213 14558 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.117656 14556 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.142478 12555 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:24:28.108773 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 120075us
I20260709 12:24:28.121991 14469 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.119112 14447 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:28.100266 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:28.066668 14589 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.057919 14560 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.147162 14518 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.119084 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.118413 14405 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.112327 14533 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.155179 13198 leader_election.cc:400] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:28.118268 14550 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:28.161317 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 564) took 1661 ms (client timeout 1995 ms). Trace:
I20260709 12:24:28.161139 14447 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.162667 14469 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:28.163478 14569 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:28.194380 14569 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.195772 14597 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.165278 14462 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.060529 14540 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.168963 13198 leader_election.cc:403] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:28.056285 14547 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:28.041381 14578 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:28.169651 13227 rpcz_store.cc:269] 0709 12:24:26.499302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.499423 (+   121us) service_pool.cc:224] Handling call
0709 12:24:28.160790 (+1661367us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001b3854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:28.161043 (+   253us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3399378304}
I20260709 12:24:28.067237 14607 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:28.208313 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 53726.2us
I20260709 12:24:28.170770 14556 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.157696 14449 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.180436 14582 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.052338 14516 rpcz_store.cc:276] 0709 12:24:25.147393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.147632 (+   239us) service_pool.cc:224] Handling call
0709 12:24:25.262466 (+114834us) ts_tablet_manager.cc:934] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
0709 12:24:25.940517 (+678051us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:26.468898 (+528381us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:26.476628 (+  7730us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:28.013511 (+1536883us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:28.013833 (+   322us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:28.014148 (+   315us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:28.014217 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":209,"tablet-copy.queue_time_us":113783,"thread_start_us":84344,"threads_started":2}
I20260709 12:24:28.221658 14469 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.222492 14516 tablet_copy_client.cc:806] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:28.223356 14516 tablet_copy_client.cc:670] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:28.189810 14614 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:28.066349 14586 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.200562 12550 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:28.199293 14462 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:28.169445 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.168871 14405 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:28.206290 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50846.9us
I20260709 12:24:28.210041 14580 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.067010 14588 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.204156 14558 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.196578 14597 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.189796 12625 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:28.226878 14578 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.232985 12553 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:28.237468 14599 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.228463 14405 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.243026 14603 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.245049 14462 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.246083 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 586) took 1661 ms. Trace:
I20260709 12:24:28.244619 14599 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.233683 14556 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.279584 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 318) took 2334 ms. Trace:
I20260709 12:24:28.250747 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:28.280086 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 120052us
I20260709 12:24:28.247537 13235 rpcz_store.cc:276] 0709 12:24:26.582597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.585982 (+  3385us) service_pool.cc:224] Handling call
0709 12:24:26.999267 (+413285us) spinlock_profiling.cc:243] Waited 7.61 ms on lock 0x7b5800126c98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6e9c 00007f0e919c6a5b 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:27.799987 (+800720us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b5800126c98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6eee 000000000036eb39 00007f0e99a3a1e0 00007f0e99b030c4 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:27.805483 (+  5496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.904565 (+ 99082us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:27.908105 (+  3540us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.964617 (+ 56512us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:27.972235 (+  7618us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.243144 (+270909us) spinlock_profiling.cc:243] Waited 91.8 ms on lock 0x7b54006f68d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:28.243219 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.243490 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296567168}
I20260709 12:24:28.257879 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.260416 14578 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.279188 14599 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.282150 14578 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.284060 14560 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.261642 14588 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:28.267645 14464 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.287045 14588 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.269200 14469 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.287559 14588 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.221743 14594 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:28.282601 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62074us
I20260709 12:24:28.262423 13198 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.283066 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.286499 14578 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.276543 14569 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.285822 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.294988 12555 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:28.295239 14597 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.296178 14597 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:28.296561 14597 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.296972 14597 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.298166 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.283694 12454 rpcz_store.cc:276] 0709 12:24:25.944556 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.944861 (+   305us) service_pool.cc:224] Handling call
0709 12:24:28.279324 (+2334463us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:27.023739 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:27.094239 (+ 70500us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:27.094278 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:24:27.094323 (+    45us) tablet.cc:662] Decoding operations
0709 12:24:27.094739 (+   416us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:27.094831 (+    92us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:27.094891 (+    60us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:27.095161 (+   270us) tablet.cc:701] Row locks acquired
0709 12:24:27.095185 (+    24us) write_op.cc:260] PREPARE: finished
0709 12:24:27.095415 (+   230us) write_op.cc:270] Start()
0709 12:24:27.095574 (+   159us) write_op.cc:276] Timestamp: P: 1783599867095330 usec, L: 0
0709 12:24:27.095604 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:24:27.368909 (+273305us) log.cc:844] Serialized 535 byte log entry
0709 12:24:27.914091 (+545182us) op_driver.cc:464] REPLICATION: finished
0709 12:24:28.029734 (+115643us) write_op.cc:301] APPLY: starting
0709 12:24:28.037746 (+  8012us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:28.042824 (+  5078us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:28.054561 (+ 11737us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:28.054801 (+   240us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:28.054978 (+   177us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:28.055028 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:28.055240 (+   212us) log.cc:844] Serialized 23 byte log entry
0709 12:24:28.055415 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.055500 (+    85us) write_op.cc:454] Released schema lock
0709 12:24:28.055540 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:28.256815 (+201275us) spinlock_profiling.cc:243] Waited 56 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94ae6e28 00007f0e98521581 00007f0e98520d58 00007f0e985259f1 00007f0e985259a9 00007f0e98525939 00007f0e98525901 00007f0e98524b2d 0000000000388634 0000000000388479
0709 12:24:28.257323 (+   508us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.257391 (+    68us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4837,"reported_tablets":1,"spinlock_wait_cycles":1920,"child_traces":[["op",{"apply.queue_time_us":115410,"apply.run_cpu_time_us":1913,"apply.run_wall_time_us":26165,"num_ops":1,"prepare.queue_time_us":937983,"prepare.run_cpu_time_us":29221,"prepare.run_wall_time_us":1281014,"raft.queue_time_us":171428,"raft.run_cpu_time_us":45798,"raft.run_wall_time_us":127166,"replication_time_us":816873,"spinlock_wait_cycles":128792960,"thread_start_us":958690,"threads_started":4,"wal-append.queue_time_us":346499}]]}
I20260709 12:24:28.293311 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.293699 13198 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.254920 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.315650 12674 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.317323 14582 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.321491 14516 tablet_copy_client.cc:538] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:28.321843 14582 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.322341 14582 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:28.314256 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 73911.5us
W20260709 12:24:28.328135 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 73542.1us
I20260709 12:24:28.333427 14607 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.334260 14594 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:28.402246 13199 leader_election.cc:400] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
W20260709 12:24:28.339645 12702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 254) took 1304 ms (client timeout 1611 ms). Trace:
W20260709 12:24:28.428853 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 50877.7us
I20260709 12:24:28.324252 14547 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.336915 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:28.430576 12702 rpcz_store.cc:269] 0709 12:24:27.034739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.034898 (+   159us) service_pool.cc:224] Handling call
0709 12:24:28.339141 (+1304243us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b54003ebcd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:28.339375 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1245715200}
I20260709 12:24:28.399642 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 575) took 1441 ms. Trace:
I20260709 12:24:28.404979 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.342701 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:28.372992 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.337687 14560 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:28.337133 14558 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.374502 14580 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
W20260709 12:24:28.442831 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 100813us
W20260709 12:24:28.446166 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 73328.2us
I20260709 12:24:28.428308 14594 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.390439 14583 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.376654 14564 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.397615 14588 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:28.465705 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 133519us
I20260709 12:24:28.446671 14556 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.454519 14594 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.374366 14578 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
W20260709 12:24:28.464445 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 128383us
I20260709 12:24:28.375423 14405 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:28.472857 14588 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.472929 14405 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.472924 12456 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 342) took 2670 ms. Trace:
W20260709 12:24:28.482969 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 241390us
I20260709 12:24:28.462248 14560 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:28.470134 14456 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.485826 14554 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:28.486720 14554 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.492817 14545 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:28.493242 14545 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.493610 14545 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.495214 14582 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.478701 14564 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.501516 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.490914 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.502703 14456 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:28.509339 14619 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:24:28.522629 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.517550 14583 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:28.529889 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.436856 13234 rpcz_store.cc:276] 0709 12:24:26.957866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:27.405921 (+448055us) service_pool.cc:224] Handling call
0709 12:24:27.434661 (+ 28740us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:27.671133 (+236472us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:27.730543 (+ 59410us) log.cc:844] Serialized 14 byte log entry
0709 12:24:27.798615 (+ 68072us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:27.798685 (+    70us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:27.798751 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:28.289953 (+491202us) spinlock_profiling.cc:243] Waited 2.48 ms on lock 0x7b18003a4fe0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919cc2a6 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419
0709 12:24:28.399050 (+109097us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400510254. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:28.399104 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:28.399410 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59201,"prepare.queue_time_us":54805,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":1616,"raft.queue_time_us":108,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":3800,"spinlock_wait_cycles":548941952,"thread_start_us":67484,"threads_started":1,"wal-append.queue_time_us":176297}
I20260709 12:24:28.535563 14552 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.536324 14552 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.476619 12456 rpcz_store.cc:276] 0709 12:24:25.802176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.813860 (+ 11684us) service_pool.cc:224] Handling call
0709 12:24:28.472736 (+2658876us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:28.259383 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:28.260324 (+   941us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:28.260401 (+    77us) write_op.cc:435] Acquired schema lock
0709 12:24:28.260437 (+    36us) tablet.cc:662] Decoding operations
0709 12:24:28.261387 (+   950us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:28.261542 (+   155us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:28.261612 (+    70us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:28.261983 (+   371us) tablet.cc:701] Row locks acquired
0709 12:24:28.262056 (+    73us) write_op.cc:260] PREPARE: finished
0709 12:24:28.262329 (+   273us) write_op.cc:270] Start()
0709 12:24:28.262542 (+   213us) write_op.cc:276] Timestamp: P: 1783599868262246 usec, L: 0
0709 12:24:28.262565 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:28.290009 (+ 27444us) log.cc:844] Serialized 535 byte log entry
0709 12:24:28.297934 (+  7925us) op_driver.cc:464] REPLICATION: finished
0709 12:24:28.298807 (+   873us) write_op.cc:301] APPLY: starting
0709 12:24:28.298911 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:28.299020 (+   109us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:28.299157 (+   137us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:28.299433 (+   276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:28.299705 (+   272us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:28.299770 (+    65us) write_op.cc:312] APPLY: finished
0709 12:24:28.300080 (+   310us) log.cc:844] Serialized 23 byte log entry
0709 12:24:28.300252 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.300340 (+    88us) write_op.cc:454] Released schema lock
0709 12:24:28.300415 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:28.300998 (+   583us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.301033 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":593,"apply.run_cpu_time_us":2085,"apply.run_wall_time_us":2085,"num_ops":1,"prepare.queue_time_us":2200911,"prepare.run_cpu_time_us":4471,"prepare.run_wall_time_us":31114,"replication_time_us":35185}]]}
I20260709 12:24:28.524739 14456 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.540444 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:28.532491 14583 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.517954 14556 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.553879 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.556798 14528 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:28.549463 14583 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.560150 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.563401 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 219) took 2069 ms. Trace:
I20260709 12:24:28.563845 14449 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.566298 14586 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.567390 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:28.568167 14405 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.565078 12455 rpcz_store.cc:276] 0709 12:24:26.494104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:26.494276 (+   172us) service_pool.cc:224] Handling call
0709 12:24:28.563168 (+2068892us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:28.312180 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:28.392038 (+ 79858us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:28.392079 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:24:28.392097 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:28.392611 (+   514us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:28.392683 (+    72us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:28.392722 (+    39us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:28.392925 (+   203us) tablet.cc:701] Row locks acquired
0709 12:24:28.392944 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:28.393172 (+   228us) write_op.cc:270] Start()
0709 12:24:28.393315 (+   143us) write_op.cc:276] Timestamp: P: 1783599868393119 usec, L: 0
0709 12:24:28.393342 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:24:28.458676 (+ 65334us) log.cc:844] Serialized 530 byte log entry
0709 12:24:28.552240 (+ 93564us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b1800314aa0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e9852241d 00007f0e9852471a 00007f0e985246a8 00007f0e98524628 00007f0e985245e3 00007f0e985237fc 00007f0e9a9562f6 00007f0e9a950aa8 00007f0e94af7310
0709 12:24:28.553478 (+  1238us) op_driver.cc:464] REPLICATION: finished
0709 12:24:28.560148 (+  6670us) write_op.cc:301] APPLY: starting
0709 12:24:28.560234 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:28.560349 (+   115us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:28.560372 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:28.560702 (+   330us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:28.560914 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:28.560964 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:28.561174 (+   210us) log.cc:844] Serialized 23 byte log entry
0709 12:24:28.561432 (+   258us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:28.561545 (+   113us) write_op.cc:454] Released schema lock
0709 12:24:28.561580 (+    35us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":4420,"apply.run_cpu_time_us":1815,"apply.run_wall_time_us":1815,"num_ops":1,"prepare.queue_time_us":1715254,"prepare.run_cpu_time_us":3938,"prepare.run_wall_time_us":174239,"replication_time_us":80080,"spinlock_wait_cycles":13782400}]]}
I20260709 12:24:28.569806 14449 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.547588 14554 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:28.571105 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 44121.2us
I20260709 12:24:28.548867 14552 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.575975 14422 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.576622 14422 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.577078 14531 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:28.577672 14449 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.578369 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.578850 14405 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.579438 14528 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.579918 14528 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.580325 14528 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.581470 14597 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.582647 14556 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.584221 14516 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:24:28.584681 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.585430 12629 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 1.
I20260709 12:24:28.586597 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:28.587242 12626 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.544314 14564 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.587983 13198 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.593964 14596 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:28.594406 14596 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.594794 14596 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.595356 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.594014 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:28.596237 12554 raft_consensus.cc:2368] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3.
I20260709 12:24:28.596789 12552 raft_consensus.cc:2368] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:28.597519 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.598768 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.575598 14582 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.599578 12553 raft_consensus.cc:2368] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3.
I20260709 12:24:28.599689 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.600734 12558 raft_consensus.cc:2368] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:28.603643 14545 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.604171 14422 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.605813 14564 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:28.612285 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 63102.2us
I20260709 12:24:28.613605 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:28.614354 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.581236 14405 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.623850 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.625475 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:28.626609 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 91967.6us
I20260709 12:24:28.591688 14597 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.633584 12626 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:28.634673 13198 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:28.637849 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:28.638602 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.640908 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.642083 14392 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:28.642614 14392 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:28.643571 14392 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.637108 14560 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.654470 12553 raft_consensus.cc:2393] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:28.657974 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.662218 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.669103 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:28.644887 14594 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.662845 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.672493 12629 raft_consensus.cc:2410] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:28.672500 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.671479 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.678154 12704 raft_consensus.cc:2368] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:28.682157 12630 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:28.688685 12625 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:28.688926 13201 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.678649 14528 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.692950 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.690359 14531 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.691774 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.682698 12552 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:28.698518 12700 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:28.688079 14545 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.701928 14584 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:28.707058 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:28.708241 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.708262 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:28.710043 12629 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.711357 12703 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:28.712134 14594 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.713207 12700 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.722568 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.723301 12700 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:28.723927 12629 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:28.724998 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.726606 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:28.727622 14585 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.728229 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.728988 13229 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:28.729735 14531 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.730362 14531 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.730984 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:28.731612 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.732237 12627 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:28.731807 13230 raft_consensus.cc:2393] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:28.732529 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.734108 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.734719 13233 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:28.728271 14585 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.735100 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.730144 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.735689 12626 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:28.736954 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.737260 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.738071 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.737004 14585 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.732570 14531 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.739007 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.785475 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.700600 14596 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.748447 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.773330 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.791533 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.746483 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.792269 13232 raft_consensus.cc:2393] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:28.740469 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.749059 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.789574 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.793363 13229 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:28.793740 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.794440 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.794713 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.802776 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:28.772171 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 83325.5us
I20260709 12:24:28.801729 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.808481 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.810145 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.812886 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:28.815133 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.818022 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.806479 14569 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:28.831776 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.832700 12558 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:28.836350 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:28.839663 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.841573 12701 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:28.844828 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:28.845569 12559 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.847805 13199 leader_election.cc:400] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:28.848593 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:28.848770 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.850688 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.834453 13235 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 2: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:28.852290 12631 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:28.868098 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:28.868089 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.870800 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.872102 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.875272 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.876248 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.877252 12626 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.878754 12628 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.874797 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.876734 12557 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:28.851434 14569 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.853528 13230 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 1.
I20260709 12:24:28.865947 14531 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:28.885105 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:28.879153 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.886543 13199 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:28.889346 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:28.897203 14445 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.897441 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.897877 14445 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.900053 14445 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.900189 12559 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:28.901505 12597 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:28.902741 14464 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.903138 14464 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:28.903519 14464 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.905584 14563 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.906174 14563 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.908380 14563 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.900627 14575 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.910624 14575 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.913033 14575 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.916352 14464 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.921466 14464 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:28.922732 14617 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.923342 14617 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:28.925733 14626 log.cc:927] Time spent T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
I20260709 12:24:28.928161 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:28.929622 14575 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.888751 14531 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.933424 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:28.933959 14531 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.933475 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:28.936194 14594 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.944901 14617 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.949536 14585 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:28.949831 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 63410.2us
I20260709 12:24:28.950321 14585 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:28.952600 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:28.961395 14586 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:28.963260 14405 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.963869 14405 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:28.965621 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 76357.3us
I20260709 12:24:28.968556 14405 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.968700 14583 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.969632 14588 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:28.970309 12702 raft_consensus.cc:2368] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:28.971211 12626 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:28.972736 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:28.970321 14588 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:28.978034 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:28.979847 14588 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:28.980561 12522 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:28.981597 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:28.981763 13227 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:28.981666 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:28.978046 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:28.983723 14554 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:28.984184 14554 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:28.984575 14554 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:28.985932 14547 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:28.986614 14547 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:28.988128 14528 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:28.987737 14547 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:28.998209 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.002398 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:29.007791 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.010300 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.012423 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.016183 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.016336 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.016948 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:29.017766 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.017874 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.018599 14563 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:29.019013 14563 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:29.019366 14563 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:29.016337 12628 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
W20260709 12:24:29.021045 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 164475us
I20260709 12:24:29.019018 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.033473 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.034327 12631 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.974807 14422 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:29.036566 12553 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:29.035007 12627 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:28.989605 14449 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.041266 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:29.041923 12559 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:29.046373 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:29.047097 12628 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.996745 14552 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:29.020021 14585 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:28.970801 14556 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:24:29.062495 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.031957 14617 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.072359 14596 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:29.075538 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:29.071493 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:29.086917 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.038349 14422 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:29.108057 12706 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:29.111884 14531 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.113726 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.092056 14422 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.114534 12704 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
W20260709 12:24:29.124295 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 140967us
I20260709 12:24:29.132568 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.057987 12701 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:29.135211 12701 raft_consensus.cc:606] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:29.135598 12701 raft_consensus.cc:614] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:29.138706 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:29.140347 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 157044us
I20260709 12:24:29.145398 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.094379 14552 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.149914 12702 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:29.187965 12700 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.190819 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:29.190868 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 59529.1us
I20260709 12:24:29.191576 13228 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.192329 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.192992 12706 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.193542 14586 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:29.194005 14586 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:29.133824 14583 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.114964 14617 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.194339 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.208389 13199 leader_election.cc:400] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:29.347384 12628 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:29.212093 12554 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:29.219233 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.558813 12702 raft_consensus.cc:2368] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3.
I20260709 12:24:29.218942 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.556948 12559 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:29.204157 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.210417 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:29.208232 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:29.561216 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:29.562211 12626 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:29.383903 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:29.333952 12704 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:29.194015 12550 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:29.569205 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 185404us
I20260709 12:24:29.572840 12700 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:29.578227 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.579144 12700 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
W20260709 12:24:29.578253 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 369961us
I20260709 12:24:29.584576 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:29.243628 14631 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:24:29.586691 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 378487us
I20260709 12:24:29.589947 12626 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:29.589947 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:29.194425 14586 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.592053 12701 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.241166 14636 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:29.559327 14552 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.246992 14569 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.599370 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:29.602734 12702 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:29.604601 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.607477 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.602202 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:29.608182 12700 raft_consensus.cc:2368] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3.
W20260709 12:24:29.609644 12625 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.012s	sys 0.019s
W20260709 12:24:29.619417 12625 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.013s	sys 0.019s
I20260709 12:24:29.620679 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:29.627797 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 275663us
I20260709 12:24:29.635145 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.635718 14639 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:29.636150 14641 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.296s
I20260709 12:24:29.636276 14639 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.638554 14639 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.639348 14641 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:29.639742 14641 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:29.640074 14641 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:29.642093 12704 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:29.647143 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:29.644261 12701 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:29.649012 12706 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:29.657730 14637 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:29.658365 14637 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:29.664861 14641 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:29.666376 14632 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.427s	user 0.001s	sys 0.000s
I20260709 12:24:29.667349 14641 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:29.680510 12550 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:29.682277 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.688512 12702 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:29.641058 14531 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:29.701172 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:29.703441 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:29.718036 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.719177 12702 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:29.702410 14554 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.716s	user 0.012s	sys 0.000s
W20260709 12:24:29.726934 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 156987us
I20260709 12:24:29.730370 13198 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:29.617066 14636 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.730394 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:29.737335 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.728171 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:29.741571 12631 consensus_meta.cc:287] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.704s	user 0.008s	sys 0.003s
I20260709 12:24:29.741209 12704 raft_consensus.cc:2376] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3. Re-sending same reply.
I20260709 12:24:29.742579 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:29.742103 12631 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:24:29.752313 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 541903us
W20260709 12:24:29.754014 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 106943us
I20260709 12:24:29.754837 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:29.733659 14588 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:29.756444 12555 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:29.741336 14456 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:29.731860 14578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.000s	sys 0.007s
W20260709 12:24:29.846417 14578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.000s	sys 0.009s
I20260709 12:24:29.824102 14456 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:29.847368 14456 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.758530 14588 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.849807 14588 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:29.857112 14639 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:29.857744 14639 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.777226 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.756898 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.859448 12705 raft_consensus.cc:2376] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4. Re-sending same reply.
I20260709 12:24:29.859561 12699 raft_consensus.cc:2376] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4. Re-sending same reply.
I20260709 12:24:29.742657 14583 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:29.860380 14647 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:29.860597 14583 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:29.861089 14651 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:29.757565 14655 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:29.862244 14655 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:29.861867 14583 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:29.863337 14655 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:29.728854 14554 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.868213 14554 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.871032 14636 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.872468 14617 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:29.879899 14646 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:29.880421 12559 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:29.880542 14646 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:29.881654 14646 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.861555 14651 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:29.755748 14659 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:29.740854 14648 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 12:24:29.883903 14651 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:29.898315 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 141748us
W20260709 12:24:29.898887 13228 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.662s	user 0.003s	sys 0.006s
W20260709 12:24:29.899250 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 168987us
I20260709 12:24:29.899546 13228 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:29.910817 14639 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:29.913224 14422 consensus_meta.cc:287] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.782s	user 0.006s	sys 0.002s
I20260709 12:24:29.825619 14547 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:29.923600 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.944612 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:29.933651 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:29.947356 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.948073 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:29.948715 12702 raft_consensus.cc:2376] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4. Re-sending same reply.
W20260709 12:24:29.964929 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 65773.4us
I20260709 12:24:29.965396 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.968663 12702 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:29.915846 14636 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:29.913731 14422 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:29.987439 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.989543 12704 raft_consensus.cc:2376] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6. Re-sending same reply.
I20260709 12:24:29.964391 14547 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:29.931082 14578 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:29.994064 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:29.970091 14658 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:29.999503 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.003602 12708 raft_consensus.cc:2368] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:30.005940 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:29.967183 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:30.018016 12704 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:30.024070 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:30.025003 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:30.019439 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.032984 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:29.987691 14636 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.038115 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.054184 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.026816 14556 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:30.032492 14639 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:30.086987 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 119920us
I20260709 12:24:30.028283 14658 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:30.100860 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:30.101580 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:30.087455 14660 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:30.102540 12702 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.104243 12708 raft_consensus.cc:2393] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:24:30.087075 14584 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.028s	sys 0.006s
W20260709 12:24:30.114217 14664 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:30.115463 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1822) took 1295 ms. Trace:
I20260709 12:24:30.121062 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:30.161021 12700 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:30.121904 14630 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.788s	user 0.011s	sys 0.011s
I20260709 12:24:30.087522 14528 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:30.094753 14648 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:30.174696 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.123780 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:30.176906 12631 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:30.124094 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.032963 14578 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.140167 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:30.108326 14639 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:30.195865 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 55805.1us
W20260709 12:24:30.158871 14584 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.029s	sys 0.006s
I20260709 12:24:30.175746 12704 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:30.204512 12631 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
W20260709 12:24:30.181747 14516 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.069s	user 0.004s	sys 0.000s
I20260709 12:24:30.208767 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.098971 14669 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.104s
W20260709 12:24:30.213507 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 118424us
I20260709 12:24:30.200408 14569 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:30.219288 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.216728 12708 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:30.175011 14554 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:24:30.231351 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.159596 14547 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:30.236421 12700 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:30.238219 14639 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:30.232795 14586 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.627s	user 0.007s	sys 0.004s
I20260709 12:24:30.241469 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.221175 14569 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:30.229137 14422 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:30.237448 14563 consensus_meta.cc:287] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.218s	user 0.007s	sys 0.007s
W20260709 12:24:30.272897 14677 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:30.274222 12702 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:30.288095 14588 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:30.297876 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.298862 12704 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:30.288985 14516 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:30.289402 14644 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:24:30.290014 14642 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.291781 14563 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.284705 14651 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:30.269603 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 70248.2us
I20260709 12:24:30.320725 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.230926 14659 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:30.246827 14569 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:30.159825 12552 rpcz_store.cc:276] 0709 12:24:28.820458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.823463 (+  3005us) service_pool.cc:224] Handling call
0709 12:24:28.834027 (+ 10564us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:28.850013 (+ 15986us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:28.850050 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:28.850665 (+   615us) log.cc:844] Serialized 26 byte log entry
0709 12:24:29.035002 (+184337us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:29.407201 (+372199us) log.cc:844] Serialized 14 byte log entry
0709 12:24:29.450787 (+ 43586us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:29.467701 (+ 16914us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:30.112960 (+645259us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b18003fda80. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:30.115175 (+  2215us) raft_consensus.cc:1685] finished
0709 12:24:30.115264 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.115387 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":925227,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":194720,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":27225,"spinlock_wait_cycles":56062208,"thread_start_us":331840,"threads_started":2,"wal-append.queue_time_us":146669}
I20260709 12:24:30.329589 14636 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:30.331285 12456 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 321) took 1286 ms. Trace:
I20260709 12:24:30.331753 12456 rpcz_store.cc:276] 0709 12:24:29.045054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.057367 (+ 12313us) service_pool.cc:224] Handling call
0709 12:24:30.331205 (+1273838us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":716,"reported_tablets":1}
I20260709 12:24:30.314056 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.334321 14659 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.336930 12455 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 6, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.339178 14578 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:30.338980 12455 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 4, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.339833 14554 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:30.313941 14456 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:30.314790 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.233649 14560 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:24:30.239697 14658 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.321659 12701 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:30.327551 14679 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:30.328141 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.328888 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.394722 12703 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:30.388252 14531 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:30.408298 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:30.365002 14528 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:30.412653 12705 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:30.324851 14642 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:30.368398 14563 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:30.336813 14659 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:30.342655 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.364689 12455 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.387838 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:30.371268 12627 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:30.393944 14679 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.246827 14653 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.306s
W20260709 12:24:30.402401 14672 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260709 12:24:30.405788 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:30.247776 14586 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.415596 12631 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:30.405864 14671 log.cc:927] Time spent T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.307s	user 0.001s	sys 0.000s
I20260709 12:24:30.419037 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:30.419970 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 375045us
I20260709 12:24:30.431288 12700 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:30.423663 12455 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 5, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 5 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.475188 12700 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:30.424496 12708 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:30.420895 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:30.476224 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 70115.1us
I20260709 12:24:30.476792 12708 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:30.429102 14556 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:24:30.479151 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.412774 14531 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.422403 14528 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.532677 14528 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:30.530392 14456 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:30.478215 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 49806.8us
I20260709 12:24:30.530296 14679 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:30.427325 14636 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.530604 12706 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:30.544456 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:30.542204 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 123239us
I20260709 12:24:30.483978 14516 tablet_bootstrap.cc:492] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:24:30.552367 14586 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:30.553658 14651 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:30.553875 14588 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:30.557334 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 80490.9us
I20260709 12:24:30.501187 14644 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:30.584482 12706 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:30.581948 14516 ts_tablet_manager.cc:1403] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 2.038s	user 0.034s	sys 0.015s
I20260709 12:24:30.590880 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:30.597450 12559 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:30.478240 14684 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:30.543927 12700 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:30.605495 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 57519.6us
W20260709 12:24:30.605456 12598 leader_election.cc:336] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.598s (SENT)
W20260709 12:24:30.635423 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52381.9us
I20260709 12:24:30.636842 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:30.634701 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:30.637645 12557 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:30.637142 14569 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:30.638921 14644 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:30.722190 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:30.722844 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:30.722326 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:30.735313 12559 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:30.733544 12630 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:30.741977 14644 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:30.770273 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 356256us
I20260709 12:24:30.772065 12700 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:30.777209 14688 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:30.778008 14688 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:30.781010 14688 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:30.772534 14422 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:30.785542 12598 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.710s (SENT)
I20260709 12:24:30.786969 12559 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:30.774689 14594 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:30.819840 12598 leader_election.cc:336] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.747s (SENT)
I20260709 12:24:30.846784 12700 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:30.851493 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 82286.6us
I20260709 12:24:30.853550 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:30.855978 12598 leader_election.cc:336] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.806s (SENT)
W20260709 12:24:30.857120 14697 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:24:30.800685 14422 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:30.858579 14516 raft_consensus.cc:359] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:30.880110 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:30.879249 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:30.842640 14642 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:30.878895 14644 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:30.861089 14658 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:30.886173 14596 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:30.886502 14658 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:30.887055 14658 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:30.889325 14658 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:30.897135 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:30.853400 14531 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:30.881327 14516 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:24:30.937518 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:30.913290 14594 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:30.946008 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 90044.1us
W20260709 12:24:30.952365 12598 leader_election.cc:336] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.887s (SENT)
I20260709 12:24:30.931568 14569 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:30.968948 14516 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:24:30.971480 12598 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.101s (SENT)
I20260709 12:24:30.971724 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1488) took 1147 ms. Trace:
I20260709 12:24:30.972231 12699 rpcz_store.cc:276] 0709 12:24:29.824669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.903742 (+ 79073us) service_pool.cc:224] Handling call
0709 12:24:30.971532 (+1067790us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b54000d02d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:30.971664 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":877547776}
W20260709 12:24:30.973081 12598 leader_election.cc:336] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.177s (SENT)
W20260709 12:24:30.954803 14585 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.849s	user 0.024s	sys 0.029s
W20260709 12:24:30.981192 14585 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.879s	user 0.024s	sys 0.029s
W20260709 12:24:30.989107 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 85931.6us
I20260709 12:24:30.988955 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:30.991695 12598 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.214s (SENT)
I20260709 12:24:30.992053 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:30.992129 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:30.995342 12597 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:30.998234 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:31.000319 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 376) took 2022 ms. Trace:
I20260709 12:24:31.000990 12629 rpcz_store.cc:276] 0709 12:24:28.971689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.973334 (+  1645us) service_pool.cc:224] Handling call
0709 12:24:29.003636 (+ 30302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:29.240464 (+236828us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:29.240510 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:29.240595 (+    85us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:29.240643 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:30.994012 (+1753369us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b5400116054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:30.994058 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:30.994179 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":474312064}
I20260709 12:24:31.006963 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:30.989470 14585 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:31.010789 13228 raft_consensus.cc:1217] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:31.023579 13232 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:31.007447 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:31.121308 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 126073us
I20260709 12:24:30.996012 14659 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.127197 13229 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:31.003198 14679 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:31.046478 14516 ts_tablet_manager.cc:1434] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.441s	user 0.014s	sys 0.012s
I20260709 12:24:31.049309 13230 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:31.053555 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:31.141494 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:31.050982 14456 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:31.049059 14644 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:31.048584 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:31.057241 14594 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.043771 14678 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:31.149362 12706 raft_consensus.cc:3055] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:31.149868 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:31.151778 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:31.136196 14516 ts_tablet_manager.cc:1467] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Tablet startup took 530ms
I20260709 12:24:31.139400 14422 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:31.136399 14693 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:31.158416 12706 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:24:31.153362 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 161702us
I20260709 12:24:31.159070 13233 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:31.161391 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:31.170055 12598 leader_election.cc:336] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.243s (SENT)
I20260709 12:24:31.170552 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:31.156831 14456 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:31.143662 14679 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.173776 14693 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.155315 14644 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.186518 14585 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.186952 14456 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.195798 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.163475 14678 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.209088 14678 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:31.199826 13234 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:31.185804 14659 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.222810 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 388) took 1238 ms. Trace:
I20260709 12:24:31.223215 12632 rpcz_store.cc:276] 0709 12:24:29.984112 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.984259 (+   147us) service_pool.cc:224] Handling call
0709 12:24:31.222030 (+1237771us) spinlock_profiling.cc:243] Waited 7.08 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:31.222239 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.222415 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.222441 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:31.222478 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.222506 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.222558 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.222655 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16287104}
I20260709 12:24:31.226011 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1787) took 1325 ms. Trace:
I20260709 12:24:31.226462 12705 rpcz_store.cc:276] 0709 12:24:29.905998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.906198 (+   200us) service_pool.cc:224] Handling call
0709 12:24:29.909957 (+  3759us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:30.414618 (+504661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.225724 (+811106us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54002a2e54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:31.225922 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1147064576}
I20260709 12:24:31.210520 14679 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:31.215891 14693 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:31.164855 14516 ts_tablet_manager.cc:1469] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Trace:
0709 12:24:25.147393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.147632 (+   239us) service_pool.cc:224] Handling call
0709 12:24:25.262466 (+114834us) ts_tablet_manager.cc:934] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
0709 12:24:25.940517 (+678051us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:26.468898 (+528381us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:26.476628 (+  7730us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:28.013511 (+1536883us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:28.013833 (+   322us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:28.014148 (+   315us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:28.014217 (+    69us) inbound_call.cc:177] Queueing success response
0709 12:24:28.521857 (+507640us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:30.605805 (+2083948us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:30.795357 (+189552us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:30.815506 (+ 20149us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":209,"mutex_wait_us":13028,"raft.queue_time_us":10513,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":4883,"tablet-copy.queue_time_us":113783,"tablet-download-pool.queue_time_us":220,"tablet-download-pool.run_cpu_time_us":2673,"tablet-download-pool.run_wall_time_us":95604,"thread_start_us":84344,"threads_started":2}
I20260709 12:24:31.215631 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.260258 13233 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:31.241816 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.229384 12706 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.263785 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:31.277917 12556 raft_consensus.cc:2368] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
W20260709 12:24:31.281745 12598 leader_election.cc:336] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.292s (SENT)
I20260709 12:24:31.289237 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.290307 12707 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:31.294095 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.295083 12557 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:31.295753 12553 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:31.296181 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:31.296401 12674 connection.cc:256] RPC call timeout handler was delayed by -1.4046702410000762s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1503s for a response
I20260709 12:24:31.296861 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.288128 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:31.294217 14637 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:31.295138 12550 raft_consensus.cc:2410] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:31.298007 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.292098 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.297376 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.307904 12706 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:31.302202 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.309042 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.310153 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.310460 14650 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.311007 14650 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:31.311084 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.311574 14650 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.312292 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.313077 12699 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:31.315874 12555 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:31.315847 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.297803 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:31.316438 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.317440 12551 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:31.318089 12556 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:31.304339 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.324987 12706 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:31.329624 14594 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:31.331161 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:31.331909 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50187.4us
I20260709 12:24:31.311686 12703 raft_consensus.cc:2376] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5. Re-sending same reply.
I20260709 12:24:31.319813 12707 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
W20260709 12:24:31.342027 12598 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.472s (SENT)
W20260709 12:24:31.296865 12674 connection.cc:256] RPC call timeout handler was delayed by -1.3839702410000427s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
I20260709 12:24:31.337908 12555 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:31.343223 12674 connection.cc:256] RPC call timeout handler was delayed by -1.3335702409999612s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1582s for a response
I20260709 12:24:31.304420 14659 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:31.347437 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:31.343613 12674 connection.cc:256] RPC call timeout handler was delayed by -1.2552702409998346s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
W20260709 12:24:31.357440 12674 connection.cc:256] RPC call timeout handler was delayed by -1.228270240999791s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260709 12:24:31.358657 12674 connection.cc:256] RPC call timeout handler was delayed by -1.1877702410001802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1744s for a response
W20260709 12:24:31.359622 12674 connection.cc:256] RPC call timeout handler was delayed by -1.1715702410001541s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
W20260709 12:24:31.360601 12674 connection.cc:256] RPC call timeout handler was delayed by -1.1625702410001395s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
W20260709 12:24:31.361527 12674 connection.cc:256] RPC call timeout handler was delayed by -1.1094702410000536s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1831s for a response
W20260709 12:24:31.362974 12674 connection.cc:256] RPC call timeout handler was delayed by -1.0905702410000231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18520000000000003s for a response
I20260709 12:24:31.365482 12550 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:31.368772 12674 connection.cc:256] RPC call timeout handler was delayed by -1.0536702409999634s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260709 12:24:31.370922 12674 connection.cc:256] RPC call timeout handler was delayed by -1.0131702409998979s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 12:24:31.384347 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:31.388393 12674 leader_election.cc:400] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3.
I20260709 12:24:31.388420 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.388926 12674 leader_election.cc:403] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:31.390976 12554 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:31.406514 12625 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:31.407480 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 382) took 1481 ms. Trace:
I20260709 12:24:31.354979 14693 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:31.407897 12625 rpcz_store.cc:276] 0709 12:24:29.926446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:29.944423 (+ 17977us) service_pool.cc:224] Handling call
0709 12:24:31.389530 (+1445107us) spinlock_profiling.cc:243] Waited 9.45 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:31.389718 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.407146 (+ 17428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.407409 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":21735680}
I20260709 12:24:31.415940 12674 leader_election.cc:400] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:31.416406 12674 leader_election.cc:403] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:31.362344 14659 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.406567 14637 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3.
W20260709 12:24:31.425226 12523 leader_election.cc:336] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.508s (SENT)
I20260709 12:24:31.425894 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:31.434624 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.424538 14679 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:24:31.431146 14641 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:24:31.422736 14653 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:24:31.440690 14659 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:31.442945 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:31.443660 13227 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:31.410405 14717 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:24:31.433019 14405 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:31.451984 14647 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.463368 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:31.449177 14594 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:31.473726 14594 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:31.474296 12523 leader_election.cc:336] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.558s (SENT)
I20260709 12:24:31.475047 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:31.476634 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 139967us
I20260709 12:24:31.478796 12674 leader_election.cc:400] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3.
I20260709 12:24:31.479246 12674 leader_election.cc:403] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:31.480010 14637 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3.
I20260709 12:24:31.480717 12674 leader_election.cc:400] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:31.482378 14575 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:31.494411 14717 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:31.495795 14717 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:31.496294 14717 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:31.471732 14405 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.511066 14650 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.481171 12674 leader_election.cc:403] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:31.526548 12551 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:31.528115 12553 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:31.530519 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 56278.7us
W20260709 12:24:31.532012 12523 leader_election.cc:336] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.574s (SENT)
I20260709 12:24:31.532548 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:31.537652 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 90440.2us
I20260709 12:24:31.540067 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.539901 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.546188 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.534199 14647 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.543433 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:31.548449 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.536547 14422 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:31.543097 12632 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:31.549891 12628 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:31.549959 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 69459.7us
I20260709 12:24:31.536718 14405 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:31.555223 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.557205 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.557566 12674 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:31.557895 12629 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:31.497330 14717 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.551162 14422 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:31.572604 14422 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:31.560300 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.560133 14737 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:31.574276 12628 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:31.562675 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.562924 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-d9812250f15d4075a3c8831ca5f3ed41 received from {username='slave'} at 127.0.0.1:40560
I20260709 12:24:31.563376 14650 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:31.566833 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:31.584475 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:31.585759 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.560353 14637 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.586563 14656 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.586692 14637 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.587061 14656 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:31.574416 14737 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:31.587397 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:31.587599 14656 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.562214 14647 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.578493 14405 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.588505 14737 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:31.589838 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.561160 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.592327 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:31.599326 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.596511 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.601665 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:31.608115 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.609385 14545 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:31.611135 12523 leader_election.cc:336] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.584s (SENT)
I20260709 12:24:31.611640 12523 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:31.616039 14582 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.579974 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-d9812250f15d4075a3c8831ca5f3ed41 on tablet d9812250f15d4075a3c8831ca5f3ed41 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:31.620059 12674 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.590749 14637 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:31.627207 14644 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:31.634670 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.635555 12704 raft_consensus.cc:2393] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:31.623171 14596 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:31.637202 14596 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:31.638207 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.638460 14596 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.639729 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.640097 14596 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.641057 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.643234 12708 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:31.644585 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.645807 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.624294 14637 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:31.647980 14637 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:31.649645 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.650429 12705 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:31.652148 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.654145 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.649019 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.605195 14648 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.649645 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:31.578713 14718 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:24:31.663729 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.660604 14405 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.661252 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.665153 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.667685 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.670382 12557 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:31.673869 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 62752us
I20260709 12:24:31.665372 12705 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:31.684454 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:31.687390 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.691135 12705 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:31.693708 12627 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:31.657263 14742 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.681881 14405 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:31.701362 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.702653 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.704032 12705 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:31.707257 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:31.708799 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.688143 14687 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.709635 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:31.711305 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.717026 14647 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.716930 14582 consensus_queue.cc:1059] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:31.717559 14647 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:31.717983 14647 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.718112 14405 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:31.718557 14405 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:31.719470 14405 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.720209 14646 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.720615 14646 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:31.720956 14646 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:31.724943 14734 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 12:24:31.690744 14740 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:24:31.716301 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.698551 14545 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:31.732487 12705 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:31.733814 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 343) took 2866 ms. Trace:
I20260709 12:24:31.735718 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.710049 14556 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.738636 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.739979 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.735448 12455 rpcz_store.cc:276] 0709 12:24:28.867706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:28.874548 (+  6842us) service_pool.cc:224] Handling call
0709 12:24:31.733734 (+2859186us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:30.857118 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:30.857871 (+   753us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:30.857912 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:24:30.857934 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:30.858632 (+   698us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:30.858722 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:30.858754 (+    32us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:24:30.859197 (+   443us) tablet.cc:701] Row locks acquired
0709 12:24:30.859217 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:30.859374 (+   157us) write_op.cc:270] Start()
0709 12:24:30.859497 (+   123us) write_op.cc:276] Timestamp: P: 1783599870859323 usec, L: 0
0709 12:24:30.859521 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:24:30.860217 (+   696us) log.cc:844] Serialized 1677 byte log entry
0709 12:24:31.443984 (+583767us) op_driver.cc:464] REPLICATION: finished
0709 12:24:31.576510 (+132526us) write_op.cc:301] APPLY: starting
0709 12:24:31.576586 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:31.576736 (+   150us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:31.576892 (+   156us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:31.577529 (+   637us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:31.577734 (+   205us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 12:24:31.577788 (+    54us) write_op.cc:312] APPLY: finished
0709 12:24:31.580703 (+  2915us) log.cc:844] Serialized 41 byte log entry
0709 12:24:31.580899 (+   196us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:31.581021 (+   122us) write_op.cc:454] Released schema lock
0709 12:24:31.581072 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:31.581505 (+   433us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:31.581546 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":115640,"reported_tablets":7,"spinlock_wait_cycles":18176,"child_traces":[["op",{"apply.queue_time_us":132279,"apply.run_cpu_time_us":2430,"apply.run_wall_time_us":4917,"num_ops":4,"prepare.queue_time_us":321302,"prepare.run_cpu_time_us":18212,"prepare.run_wall_time_us":99006,"raft.queue_time_us":265599,"raft.run_cpu_time_us":39086,"raft.run_wall_time_us":115316,"replication_time_us":584295,"thread_start_us":653834,"threads_started":4,"wal-append.queue_time_us":136137}]]}
I20260709 12:24:31.743815 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.740798 12703 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:31.714335 14687 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:31.739369 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:31.753335 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 53876.9us
I20260709 12:24:31.759227 12674 leader_election.cc:400] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:24:31.759889 12674 leader_election.cc:403] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:31.748056 14644 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.805815 14644 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:31.806267 14644 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.748667 14584 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:31.809682 14584 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.810122 14584 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:31.810345 14746 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:31.742674 14648 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:31.814390 14648 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:31.814780 14648 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:31.815636 14648 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.817054 14648 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.759377 14692 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:24:31.823071 14757 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:24:31.757794 14687 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.787640 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:31.791739 14736 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.229s	user 0.002s	sys 0.000s
I20260709 12:24:31.791203 14656 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.794337 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:31.796443 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.801811 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1551) took 1244 ms. Trace:
I20260709 12:24:31.834249 12707 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:31.834137 12558 rpcz_store.cc:276] 0709 12:24:30.557596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.789514 (+231918us) service_pool.cc:224] Handling call
0709 12:24:30.789955 (+   441us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:30.935548 (+145593us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:30.935581 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:30.935634 (+    53us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:30.935669 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.801582 (+865913us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b5400102554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:31.801628 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:31.801744 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":334285184}
W20260709 12:24:31.837720 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 123417us
I20260709 12:24:31.844185 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:31.845196 12631 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:31.855638 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.823148 14405 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.862457 12706 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:31.859965 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.851044 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.855401 14738 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:31.889832 12558 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:31.889833 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.892872 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:31.891865 12558 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:31.894925 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:31.898129 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.899329 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.899647 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.900439 12702 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:31.901234 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:31.900461 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:31.902877 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:31.903249 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.897272 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:31.904017 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 144995us
I20260709 12:24:31.905431 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.912016 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:31.916074 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.916633 14563 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:31.917119 14563 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:31.917567 14563 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.917915 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.910880 12558 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.918504 12699 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:31.918645 12558 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:31.925189 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.928588 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.930723 12708 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:31.927109 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.926023 12700 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:31.901083 14639 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:31.938467 12708 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:31.887684 14578 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:31.941926 12708 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:31.950670 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:31.950912 12699 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:32.039269 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:32.356742 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.095762 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 202993us
W20260709 12:24:32.395366 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 356185us
I20260709 12:24:32.192734 12558 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:24:31.971285 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.320040 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 407196us
I20260709 12:24:32.398816 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:31.952353 12523 leader_election.cc:336] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.738s (SENT)
I20260709 12:24:32.396257 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:32.413789 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:31.954787 12708 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.419059 14735 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.419478 14735 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:31.953447 14742 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.419902 14735 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.010318 14646 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.421365 13228 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:32.097147 14705 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
W20260709 12:24:32.422479 12707 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.013s	sys 0.013s
W20260709 12:24:32.426496 12707 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.014s	sys 0.014s
W20260709 12:24:32.423367 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.034469 14754 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:24:32.027582 14745 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
W20260709 12:24:32.331278 14644 consensus_meta.cc:287] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.003s
I20260709 12:24:32.424659 12699 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:24:32.428503 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 476234us
W20260709 12:24:32.448784 12523 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.795s (SENT)
I20260709 12:24:32.449258 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:32.004223 14639 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:32.417136 14585 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:32.063031 14758 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:31.969770 14647 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.413787 14656 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:32.427634 14742 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:32.468801 12523 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.748s (SENT)
I20260709 12:24:32.575819 12523 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:32.447184 14584 consensus_meta.cc:287] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.637s	user 0.012s	sys 0.000s
I20260709 12:24:32.467165 14585 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:32.481076 14647 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:32.482985 14646 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:32.486624 14769 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:32.513914 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.111904 14637 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.514770 12703 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:32.569468 14648 consensus_meta.cc:287] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.666s	user 0.009s	sys 0.000s
I20260709 12:24:32.523036 14575 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:32.463227 12598 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.025s	sys 0.049s
I20260709 12:24:32.573813 14545 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:32.594866 12598 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.025s	sys 0.049s
W20260709 12:24:32.598502 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 642534us
W20260709 12:24:32.580004 12632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.023s	sys 0.042s
W20260709 12:24:32.599853 12632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.023s	sys 0.042s
I20260709 12:24:32.582552 12708 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:24:32.566431 14405 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.630s	user 0.006s	sys 0.001s
I20260709 12:24:32.517856 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:32.588161 12674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.007s	sys 0.029s
I20260709 12:24:32.591015 12701 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:32.592620 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 123852us
W20260709 12:24:32.604622 12674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.007s	sys 0.029s
I20260709 12:24:32.604637 12701 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:24:32.605072 12523 leader_election.cc:336] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.750s (SENT)
I20260709 12:24:32.605626 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:32.569926 14751 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:32.605621 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 693670us
I20260709 12:24:32.609385 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 484) took 1017 ms. Trace:
I20260709 12:24:32.609822 12559 rpcz_store.cc:276] 0709 12:24:31.591778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.591907 (+   129us) service_pool.cc:224] Handling call
0709 12:24:31.602193 (+ 10286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.610293 (+  8100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.610327 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.619663 (+  9336us) log.cc:844] Serialized 26 byte log entry
0709 12:24:31.710233 (+ 90570us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:31.710274 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:31.710350 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:32.609177 (+898827us) raft_consensus.cc:1685] finished
0709 12:24:32.609196 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.609329 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27310,"raft.queue_time_us":7774,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":3558,"thread_start_us":86491,"threads_started":1,"wal-append.queue_time_us":233593}
W20260709 12:24:32.596091 14726 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:24:32.589591 14585 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:32.613487 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.457214 14644 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.588627 14647 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:32.621335 12522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.018s	sys 0.069s
I20260709 12:24:32.611088 12674 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:32.658972 12705 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
W20260709 12:24:32.660033 12523 leader_election.cc:336] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.884s (SENT)
I20260709 12:24:32.594600 14575 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:32.663535 12522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.018s	sys 0.070s
I20260709 12:24:32.664193 12706 raft_consensus.cc:1240] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:32.667342 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 56334us
W20260709 12:24:32.668515 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 817529us
I20260709 12:24:32.612565 14742 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.660979 12701 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.664158 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:32.586869 14584 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.678542 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:32.679877 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.684506 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.677690 14757 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:24:32.685355 12631 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:32.687217 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:32.688009 14760 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.666s	user 0.011s	sys 0.011s
I20260709 12:24:32.688318 14766 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.689018 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.607944 14545 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.680927 12701 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:32.695722 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.695775 12550 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:32.661001 14594 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:32.690201 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:32.698405 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:32.699867 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.701547 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.712404 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:32.714186 12557 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:32.672449 14405 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.678737 14741 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.722023 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:32.728914 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:32.729276 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:32.726006 12631 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:32.671339 14641 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
I20260709 12:24:32.673069 14586 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:24:32.694442 14647 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:32.739404 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:32.740309 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:32.740360 12706 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:32.675582 14656 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 12:24:32.759002 12706 raft_consensus.cc:606] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:32.759361 12706 raft_consensus.cc:614] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:32.746577 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.717283 14560 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.764474 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:32.656721 14639 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.774936 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:32.775696 12704 raft_consensus.cc:2376] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4. Re-sending same reply.
I20260709 12:24:32.770118 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:32.777251 12704 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:32.756790 13231 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:24:32.816493 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.816282 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:32.817394 12707 raft_consensus.cc:2376] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4. Re-sending same reply.
I20260709 12:24:32.718052 14594 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:32.820776 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 669861us
I20260709 12:24:32.822991 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.738632 14751 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.056s
I20260709 12:24:32.831836 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:32.736197 14742 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:32.771826 14575 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.823119 14647 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:32.835500 12633 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:32.837915 14765 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:32.838042 14778 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.840130 12630 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:32.838176 14750 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:32.849040 13227 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:32.849478 14737 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.900717 14778 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.901314 14644 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:32.901531 14737 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:32.903015 14778 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:32.903573 14737 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:32.853519 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 1829) took 1114 ms. Trace:
I20260709 12:24:32.904112 12705 rpcz_store.cc:276] 0709 12:24:31.739016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.739137 (+   121us) service_pool.cc:224] Handling call
0709 12:24:32.853285 (+1114148us) spinlock_profiling.cc:243] Waited 903 ms on lock 0x7b54003ecbd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:32.853444 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2077052288}
I20260709 12:24:32.899266 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:32.858222 14545 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:32.859513 12626 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:32.860242 14594 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:32.778578 14560 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.865068 14717 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.867322 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1661) took 1019 ms. Trace:
I20260709 12:24:32.830672 14679 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.872670 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 302) took 1010 ms. Trace:
I20260709 12:24:32.741905 14768 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.078s
I20260709 12:24:32.887346 14575 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:32.896998 14773 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:24:32.744256 14741 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:32.898214 12701 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:32.899297 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.919531 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1660) took 1073 ms. Trace:
I20260709 12:24:32.957770 12630 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:32.957705 12626 rpcz_store.cc:276] 0709 12:24:31.846270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.846450 (+   180us) service_pool.cc:224] Handling call
0709 12:24:32.859158 (+1012708us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:32.859337 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.919200 (+ 59863us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.919461 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9506176}
I20260709 12:24:32.959088 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.960340 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:32.922008 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:32.964059 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:32.966023 12630 raft_consensus.cc:2410] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:32.928690 12634 rpcz_store.cc:276] 0709 12:24:31.847514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.847689 (+   175us) service_pool.cc:224] Handling call
0709 12:24:32.866610 (+1018921us) spinlock_profiling.cc:243] Waited 4.05 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:32.866785 (+   175us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.866943 (+   158us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.866967 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:32.867004 (+    37us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:32.867032 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.867081 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:32.867174 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":9313664}
I20260709 12:24:32.966768 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.967028 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.967864 12634 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:32.968814 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:32.969622 14742 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:32.970253 14742 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:32.972800 14742 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:32.933718 12703 rpcz_store.cc:276] 0709 12:24:31.861809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.861947 (+   138us) service_pool.cc:224] Handling call
0709 12:24:32.514535 (+652588us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.588333 (+ 73798us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.872491 (+284158us) spinlock_profiling.cc:243] Waited 624 ms on lock 0x7b54002e5c50. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:32.872612 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1434686208}
I20260709 12:24:32.898069 14750 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:32.974114 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:32.974457 14750 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:32.976140 14750 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:32.954607 12633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:32.977792 12633 raft_consensus.cc:606] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:32.979489 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:32.923254 14563 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.005s	user 0.008s	sys 0.004s
I20260709 12:24:32.981889 12555 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:53324
I20260709 12:24:32.982692 12555 raft_consensus.cc:606] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:32.981880 14563 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:32.961338 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:32.985658 12627 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:32.940200 14687 consensus_meta.cc:287] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.116s	user 0.009s	sys 0.003s
I20260709 12:24:32.932492 14771 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:32.926488 14637 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:32.922729 14751 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:32.988761 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:32.924152 14445 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:32.981325 12633 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:32.893393 14735 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.007975 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 616) took 1159 ms. Trace:
I20260709 12:24:33.008394 13228 rpcz_store.cc:276] 0709 12:24:31.848544 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.848649 (+   105us) service_pool.cc:224] Handling call
0709 12:24:31.848897 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.421738 (+572841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.007703 (+585965us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b54004d9c54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:33.007909 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316157696}
I20260709 12:24:33.010098 12633 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:33.011701 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1656) took 1171 ms. Trace:
I20260709 12:24:32.994908 14445 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.018806 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 411) took 1189 ms. Trace:
I20260709 12:24:33.019575 14445 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.019915 14659 raft_consensus.cc:1064] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:24:33.020045 13201 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.021768 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.022115 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.022673 14710 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.102s
I20260709 12:24:33.022902 14641 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.022853 12553 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:33.021791 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.028208 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:33.028355 12628 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.028517 12554 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:33.012270 12627 rpcz_store.cc:276] 0709 12:24:31.840594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.840774 (+   180us) service_pool.cc:224] Handling call
0709 12:24:32.704960 (+864186us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:32.705132 (+   172us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:32.986178 (+281046us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.011389 (+ 25211us) spinlock_profiling.cc:243] Waited 280 ms on lock 0x7b540037ffd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:33.011621 (+   232us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":671963392}
I20260709 12:24:33.040443 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:33.041754 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:33.030613 14659 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.033630 12704 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:33.034327 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:32.993909 14693 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.038898 14585 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.030776 14735 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.043181 12630 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:33.043187 12627 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.049338 12633 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:33.019266 12632 rpcz_store.cc:276] 0709 12:24:31.829667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.829829 (+   162us) service_pool.cc:224] Handling call
0709 12:24:31.845814 (+ 15985us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:31.859475 (+ 13661us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:31.859513 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:31.881768 (+ 22255us) log.cc:844] Serialized 26 byte log entry
0709 12:24:32.600233 (+718465us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:32.600281 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:32.600360 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.018579 (+418219us) raft_consensus.cc:1685] finished
0709 12:24:33.018604 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.018746 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":699,"raft.queue_time_us":17148,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":20404,"thread_start_us":718040,"threads_started":1,"wal-append.queue_time_us":823684}
I20260709 12:24:32.995553 14776 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:32.941030 14679 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.063684 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:32.985282 14563 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.064378 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:33.064762 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.088682 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.089056 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.024319 14710 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:33.071346 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 327642us
I20260709 12:24:33.071877 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:33.073143 12551 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:33.060643 12598 leader_election.cc:336] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.520s (SENT)
I20260709 12:24:33.025139 14751 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:33.084288 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:33.027714 14584 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.099462 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.100526 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:32.992038 14687 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.066998 14594 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:33.097637 12598 leader_election.cc:336] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.521s (SENT)
I20260709 12:24:33.107015 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:33.111236 12704 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:33.112341 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:33.113363 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:33.107684 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 343298us
I20260709 12:24:33.115065 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:33.116441 12598 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.980s (SENT) [suppressed 53 similar messages]
I20260709 12:24:33.132594 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.134027 12632 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:33.070636 14650 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260709 12:24:33.072741 14582 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 12:24:33.136106 12598 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.104918 14648 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.103822 14637 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:33.146847 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.146807 12629 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.062801 14756 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:24:33.150439 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.153420 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.116496 14656 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.166339 14741 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.167160 14780 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.094539 14776 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.169848 14585 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.170552 12703 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:33.172549 14560 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:33.173519 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.170035 14776 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.146375 14742 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:33.180285 14742 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.182516 14742 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.183125 14756 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.184741 14766 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:33.185930 14757 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.189841 14751 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.111404 14586 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:24:33.193866 13231 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.196110 14687 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.185166 14766 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:33.137993 14738 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.237895 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:33.239810 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:33.243574 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:33.244145 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 90815.3us
I20260709 12:24:33.202121 12454 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 3, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.245076 12598 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.247273 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:33.242941 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:33.253037 13229 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:33.253772 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 486) took 1632 ms. Trace:
I20260709 12:24:33.257077 13199 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.264345 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.265825 12633 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:33.265748 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:33.145951 14578 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:24:33.234476 14594 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.248435 12454 catalog_manager.cc:5697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:33.254204 12556 rpcz_store.cc:276] 0709 12:24:31.621665 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.719597 (+ 97932us) service_pool.cc:224] Handling call
0709 12:24:31.719862 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:31.720045 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:31.883221 (+163176us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.024479 (+1141258us) spinlock_profiling.cc:243] Waited 2.34 ms on lock 0x7b18003fd780. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:24:33.253444 (+228965us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.253497 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:33.253547 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.253611 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.253722 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41551,"prepare.queue_time_us":145368,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":51,"spinlock_wait_cycles":5371264,"thread_start_us":371200,"threads_started":2}
I20260709 12:24:33.267107 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:33.274646 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:33.307633 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.010s	sys 0.007s
W20260709 12:24:33.308010 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.010s	sys 0.008s
I20260709 12:24:33.273263 14563 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:33.279428 14639 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.260574 14756 consensus_queue.cc:1059] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 12:24:33.279452 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:33.266175 14585 consensus_queue.cc:1059] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
W20260709 12:24:33.327242 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 194744us
I20260709 12:24:33.273396 14786 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.314554 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:33.276717 14778 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
W20260709 12:24:33.329545 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 213658us
I20260709 12:24:33.277449 14584 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:24:33.328768 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.319353 14563 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:33.312697 14788 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:33.365442 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50958.1us
I20260709 12:24:33.325909 14445 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.367007 12598 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.370608 12627 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.319604 14594 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
W20260709 12:24:33.379942 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 51267us
W20260709 12:24:33.384568 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.364571 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:33.381779 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:33.391040 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 276149us
I20260709 12:24:33.391832 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.365195 14738 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:33.373430 14563 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.373128 14582 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.392721 14687 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.310576 14766 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.405211 14741 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:33.426105 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.390410 14750 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.021s
W20260709 12:24:33.425000 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.427522 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.434971 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:33.435618 12630 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:33.420848 14756 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:33.443579 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.444672 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:24:33.445128 14785 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:24:33.409617 14735 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:24:33.452744 14794 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:24:33.428597 14741 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:33.441200 14687 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:33.488936 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:33.495268 13228 raft_consensus.cc:2410] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:33.493883 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:33.498560 14798 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260709 12:24:33.433629 14737 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.050s
I20260709 12:24:33.455912 14741 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:33.500690 13226 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:33.508526 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 83606.1us
I20260709 12:24:33.487201 14710 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:33.490394 14650 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.516116 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:33.520910 14575 consensus_meta.cc:287] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.581s	user 0.011s	sys 0.000s
I20260709 12:24:33.525080 14637 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:33.533607 14791 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260709 12:24:33.515551 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 88103.6us
I20260709 12:24:33.541560 14422 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:24:33.546306 14796 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
W20260709 12:24:33.549947 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 119800us
W20260709 12:24:33.554783 14794 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:24:33.553717 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.559998 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.562961 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.567211 13226 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:33.567889 12707 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:33.565551 12634 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:33.574966 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:33.611892 13228 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.610657 13234 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:33.610693 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 47818.2us
W20260709 12:24:33.615025 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.611440 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 57797.2us
I20260709 12:24:33.615768 14405 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:33.507678 14687 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.610019 14656 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.623126 14776 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:33.623436 14804 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
W20260709 12:24:33.623967 14799 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260709 12:24:33.566576 14422 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:33.624541 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.629845 14803 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.544114 14786 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
I20260709 12:24:33.630349 14803 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.632503 14803 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:33.566308 14768 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:33.636829 14812 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
W20260709 12:24:33.640548 14790 log.cc:927] Time spent T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:24:33.608975 14575 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:33.655853 13228 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.643003 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:33.564409 14637 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.658955 14637 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.659960 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.659983 13234 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:33.635663 14768 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:33.663089 14768 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.621969 14788 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.619438 14710 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.654093 14756 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:33.665868 14710 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:33.666136 14756 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:33.666574 14756 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.621140 14456 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.649682 14817 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:33.650619 14717 consensus_meta.cc:287] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.717s	user 0.003s	sys 0.007s
I20260709 12:24:33.628032 14780 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:24:33.654054 14687 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.659564 14563 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.625061 14422 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.684535 12625 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:33.685806 12708 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.702160 12707 raft_consensus.cc:1240] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:33.705072 14721 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.705816 14721 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.707520 12627 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:33.683542 14693 consensus_meta.cc:287] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.608s	user 0.010s	sys 0.000s
I20260709 12:24:33.711231 13233 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:33.717101 13227 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEARNER]: Advancing to term 3
I20260709 12:24:33.675971 14817 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.672869 14575 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.710562 14656 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:33.683619 14819 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:33.716758 14693 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:33.766637 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:33.765888 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:33.806529 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1528) took 1082 ms. Trace:
I20260709 12:24:33.676251 14456 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.721192 14422 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:33.812659 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.814774 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:33.755508 14656 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:33.767149 14710 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.824699 14710 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.826771 14710 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.829901 14656 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:33.831013 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.831097 14656 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:33.831534 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.831851 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:33.832137 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:33.807035 12702 rpcz_store.cc:276] 0709 12:24:32.724525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.841428 (+116903us) service_pool.cc:224] Handling call
0709 12:24:32.841686 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.841881 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.841905 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.842326 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.080691 (+238365us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:33.119294 (+ 38603us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.119528 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.119624 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.667719 (+548095us) spinlock_profiling.cc:243] Waited 6.71 ms on lock 0x7b1800338b00. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e989bf58f 00007f0e919fe571 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd
0709 12:24:33.754278 (+ 86559us) raft_consensus.cc:1685] finished
0709 12:24:33.806256 (+ 51978us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.806462 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":99120,"prepare.queue_time_us":38103,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":87,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":16750,"spinlock_wait_cycles":15422720,"thread_start_us":237980,"threads_started":1,"wal-append.queue_time_us":404144}
I20260709 12:24:33.832757 14768 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.843932 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:33.845803 13227 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:33.803943 14757 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:33.836071 14644 raft_consensus.cc:3055] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:33.839208 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.846511 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.839874 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.839988 14721 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:33.842072 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:33.833483 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:33.850059 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:33.850863 13227 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:33.856674 14738 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:33.858615 14738 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.866230 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:33.849004 12550 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:33.866999 12554 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
W20260709 12:24:33.903559 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 343611us
I20260709 12:24:33.904629 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.906258 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.907586 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.917768 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.917965 12702 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:33.848387 14644 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:33.944973 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:33.953763 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 420) took 1043 ms. Trace:
I20260709 12:24:33.954321 12634 rpcz_store.cc:276] 0709 12:24:32.909984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.968530 (+ 58546us) service_pool.cc:224] Handling call
0709 12:24:33.953532 (+985002us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400344ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:33.953681 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1370807552}
I20260709 12:24:33.909196 14422 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:33.958288 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:33.961877 12702 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:33.960556 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:33.963411 12633 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:33.959306 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:33.866323 14757 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:33.951735 14563 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.966581 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1529) took 1241 ms. Trace:
I20260709 12:24:33.958393 14735 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:33.977735 12705 rpcz_store.cc:276] 0709 12:24:32.724730 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.905268 (+180538us) service_pool.cc:224] Handling call
0709 12:24:32.905623 (+   355us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:32.905962 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:32.905989 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:32.906534 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.260512 (+353978us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:33.963978 (+703466us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.964283 (+   305us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.966358 (+  2075us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.966408 (+    50us) raft_consensus.cc:1685] finished
0709 12:24:33.966419 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.966533 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":411740,"prepare.queue_time_us":452249,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":12577,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":20177,"thread_start_us":643873,"threads_started":2,"wal-append.queue_time_us":466600}
I20260709 12:24:33.965565 14827 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:33.966660 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:33.967900 12703 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.992012 12707 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:33.969238 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:33.962702 14456 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:33.960973 14422 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:33.969370 14659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.008s	sys 0.026s
I20260709 12:24:33.994558 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:33.996147 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1530) took 1271 ms. Trace:
I20260709 12:24:33.995193 14735 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:33.997679 14422 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.006748 14735 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.011261 14701 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:34.011547 12625 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 392) took 2476 ms (client timeout 1613 ms). Trace:
I20260709 12:24:34.011704 14701 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.012120 14701 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:34.011971 12625 rpcz_store.cc:269] 0709 12:24:31.535022 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:31.535165 (+   143us) service_pool.cc:224] Handling call
0709 12:24:34.011338 (+2476173us) spinlock_profiling.cc:243] Waited 2.14 s on lock 0x7b5400371254. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:34.011443 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4930460032}
I20260709 12:24:34.014258 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2040) took 1312 ms. Trace:
W20260709 12:24:34.016638 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.019024 14545 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:34.014647 12628 rpcz_store.cc:276] 0709 12:24:32.701875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:32.726691 (+ 24816us) service_pool.cc:224] Handling call
0709 12:24:33.028172 (+301481us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.028893 (+   721us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.014069 (+985176us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400343fd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:34.014203 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":684192000}
I20260709 12:24:34.021811 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:34.023912 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:34.019830 14545 consensus_queue.cc:1243] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer a2a8d71f644447218c1afc3e5f7716cd log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:34.025950 12703 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
W20260709 12:24:34.034489 14741 consensus_meta.cc:287] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 12:24:34.035660 14545 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.035931 14741 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.038192 14741 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.000702 12701 rpcz_store.cc:276] 0709 12:24:32.724956 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.007570 (+282614us) service_pool.cc:224] Handling call
0709 12:24:33.033857 (+ 26287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.034290 (+   433us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.034351 (+    61us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.035019 (+   668us) log.cc:844] Serialized 26 byte log entry
0709 12:24:33.335707 (+300688us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.995141 (+659434us) log.cc:844] Serialized 14 byte log entry
0709 12:24:33.995406 (+   265us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.995500 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:33.995945 (+   445us) raft_consensus.cc:1685] finished
0709 12:24:33.995960 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:33.996092 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336848,"prepare.queue_time_us":419300,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":4277,"raft.queue_time_us":29038,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":11188,"thread_start_us":606470,"threads_started":2,"wal-append.queue_time_us":485627}
I20260709 12:24:34.047976 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:34.052732 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:33.999050 14827 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:33.998587 14659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.009s	sys 0.026s
I20260709 12:24:34.000027 14721 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.056272 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:34.057087 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:34.062069 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:34.013676 14422 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.068929 14422 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.028609 14637 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:33.971520 14825 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.057s
I20260709 12:24:34.020085 14776 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.093047 14769 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.094650 12550 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:34.108336 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:34.027279 14575 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.108982 12559 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
W20260709 12:24:34.075016 14797 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 12:24:33.995602 14710 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:24:34.023864 14804 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:34.100391 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 131217us
I20260709 12:24:34.099400 14768 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.104940 14757 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:34.107007 14701 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.115212 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1539) took 1368 ms. Trace:
I20260709 12:24:34.107885 14817 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.116686 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1542) took 1027 ms. Trace:
W20260709 12:24:34.122107 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 116886us
I20260709 12:24:34.073737 14803 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 12:24:34.015417 14644 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.073943 14750 consensus_queue.cc:1059] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
W20260709 12:24:34.124919 12522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.031s	sys 0.017s
I20260709 12:24:34.191267 14836 consensus_queue.cc:1059] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:34.192809 12522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.031s	sys 0.017s
I20260709 12:24:34.123656 14776 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:34.189678 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:34.189808 12704 rpcz_store.cc:276] 0709 12:24:32.746862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.122056 (+375194us) service_pool.cc:224] Handling call
0709 12:24:33.122317 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.259791 (+137474us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.259838 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.259898 (+    60us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:33.259948 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.114982 (+855034us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540004f6d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:34.115023 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.115159 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315606272}
W20260709 12:24:34.193972 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 619059us
W20260709 12:24:34.179260 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.092825 14829 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:34.170467 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 114226us
I20260709 12:24:34.202644 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:34.204031 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:34.202670 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 257793us
I20260709 12:24:34.205168 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.206310 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:34.201583 12700 rpcz_store.cc:276] 0709 12:24:33.089474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.482502 (+393028us) service_pool.cc:224] Handling call
0709 12:24:33.837094 (+354592us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:33.837258 (+   164us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.837292 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:33.837330 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:33.837359 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:33.837434 (+    75us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.116521 (+279087us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b54001d6fd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:34.116626 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":783788288}
I20260709 12:24:34.210274 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:34.160120 14594 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.213531 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.217629 12627 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:34.217813 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.221998 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.213555 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:34.224510 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.201967 14644 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.226861 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:34.132468 14637 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.228586 14637 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.230860 14637 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.234011 14776 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:34.234181 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.235105 12629 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:34.211172 14710 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.212440 14829 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.217447 14742 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:34.213598 14768 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
W20260709 12:24:34.241745 14756 consensus_meta.cc:287] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.573s	user 0.010s	sys 0.000s
I20260709 12:24:34.215420 14757 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:34.239681 14710 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.243167 14804 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.242352 14776 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.243443 14829 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.248365 14803 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:24:34.287681 14742 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.290763 13230 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:34.288173 14710 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:34.310264 14839 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:24:34.286787 14756 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.322783 14756 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:34.332753 14831 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
I20260709 12:24:34.297379 14768 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.305171 14804 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:34.302006 14844 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.342929 14679 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:34.331660 14757 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:34.345790 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 123836us
I20260709 12:24:34.350008 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.337052 14804 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:34.381589 14405 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.344111 14768 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.360836 14844 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:34.386050 12523 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.357697 14757 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.393908 14647 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:34.394395 14647 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:34.394834 14757 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.396682 14768 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.377067 14701 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.390285 14656 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.397756 14656 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.398727 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 423) took 1354 ms. Trace:
I20260709 12:24:34.395409 14647 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.400784 14647 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.400432 14804 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.391776 14843 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.403484 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.404520 12630 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:34.392362 14844 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.418571 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:34.419425 12628 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.399154 12632 rpcz_store.cc:276] 0709 12:24:33.044032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.147312 (+103280us) service_pool.cc:224] Handling call
0709 12:24:33.161888 (+ 14576us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:33.162326 (+   438us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:33.162381 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:33.841072 (+678691us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b2c00000238. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:24:33.841505 (+   433us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.131832 (+290327us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:34.131903 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.131992 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:34.398438 (+266446us) raft_consensus.cc:1685] finished
0709 12:24:34.398460 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:34.398663 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9338,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":80746240,"thread_start_us":289867,"threads_started":1,"wal-append.queue_time_us":497362}
I20260709 12:24:34.401852 14804 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.422922 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.425350 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:34.386898 14405 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.426928 14843 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.399892 14829 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.429885 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.430285 14843 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.430580 12627 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:34.429261 14405 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.432005 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.437736 14784 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:34.438189 14784 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.438561 14784 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.399864 14656 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:34.439591 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.421263 14771 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:34.443486 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 203058us
I20260709 12:24:34.431241 14829 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.448663 14841 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.430944 14835 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.439791 14817 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.440016 14701 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.466029 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:34.442349 14756 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.468703 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:34.470541 12701 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:34.471091 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 232608us
I20260709 12:24:34.475023 13227 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:34.475175 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.476702 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.459870 14637 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.482086 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.482707 13228 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:34.483494 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:34.484565 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.477113 14768 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.474306 14735 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:24:34.486486 14768 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:34.487643 14806 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.999s	user 0.000s	sys 0.005s
I20260709 12:24:34.488493 14768 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:34.490695 14849 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:24:34.474252 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.474617 14718 consensus_queue.cc:1059] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:24:34.480363 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:34.504190 13228 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:34.510397 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:34.512367 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.512425 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:34.521337 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.497560 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:34.498909 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:34.499393 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:34.499495 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:34.500382 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:34.500568 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:34.495625 13232 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:34.502157 14582 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.526777 14855 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:24:34.526984 14582 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.530066 12700 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:34.537397 12628 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:24:34.539530 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 43729.6us
I20260709 12:24:34.472401 14701 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.566531 14582 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.631209 14860 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:24:34.646822 13227 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:34.623448 14656 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.648324 14860 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:34.648792 14701 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.648684 14656 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.477310 14756 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.648723 14860 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:34.651598 14656 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:34.586867 14784 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.561770 14405 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.651963 14860 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.528889 14735 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.610581 14774 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.664888 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.653918 14405 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.562242 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:34.655069 14860 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:34.674625 12699 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.674647 12522 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:34.683593 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.681191 14405 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.697233 14422 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.652516 14756 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.702940 14756 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.703485 14756 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.705830 14756 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.663313 14710 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.710011 13234 raft_consensus.cc:2368] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5.
I20260709 12:24:34.711066 14710 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:34.673830 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 125113us
I20260709 12:24:34.665594 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.689148 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.689319 14766 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.691075 12554 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:34.714576 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:34.717804 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.719885 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:34.729357 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:34.693464 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.733655 12551 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:34.735023 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:34.735725 12551 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:34.738947 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.740079 13233 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:34.742296 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.523800 14456 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.744604 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:34.745345 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 305840us
I20260709 12:24:34.744791 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:34.750646 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.748391 14824 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:34.753006 13227 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:34.754547 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.755008 12671 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:34.761322 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:34.756165 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:34.764636 13198 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.766484 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.755722 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:34.768702 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.758458 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:34.770975 12522 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.738054 14756 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.738368 14647 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.743456 14422 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:34.775858 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.777033 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.777381 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.740813 14835 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.778316 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:34.789968 12522 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:34.765573 14545 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.794144 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.796375 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:34.769189 14718 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.765341 14737 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.770509 14637 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.776881 14560 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:34.803694 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:34.778190 14855 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:34.780867 14586 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:34.794819 14742 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:34.828591 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 50387.8us
I20260709 12:24:34.769361 14751 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:34.832329 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:34.808570 14644 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:34.806836 14718 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.837679 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.813511 14637 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.817692 14855 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:34.835431 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.808851 14545 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.836747 14644 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:34.835695 14836 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.839882 14718 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:34.863122 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 88425.4us
I20260709 12:24:34.839515 14637 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.795651 14835 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.864400 14644 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.877609 14750 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:34.848173 14855 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:34.886219 14545 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:34.881060 14827 raft_consensus.cc:993] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:34.903038 14405 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.882232 14656 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.915077 14405 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:34.907575 14637 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.884078 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:34.920981 14844 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:34.884740 14750 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:24:34.931708 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47699.4us
W20260709 12:24:34.935878 14801 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 1.500s	user 0.012s	sys 0.000s
I20260709 12:24:34.938207 14835 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.950098 14653 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:34.950639 14653 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:34.952260 12699 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:34.954157 14653 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.955446 14653 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:34.931010 14422 raft_consensus.cc:1081] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:24:34.965778 14737 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:34.966950 14802 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:34.967306 14802 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:34.977552 14802 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.939253 14784 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:34.956284 14405 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:34.953393 14844 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:34.981279 12552 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:35.002704 12625 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:34.955757 14718 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:34.999945 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 167667us
I20260709 12:24:35.005185 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:35.007380 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:35.012193 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:34.995355 14802 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.020562 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:35.021538 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:35.025275 14637 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.027070 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:35.027864 12699 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:35.028168 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:35.028378 14784 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:35.028867 12631 raft_consensus.cc:2368] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:24:35.028916 14784 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:35.031512 14836 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.022727 14800 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.033003 13232 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:35.033726 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.035557 12631 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:24:35.036158 12631 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.036554 12631 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:35.037611 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.997972 14750 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:35.043655 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:34.991436 14405 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.048179 12629 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.049680 12671 leader_election.cc:400] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:24:35.046419 12631 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:34.997089 14846 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:35.050045 12671 leader_election.cc:403] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:24:34.996886 14818 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:34.989532 14855 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:34.996062 14844 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.046277 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:35.067701 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:35.071621 12631 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:35.055410 14637 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.052888 14756 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:35.081846 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.073237 14766 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:35.095170 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:35.097249 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:35.098332 12708 raft_consensus.cc:2410] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:35.100369 12702 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:35.071101 14545 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:24:35.105979 12700 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:35.107110 14867 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:35.107667 14867 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:35.108227 14769 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:35.108672 14867 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.111594 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:35.114193 12701 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:35.100600 14766 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.116441 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.056342 14784 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.119172 12626 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.120184 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:35.122074 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:35.122656 12631 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.122596 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.125599 12557 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:35.128750 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.129251 12557 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:35.131218 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.131474 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:35.131937 12557 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.108700 14769 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:35.133910 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:35.131975 14788 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:35.137639 14788 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:35.138453 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.139139 12556 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:35.138882 14788 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.118198 14780 raft_consensus.cc:3055] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:35.140280 14780 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:35.128420 14868 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:35.137688 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.118837 14766 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.144171 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:35.112934 14545 consensus_queue.cc:1243] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer a2a8d71f644447218c1afc3e5f7716cd log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:35.152453 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:35.154539 12557 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:35.154834 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:35.171818 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.177100 12631 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:35.145340 14867 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.155680 14864 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.179649 13198 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:35.149358 14880 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.149075 14800 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.154331 14647 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:35.167755 14741 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:35.187489 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.178534 14656 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.184091 14582 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.172842 14868 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:24:35.178807 14644 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.191892 14718 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.223723 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:35.196527 14405 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.205629 14641 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:35.267338 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.207553 14803 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:35.206441 14582 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.193738 14800 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:35.281366 14877 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
I20260709 12:24:35.196313 14647 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:35.287154 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 85134us
W20260709 12:24:35.273021 14883 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:24:35.288276 12674 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.267474 14844 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:35.294106 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.276711 14803 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:35.192659 14880 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.283840 14582 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.304589 14405 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:35.308327 14405 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.308795 14405 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.276103 14641 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:35.311045 14647 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:35.310786 14641 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.314541 14644 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:35.317274 14881 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:24:35.316664 12674 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:35.319649 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.321380 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.295732 14855 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.298957 14757 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.305197 14803 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.341152 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.336194 14819 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:35.337253 14656 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.202819 14889 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.131s
W20260709 12:24:35.353578 14884 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.140s	user 0.000s	sys 0.000s
I20260709 12:24:35.344637 14757 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.196796 14769 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.370443 14800 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.355901 14819 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:35.375205 14819 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.377955 14819 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.381980 14769 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:35.383950 12552 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 1588) took 1726 ms (client timeout 2111 ms). Trace:
W20260709 12:24:35.384481 12552 rpcz_store.cc:269] 0709 12:24:33.657183 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.659692 (+  2509us) service_pool.cc:224] Handling call
0709 12:24:35.383733 (+1724041us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400319a54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:35.383857 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3010303744}
I20260709 12:24:35.390936 14582 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.415407 12700 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:35.422159 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:35.422966 12554 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:35.397187 14656 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:35.423321 12554 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:35.427769 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.429231 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:35.434883 14757 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.427557 12554 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.446082 12554 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:35.457175 14653 consensus_meta.cc:287] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.501s	user 0.005s	sys 0.006s
I20260709 12:24:35.458737 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:35.463955 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:35.468592 12554 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:35.470530 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:35.472347 14826 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.472950 14582 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:35.473031 14826 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:35.478354 14826 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.486461 14405 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.489287 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:35.492169 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:35.493098 12554 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.470734 14889 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:35.504030 14545 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.516892 14800 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.525914 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.467533 14766 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.516814 14656 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.506239 14855 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:35.516672 14582 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:35.537724 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.525887 14757 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.521436 14889 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:35.545725 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.553614 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 385329us
I20260709 12:24:35.555285 14405 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:35.529400 14800 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:35.570712 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.536271 14545 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:35.529006 14637 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:24:35.570127 12554 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:35.550755 14889 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.558266 14844 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:35.594692 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:35.595528 12701 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:35.538517 14656 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.600028 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:35.578753 14880 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.549623 14855 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.550520 14757 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.548219 14582 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:35.616766 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.619585 12708 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:35.585664 14899 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.626551 12553 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:35.632396 12555 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:35.602355 14844 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.626451 14456 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:35.682202 14897 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:35.636682 14896 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:24:35.705084 14594 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:35.726806 14750 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:35.830725 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.728631 14858 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:35.737229 14880 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.739394 14637 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:35.739952 14405 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:35.749629 14900 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:35.759829 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.834262 14867 consensus_meta.cc:287] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.003s
I20260709 12:24:35.770750 14780 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.793879 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:35.832818 14756 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.682960 14823 raft_consensus.cc:3055] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:35.823509 12597 leader_election.cc:400] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5.
I20260709 12:24:35.825872 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:35.639642 14647 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:35.767158 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:35.852038 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:35.853521 12557 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:35.811718 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:35.828992 14804 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:35.832964 14594 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.631765 14899 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.829794 14456 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.882004 12631 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:35.880892 12625 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.902379 12702 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:35.837318 14858 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:35.905970 12597 leader_election.cc:403] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:35.907516 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:35.909024 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:35.909693 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:35.910089 12626 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:35.911450 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:35.915375 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 104393us
W20260709 12:24:35.882687 14902 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.255s	user 0.000s	sys 0.000s
W20260709 12:24:35.882015 14903 log.cc:927] Time spent T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:24:35.919610 12708 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:35.634670 14545 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.900058 14855 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:35.853713 14766 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:35.929714 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.917845 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:35.855928 14641 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.934893 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:35.830233 14897 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.893441 14823 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:35.874434 14656 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:35.848446 14880 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:35.928786 14877 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:35.951946 12702 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:24:35.954176 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:35.956877 14819 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.578s	user 0.010s	sys 0.000s
I20260709 12:24:35.852844 14405 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.934252 14780 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:35.971576 14913 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:35.971838 14823 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.964298 14687 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:35.933997 14824 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5.
I20260709 12:24:35.874085 14756 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:35.849047 14637 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.909265 14804 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.047345 14804 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:36.048489 14866 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 1.197s	user 0.004s	sys 0.001s
I20260709 12:24:36.056246 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:36.057330 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1845) took 1559 ms. Trace:
I20260709 12:24:35.852727 14900 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.059532 14900 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.057919 12706 rpcz_store.cc:276] 0709 12:24:34.497494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:34.497611 (+   117us) service_pool.cc:224] Handling call
0709 12:24:34.497899 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:34.502277 (+  4378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:34.502325 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:34.513693 (+ 11368us) log.cc:844] Serialized 26 byte log entry
0709 12:24:34.772257 (+258564us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:34.799080 (+ 26823us) log.cc:844] Serialized 14 byte log entry
0709 12:24:34.816645 (+ 17565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:34.816753 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:35.037005 (+220252us) spinlock_profiling.cc:243] Waited 6.08 ms on lock 0x7b18004219c0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:36.047766 (+1010761us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:36.057056 (+  9290us) raft_consensus.cc:1685] finished
0709 12:24:36.057087 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.057255 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33744,"prepare.queue_time_us":27048,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":56,"raft.queue_time_us":36738,"raft.run_cpu_time_us":356,"raft.run_wall_time_us":64822,"spinlock_wait_cycles":37188224,"thread_start_us":206004,"threads_started":1,"wal-append.queue_time_us":271272}
I20260709 12:24:35.981714 14786 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 12:24:35.938613 14692 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:35.995985 14898 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:35.969497 14641 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:35.997030 14915 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:35.998476 14899 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:35.999797 14456 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:36.004698 14769 consensus_meta.cc:287] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.622s	user 0.011s	sys 0.000s
I20260709 12:24:36.014221 14784 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:35.928231 14647 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.022152 14844 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.027168 14597 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:36.028390 14912 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:24:35.938462 14584 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:24:36.031239 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:36.150257 13226 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:24:36.033187 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.028611 14856 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.038009 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:36.039994 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.092751 14757 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.041107 14756 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:36.042353 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.994767 14687 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.069245 14898 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.167888 14687 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.169304 14898 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.070878 14880 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:36.082896 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:35.988560 14800 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:36.091542 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 265774us
I20260709 12:24:36.173540 14855 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.174216 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:36.174106 14855 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.030705 14778 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.175150 14778 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:36.132570 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 70097.3us
I20260709 12:24:36.177315 14735 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:36.178182 14864 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:36.178544 14864 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:36.150003 14597 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.040611 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:36.166057 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:36.331343 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.166672 14584 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:36.089526 14804 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.281955 14405 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.306279 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.275688 14802 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:36.159402 14647 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.166003 14582 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.351133 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:36.277796 14659 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:36.149494 14915 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:36.225868 14786 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:24:36.282878 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.276291 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.361583 12557 raft_consensus.cc:2410] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:36.270637 14844 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.305825 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.378561 12554 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:36.379758 12554 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:36.330538 14855 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.179379 14864 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:36.328111 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 153968us
I20260709 12:24:36.177153 14778 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.242065 14918 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.121486 14784 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:36.334270 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.395949 12550 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
W20260709 12:24:36.336406 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 414730us
I20260709 12:24:36.340197 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.343596 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:36.400259 12553 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:36.182184 14856 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:36.327461 14889 consensus_meta.cc:287] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.731s	user 0.014s	sys 0.006s
I20260709 12:24:36.338739 12558 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:36.147477 14876 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:36.242592 14828 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 12:24:36.335180 14890 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:24:36.417961 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.408752 14918 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.419479 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.420069 12558 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:36.420249 14687 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.420964 14918 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.428193 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.361888 13234 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:36.180447 14800 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:36.328161 14756 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.344139 14897 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.337898 14819 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.344976 14802 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:36.347738 14788 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:36.403329 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.496019 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.496212 12706 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:36.496963 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:36.413156 14693 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:36.505834 14897 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.508869 14693 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.509047 14897 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.418617 14585 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:36.511343 14897 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.349228 14584 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.513093 14597 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.513721 14597 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:36.514106 14597 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:36.514228 14584 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.421854 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.422645 14641 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.422983 14784 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:36.423873 14803 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.071s	user 0.007s	sys 0.005s
I20260709 12:24:36.376048 14656 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.516505 14803 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.516645 14656 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.518754 14803 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.519691 12704 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:36.520532 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.521369 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.521901 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.522617 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.523252 12704 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:36.325275 14920 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.524111 14920 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.525852 14802 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.526986 14920 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.417244 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:36.528394 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 111221us
I20260709 12:24:36.429574 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.530517 12553 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:36.431036 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.427443 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.352592 14804 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.387933 14844 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.376353 14659 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.383900 14594 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.445909 12559 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.429833 13233 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:36.449203 14687 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.451696 14858 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.426445 14876 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:36.380872 14915 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.457056 12550 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.432232 14756 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.439627 14637 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:36.471527 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.024s	sys 0.045s
I20260709 12:24:36.425096 14889 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.447711 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.406176 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:36.579355 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.024s	sys 0.046s
I20260709 12:24:36.497339 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:36.579746 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 647026us
I20260709 12:24:36.497473 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.498255 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.499104 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.580971 12702 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:36.515978 13235 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:36.518803 14656 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.360162 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:36.543294 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 115929us
I20260709 12:24:36.545226 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.585783 12558 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:36.531662 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.587137 12553 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:36.515015 14597 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:36.551939 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 55066.7us
I20260709 12:24:36.541195 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.554548 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:36.598836 14889 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.599462 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.599761 12558 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:36.600483 14844 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.601577 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.601722 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.602900 14594 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:36.603197 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.603865 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.604595 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.548874 14757 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:36.605942 14757 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:36.606412 14757 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:36.578718 12633 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:36.493153 14819 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.576339 14813 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.551333 14456 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:36.647748 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 269839us
W20260709 12:24:36.648602 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 107672us
I20260709 12:24:36.649299 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.589803 13230 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:36.502828 14788 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.594750 14659 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.596879 14693 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.598260 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:36.604733 14915 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.545912 14846 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.582015 14926 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.606715 14756 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.641251 12634 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:36.645462 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 60045.5us
I20260709 12:24:36.678645 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.679754 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.645819 12626 raft_consensus.cc:2410] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:24:36.645653 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 47316.4us
W20260709 12:24:36.646097 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 57040.9us
I20260709 12:24:36.549144 14920 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:36.554003 14803 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.607707 12559 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:36.604656 14804 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.683475 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:36.666441 14769 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.687848 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:36.688663 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.688768 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.689522 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.652040 14856 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.666781 14582 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.676291 14594 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.692056 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.699713 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:36.687780 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.669150 14858 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:36.693365 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.701049 12704 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.703303 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:36.700102 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:36.707298 12705 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.697336 13228 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:36.697677 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.709436 13227 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:36.696903 13226 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
W20260709 12:24:36.711671 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 294316us
I20260709 12:24:36.715646 12700 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:36.655289 14456 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.720120 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.696240 14637 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:36.720731 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:36.695772 14769 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:36.706629 14927 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:24:36.651365 14813 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.692652 14717 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:24:36.723489 13229 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.734656 14456 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.735258 14456 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.735692 14456 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.736042 14824 consensus_queue.cc:1059] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:36.738982 14741 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:36.739326 14741 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:36.740278 14750 consensus_meta.cc:287] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.000s
I20260709 12:24:36.740209 14741 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.740866 12703 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:36.720875 12700 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:36.705842 13235 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.743487 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.728526 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.745335 13231 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
W20260709 12:24:36.745770 14780 consensus_meta.cc:287] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.716s	user 0.010s	sys 0.000s
I20260709 12:24:36.746341 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.747269 14788 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.726328 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:36.748808 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1571) took 1159 ms. Trace:
I20260709 12:24:36.749450 12707 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:36.749181 12699 rpcz_store.cc:276] 0709 12:24:35.589562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.589940 (+   378us) service_pool.cc:224] Handling call
0709 12:24:35.590336 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:35.634190 (+ 43854us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:35.965525 (+331335us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.460363 (+494838us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.460436 (+    73us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:36.460501 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.748572 (+288071us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b54002a2454. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:36.748618 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.748750 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13962,"prepare.queue_time_us":524982,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":15626,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":1606,"spinlock_wait_cycles":100168960,"thread_start_us":616192,"threads_started":2,"wal-append.queue_time_us":587576}
I20260709 12:24:36.708784 14582 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:36.713949 14860 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.751402 14582 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.751498 14860 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.752040 14860 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.752350 14778 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:36.752931 14778 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.680752 14846 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.756276 13234 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:36.756726 14846 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.729523 14769 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.761621 14922 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.762259 14922 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:36.763978 14930 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:24:36.681918 14926 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.764532 14922 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.741348 14880 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.765707 14880 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.766453 14778 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:36.744553 13229 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:36.766861 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 346) took 1014 ms. Trace:
I20260709 12:24:36.767172 14788 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.767859 14788 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.767246 12701 rpcz_store.cc:276] 0709 12:24:35.752230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.768168 (+ 15938us) service_pool.cc:224] Handling call
0709 12:24:35.768653 (+   485us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:36.104311 (+335658us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:36.465933 (+361622us) log.cc:844] Serialized 14 byte log entry
0709 12:24:36.705533 (+239600us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:36.706254 (+   721us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.706317 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.766622 (+ 60305us) spinlock_profiling.cc:243] Waited 335 ms on lock 0x7b54003eadd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:36.766670 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:36.766795 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5052,"prepare.queue_time_us":136358,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":16745,"raft.queue_time_us":5891,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":4856,"spinlock_wait_cycles":771261312,"thread_start_us":557574,"threads_started":2}
I20260709 12:24:36.716817 14756 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:36.716352 14915 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:36.772774 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.715549 14594 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.777261 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:36.781119 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.786609 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.787231 12626 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:36.777663 13201 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:36.791256 14856 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.757397 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.794107 14918 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:36.795369 14585 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:36.790526 14800 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.795833 14585 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:36.796110 14800 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:36.796716 14585 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.798398 14597 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:36.799185 14897 raft_consensus.cc:1064] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
W20260709 12:24:36.799170 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 72945.1us
I20260709 12:24:36.800189 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:36.800971 14545 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:36.801684 14545 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:36.800465 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:36.792996 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.806411 12705 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:36.807400 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.807958 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.808699 12700 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
W20260709 12:24:36.809898 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.810009 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.811087 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.811426 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.811678 12699 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:36.812659 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.813767 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.814610 12700 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:36.814093 12704 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:36.816401 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:36.818166 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:36.818928 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:36.820576 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:36.813298 12699 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:36.835068 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:36.836747 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:36.773506 14656 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.843788 12522 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:36.835748 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.845337 14405 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:36.845845 14405 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:36.846276 14405 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:36.837702 14693 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.848759 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.848920 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:36.849855 12707 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:36.850443 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:36.798480 14800 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:36.803975 14778 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.851809 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.856732 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.862341 12625 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:36.840039 14653 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.856022 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.853245 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.858479 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.841418 14784 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.851827 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.871377 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.864836 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.873240 12633 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:36.697319 14876 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.874023 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.860648 14855 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:36.875100 14855 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.875600 14855 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.801864 14897 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.840384 14920 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.879730 14920 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.880116 14920 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.842355 14804 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:36.841936 14750 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:36.885725 14804 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:36.885877 14750 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.886272 14804 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.886560 14750 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:36.867254 12631 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:36.868474 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.851161 14692 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.837795 14756 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:36.848196 14456 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.864153 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.856150 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:36.894030 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 75941.9us
I20260709 12:24:36.894379 12630 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:36.851207 14693 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:36.900552 14780 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.901103 14780 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.903362 14780 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.907881 14880 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.912091 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.912739 13233 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:36.914222 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:36.916891 14585 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.860834 14917 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:36.864830 14778 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.852288 14919 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:36.865797 14575 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:36.868955 14653 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:36.941188 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.961391 12630 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:36.871644 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.941906 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:36.922891 14932 log.cc:927] Time spent T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:36.974076 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.895581 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.962136 14405 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.923357 14692 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.977384 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.942379 14898 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:36.851069 14656 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.890520 14936 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:36.955734 13235 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:37.014441 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.014948 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.015226 13235 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:36.872561 14784 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.942144 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.894670 14800 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:36.941741 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:36.922647 14915 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:36.978302 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:36.977847 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.923586 14693 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:36.983871 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 85807.2us
I20260709 12:24:36.957134 14778 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:36.939138 14917 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:36.991928 14898 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:37.089562 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 218233us
I20260709 12:24:37.090507 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:36.937796 14921 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:36.998590 14405 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.000407 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:36.959697 14650 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.000805 14656 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:36.964423 14575 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.001471 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:37.001950 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.002836 14889 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:37.003343 14920 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:36.994009 14687 consensus_queue.cc:1059] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:24:37.007979 14756 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.008693 14828 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:36.973294 14931 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:36.979848 14941 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:24:37.016412 13228 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.093139 14898 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:36.960068 14919 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:36.963025 14653 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:36.975035 14819 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.107803 14889 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:37.084710 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.173802 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.086989 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.093883 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.174700 13233 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:37.013916 14936 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:37.098634 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 203097us
I20260709 12:24:37.176803 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:37.178050 12522 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:37.108835 14692 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.078652 14800 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:37.082152 14915 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.157730 14756 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.110210 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.092691 14917 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.078063 12630 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:37.170047 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:37.176013 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:37.217623 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.217845 12704 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:37.072362 14784 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.179169 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:37.195073 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.080624 14813 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.201581 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.225006 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.206130 14819 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:37.206537 14803 consensus_meta.cc:287] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.511s	user 0.009s	sys 0.000s
I20260709 12:24:37.207382 12557 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:37.209712 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.178731 14780 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.210438 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.212085 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:37.214001 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 103917us
I20260709 12:24:37.202364 14800 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.221635 12630 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:37.222189 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.230715 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.147480 14931 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.233341 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.233825 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 319) took 7189 ms. Trace:
I20260709 12:24:37.209839 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.231752 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.176800 14919 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:37.236147 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 55961.7us
I20260709 12:24:37.241361 12556 raft_consensus.cc:2393] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:37.165789 14921 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:37.244309 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.146987 14828 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.213258 14915 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.215055 14864 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.248953 14960 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.083s
I20260709 12:24:37.324029 14944 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:37.324398 14944 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:37.325731 13235 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:37.235175 12671 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:37.237985 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 58900.4us
W20260709 12:24:37.327831 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 98511.3us
I20260709 12:24:37.328321 12674 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:37.329618 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:37.250615 13229 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:37.249745 12625 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:37.281162 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.249647 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.287145 14813 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:37.288424 14656 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:37.250735 12454 rpcz_store.cc:276] 0709 12:24:30.038152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:30.052038 (+ 13886us) service_pool.cc:224] Handling call
0709 12:24:37.219089 (+7167051us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:33.611116 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:33.645642 (+ 34526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:33.645676 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:24:33.645692 (+    16us) tablet.cc:662] Decoding operations
0709 12:24:33.646116 (+   424us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:33.646167 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:33.646192 (+    25us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:33.646498 (+   306us) tablet.cc:701] Row locks acquired
0709 12:24:33.646511 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:24:33.646667 (+   156us) write_op.cc:270] Start()
0709 12:24:33.646763 (+    96us) write_op.cc:276] Timestamp: P: 1783599873646607 usec, L: 0
0709 12:24:33.646781 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:24:33.647415 (+   634us) log.cc:844] Serialized 917 byte log entry
0709 12:24:34.514480 (+867065us) op_driver.cc:464] REPLICATION: finished
0709 12:24:35.093583 (+579103us) write_op.cc:301] APPLY: starting
0709 12:24:35.093676 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:35.093803 (+   127us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:35.093923 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:35.143480 (+ 49557us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:35.154137 (+ 10657us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:35.169296 (+ 15159us) write_op.cc:312] APPLY: finished
0709 12:24:35.183719 (+ 14423us) log.cc:844] Serialized 29 byte log entry
0709 12:24:35.190442 (+  6723us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:35.192927 (+  2485us) write_op.cc:454] Released schema lock
0709 12:24:35.200854 (+  7927us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:35.273651 (+ 72797us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:35.275898 (+  2247us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":141552,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":555286,"apply.run_cpu_time_us":3047,"apply.run_wall_time_us":164557,"num_ops":2,"prepare.queue_time_us":153598,"prepare.run_cpu_time_us":61029,"prepare.run_wall_time_us":584980,"raft.queue_time_us":128761,"raft.run_cpu_time_us":76519,"raft.run_wall_time_us":558749,"replication_time_us":825979,"thread_start_us":1027928,"threads_started":4,"wal-append.queue_time_us":512230,"wal-append.run_cpu_time_us":11269,"wal-append.run_wall_time_us":2090250}]]}
I20260709 12:24:37.250252 12558 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
W20260709 12:24:37.306315 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 55601.4us
I20260709 12:24:37.309932 13226 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:37.343009 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.237011 14955 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.311657 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:37.235585 14803 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.232566 14545 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:37.204236 14687 consensus_queue.cc:1059] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:24:37.235349 14922 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.313664 14918 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:37.318041 14931 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:37.319882 14880 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.329965 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:37.331622 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50556.5us
W20260709 12:24:37.237289 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 146864us
I20260709 12:24:37.249095 14923 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.337304 14897 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.374109 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:37.376623 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46739.3us
I20260709 12:24:37.251967 12628 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
W20260709 12:24:37.326467 14949 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.338s	user 0.001s	sys 0.000s
W20260709 12:24:37.327008 14952 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
W20260709 12:24:37.327163 14953 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:24:37.237906 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:37.301733 14962 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:37.343532 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:37.354049 14964 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.356189 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:37.399638 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 56183.1us
I20260709 12:24:37.400080 12631 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.248713 14780 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.238402 14819 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:37.358145 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.408537 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 79011.6us
I20260709 12:24:37.290313 14889 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.332238 14637 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.363445 14936 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.368033 13229 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:37.414152 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:37.338202 14960 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.220903 14756 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:37.358028 14582 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.005s
I20260709 12:24:37.325212 14944 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.378239 14844 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:24:37.404273 14931 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:37.404539 14858 consensus_meta.cc:287] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.689s	user 0.007s	sys 0.002s
I20260709 12:24:37.367363 14575 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.409514 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.448812 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.404788 14964 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.439622 14582 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.449873 14828 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:37.411634 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 173794us
I20260709 12:24:37.413332 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.379173 14880 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.337764 14813 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.376950 14545 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.354792 14656 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.421875 12628 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:37.417886 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.459393 12634 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:37.430974 12631 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:37.377506 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.398656 14803 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.406260 14920 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:37.442131 14959 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.212s	user 0.004s	sys 0.000s
I20260709 12:24:37.442214 14968 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:37.442634 14954 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:24:37.447996 14637 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.413094 14646 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:37.359298 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:37.405093 14824 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:37.422519 14960 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.455735 13199 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.463646 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:37.464653 12598 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.441407 14931 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.444166 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.412214 14917 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.432483 14650 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:24:37.502257 14824 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:37.489974 14741 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:37.503674 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 59599.6us
W20260709 12:24:37.503288 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47654.9us
I20260709 12:24:37.450500 14897 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.456847 14813 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.507032 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.515067 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:37.467931 14944 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.520275 13201 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.495107 14445 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:37.486493 14575 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:37.510404 12704 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:37.455963 14922 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:37.511149 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:37.508443 14897 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.513378 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:37.504880 14757 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.864s	user 0.011s	sys 0.000s
I20260709 12:24:37.497278 14931 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.522289 12554 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:37.545920 12699 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:37.495203 14960 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.555992 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:37.518504 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:37.558007 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 51801.5us
W20260709 12:24:37.521588 14769 consensus_meta.cc:287] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.760s	user 0.010s	sys 0.000s
I20260709 12:24:37.465706 14803 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.551719 14969 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.498060 14545 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:37.522358 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:37.413360 14962 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.552143 14965 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.498509 14784 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.566397 12704 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:37.568147 12699 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:37.495708 14637 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.516831 14970 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:37.503255 14824 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.518826 14856 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.543849 14582 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.547200 14897 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.507835 14819 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.521607 14964 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.595939 12557 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.549739 14923 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:37.520488 14646 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.559032 14936 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.541461 14920 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.521339 14445 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:37.609552 14780 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.610052 14445 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.611061 14445 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:37.612154 14750 consensus_meta.cc:287] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.725s	user 0.008s	sys 0.002s
I20260709 12:24:37.612735 14750 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.614912 12707 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:37.618152 14687 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:37.572214 14769 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.621627 12705 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.582466 12704 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:37.566177 14803 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.583094 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.558578 14757 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.612077 14823 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.552788 14575 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:24:37.645139 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.599130 14956 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
W20260709 12:24:37.647639 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 64623.5us
I20260709 12:24:37.594727 14913 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:37.595049 14970 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:37.504469 14968 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.606241 14936 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.601987 14961 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.588552 14856 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.576371 14545 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.644690 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.651190 12703 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:37.605124 14800 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.644011 12706 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:37.637777 14804 consensus_meta.cc:287] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.751s	user 0.009s	sys 0.002s
W20260709 12:24:37.653208 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 275822us
I20260709 12:24:37.651758 14972 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:37.660598 14936 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.663606 14970 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.681711 14856 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.666453 14637 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.669793 14880 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.673763 14788 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.674799 14962 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:37.676797 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 114399us
W20260709 12:24:37.677443 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.678903 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:37.719786 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:37.682636 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 176357us
W20260709 12:24:37.637174 14855 consensus_meta.cc:287] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.003s
I20260709 12:24:37.580137 14969 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.644356 14919 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.696993 14945 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.705215 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.706385 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.654525 14756 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.634737 14920 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.683561 14824 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
W20260709 12:24:37.682128 14860 consensus_meta.cc:287] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.001s
I20260709 12:24:37.708268 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:37.761312 14983 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:37.761819 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.707231 12552 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:37.654213 14445 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.713557 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:37.714658 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 152237us
I20260709 12:24:37.703639 14961 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.718080 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.722369 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:37.716825 14597 consensus_meta.cc:287] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.918s	user 0.008s	sys 0.003s
I20260709 12:24:37.729496 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.729576 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.753122 14880 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:37.708101 14980 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.763664 12559 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:37.763599 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.710903 14804 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:37.768210 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 54871.9us
I20260709 12:24:37.774425 13232 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:37.754128 14637 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
I20260709 12:24:37.782331 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.723697 14855 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.785138 13235 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:37.796828 12551 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:37.790813 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:37.771311 14778 consensus_meta.cc:287] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.675s	user 0.007s	sys 0.003s
I20260709 12:24:37.766968 14445 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.798132 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:37.802312 13226 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:37.772573 14961 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.806113 12556 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:37.801532 13230 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.708s	user 0.010s	sys 0.001s
I20260709 12:24:37.773456 14983 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.808990 12555 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:37.765275 14860 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.719523 14972 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.763067 14945 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:37.806941 14975 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260709 12:24:37.805833 14445 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.773737 14968 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.807693 14824 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.805990 14981 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.798796 14918 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:24:37.812706 14800 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.819496 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:37.812258 13230 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:37.810204 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.811807 14750 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.825269 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 644) took 1128 ms. Trace:
I20260709 12:24:37.825441 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 642) took 1133 ms. Trace:
I20260709 12:24:37.826792 12701 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:37.806346 14778 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.808933 14784 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.830518 13228 rpcz_store.cc:276] 0709 12:24:36.696916 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.718642 (+ 21726us) service_pool.cc:224] Handling call
0709 12:24:37.016182 (+297540us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.119082 (+102900us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:37.825082 (+706000us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54006f68d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:37.825213 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":669140224}
I20260709 12:24:37.815156 14983 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.828099 13235 raft_consensus.cc:2376] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5. Re-sending same reply.
I20260709 12:24:37.830646 13227 rpcz_store.cc:276] 0709 12:24:36.692057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.710196 (+ 18139us) service_pool.cc:224] Handling call
0709 12:24:36.920288 (+210092us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.920620 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.920650 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.921111 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.992200 (+ 71089us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:36.992243 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.992316 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:37.305143 (+312827us) spinlock_profiling.cc:243] Waited 4.94 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:37.549329 (+244186us) raft_consensus.cc:1685] finished
0709 12:24:37.549360 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:37.825270 (+275910us) spinlock_profiling.cc:243] Waited 208 ms on lock 0x7b54007b93d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:37.825369 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":769,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":161,"spinlock_wait_cycles":489056256,"thread_start_us":70305,"threads_started":1,"wal-append.queue_time_us":165142}
I20260709 12:24:37.817298 14575 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.834518 14919 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:37.825986 14971 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:24:37.819145 14545 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.834836 14804 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:37.828575 14898 consensus_meta.cc:287] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.667s	user 0.006s	sys 0.005s
I20260709 12:24:37.823482 14824 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.840948 13234 raft_consensus.cc:2368] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
W20260709 12:24:37.835388 14693 consensus_meta.cc:287] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.739s	user 0.004s	sys 0.007s
I20260709 12:24:37.842428 14973 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:37.811020 14847 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.111s
I20260709 12:24:37.848129 14973 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:37.848582 14973 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.850638 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:37.840102 14915 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.505s	user 0.011s	sys 0.000s
I20260709 12:24:37.835799 14983 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.783196 14980 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.841132 14824 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:37.860852 14920 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.864915 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:37.853528 14653 consensus_meta.cc:287] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260709 12:24:37.872797 12702 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:37.872792 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 1862) took 1376 ms. Trace:
I20260709 12:24:37.873381 12706 rpcz_store.cc:276] 0709 12:24:36.495910 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.497152 (+  1242us) service_pool.cc:224] Handling call
0709 12:24:37.872509 (+1375357us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54000d07d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:37.872713 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2445597696}
I20260709 12:24:37.840970 14898 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.874570 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:37.868212 14969 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.850199 14693 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.887696 14693 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.868021 14637 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.889845 14855 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.853525 14915 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.876456 14920 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.866268 14880 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.830116 14981 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.895172 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:37.894124 13231 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:37.896492 12553 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:37.870564 14653 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.890879 14803 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.901515 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:37.900671 14860 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.902159 12558 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:37.894654 14855 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:37.894253 14818 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:37.891791 14637 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.912182 12708 raft_consensus.cc:2393] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:37.912379 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.915745 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:37.919102 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.920339 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.921514 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:37.924368 14803 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.905629 12552 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:37.896862 14880 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.925554 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.928774 14970 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.929400 14970 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.929781 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.896283 14920 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.904769 14818 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:37.932490 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:37.933074 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:37.931862 14921 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.936182 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:37.940413 13201 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:37.938179 14915 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.915149 14944 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.941567 12704 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:37.944697 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.945399 12550 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:37.941576 14921 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.946244 14653 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.945967 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.950045 12554 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:37.906212 14855 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.931629 14970 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.932331 14982 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:37.941920 14575 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:37.917567 14813 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:37.956698 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:37.957819 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:37.966574 12550 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:37.960968 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:37.961676 14637 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.944106 14972 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.951571 14653 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:37.947302 14915 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.960919 14926 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:37.983858 12553 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:37.980010 13227 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:37.947557 14944 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.961071 14898 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.960036 14818 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.985435 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:37.970336 14803 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:37.992081 14945 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:37.992795 14880 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:37.987964 14915 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:37.999015 14913 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:37.999511 14913 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:37.992187 14803 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:37.970075 14980 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.001677 12553 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:38.002116 12550 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:38.007030 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:37.966275 14982 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.009172 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.012996 12550 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 1.
I20260709 12:24:38.013909 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.014448 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:38.014886 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.014907 12550 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:38.015306 12707 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:37.982105 14931 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.011554 13228 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:38.000059 14915 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.014307 14898 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.005779 14803 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.020363 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.007797 14818 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.022019 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.022868 12550 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:38.023216 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.026418 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.029518 13233 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:38.030555 14981 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.031751 14656 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.033275 12550 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:38.037904 14944 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.019004 14445 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.041343 14855 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.042094 14920 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.025743 14659 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.023989 14898 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.049788 14659 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.050091 14445 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.050321 14659 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.053622 14898 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.060942 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.061645 12553 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:38.040426 14921 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.117341 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.118973 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:38.120189 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.029963 14973 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.121539 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.117621 14920 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:38.122876 14987 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:24:38.022442 14960 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.123557 12704 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:38.034953 14936 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.045516 14944 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.113112 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:38.061188 14778 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:38.116679 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.116997 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.138129 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:38.126353 12553 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:38.132398 12559 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:38.150323 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.151067 12629 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:38.151473 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.151889 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.157371 12626 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:38.138648 14984 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.455s	user 0.004s	sys 0.000s
I20260709 12:24:38.155258 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.160094 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:38.132726 14813 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.154835 14923 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.177830 12559 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:38.174299 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:38.181110 12630 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.177147 12553 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:38.141296 14824 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.122917 14920 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.113656 14897 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.185595 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.233997 12630 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:38.229048 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.276242 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.276800 12700 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:38.194505 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.277858 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.198298 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.278743 13227 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.279582 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.278254 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.280457 14737 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.280901 14737 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.281119 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.281230 14737 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.281785 12700 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.283151 14769 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:38.284829 14986 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.591s	user 0.003s	sys 0.000s
I20260709 12:24:38.284960 14917 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.287588 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.290045 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 541) took 1057 ms. Trace:
I20260709 12:24:38.291275 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.291486 12708 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:38.291747 12553 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.292564 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.293313 12708 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:38.294385 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.295071 12708 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.306308 12700 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:38.307384 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.307691 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.308542 12700 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:38.290418 12557 rpcz_store.cc:276] 0709 12:24:37.232856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.234415 (+  1559us) service_pool.cc:224] Handling call
0709 12:24:37.234739 (+   324us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.596433 (+361694us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.289824 (+693391us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54001d1fd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:38.289990 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830160768}
I20260709 12:24:38.309393 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.312906 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.309681 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.305160 14637 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:38.262581 14856 consensus_meta.cc:287] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.540s	user 0.011s	sys 0.000s
I20260709 12:24:38.330789 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.183670 14656 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:38.227478 14802 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.196985 14982 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.333988 12700 raft_consensus.cc:2368] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:38.201917 14972 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:38.157562 14944 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.157471 14898 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.148s
I20260709 12:24:38.335781 12708 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:38.185998 14880 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:38.341720 12597 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.4:37323 timed out after 1.729s (SENT) [suppressed 3 similar messages]
I20260709 12:24:38.401180 13227 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:38.334563 14864 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.313730 14983 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.343256 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 654) took 1545 ms. Trace:
W20260709 12:24:38.344321 14985 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.650s	user 0.004s	sys 0.000s
I20260709 12:24:38.347235 14889 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.348621 14741 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:38.351181 14737 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.352165 14757 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:38.356360 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.426064 12707 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:38.357398 14656 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.358122 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1597) took 1183 ms. Trace:
I20260709 12:24:38.358922 14920 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.318114 14769 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:38.233385 14803 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.330006 14922 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:38.360594 14824 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.232098 14961 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.289862 14931 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:38.256940 14960 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.195921 14913 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.445709 13229 raft_consensus.cc:2368] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:24:38.336776 14921 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.338960 14855 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.353289 14594 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.420689 14936 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.422113 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:38.406965 14941 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:24:38.433743 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:38.432035 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:38.404140 14880 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:38.465111 14880 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:38.467587 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 652) took 1681 ms (client timeout 2227 ms). Trace:
W20260709 12:24:38.468014 13234 rpcz_store.cc:269] 0709 12:24:36.786492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.786599 (+   107us) service_pool.cc:224] Handling call
0709 12:24:38.467397 (+1680798us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54004d9c54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.467519 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2384781184}
I20260709 12:24:38.469020 14961 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.341722 14856 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.447803 14855 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:38.469842 14855 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:38.470389 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.471596 14856 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.471614 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.469321 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:38.474537 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 648) took 1755 ms (client timeout 1527 ms). Trace:
I20260709 12:24:38.367849 14972 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.442956 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:38.418460 14741 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:38.416567 14864 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.476450 13228 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:24:38.475123 13232 rpcz_store.cc:269] 0709 12:24:36.719606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.743180 (+ 23574us) service_pool.cc:224] Handling call
0709 12:24:38.474313 (+1731133us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540064fad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.474450 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2369473408}
I20260709 12:24:38.447041 14921 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:38.445303 14922 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:38.468034 14803 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:38.492738 14944 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.490608 14897 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.486402 14921 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.498479 14972 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:38.500816 14923 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:38.495191 14973 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:38.501784 14983 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.541210 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.543927 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.544859 12559 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.403064 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.417304 13231 rpcz_store.cc:276] 0709 12:24:36.797986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.834127 (+ 36141us) service_pool.cc:224] Handling call
0709 12:24:38.342932 (+1508805us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400132754. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.343178 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2100715776}
W20260709 12:24:38.555965 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 152824us
I20260709 12:24:38.556689 12553 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:24:38.558178 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 216333us
I20260709 12:24:38.558965 12553 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:38.561722 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.428000 12705 rpcz_store.cc:276] 0709 12:24:37.174237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.175599 (+  1362us) service_pool.cc:224] Handling call
0709 12:24:37.176099 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.622003 (+445904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.357802 (+735799us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b5400420ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:38.358025 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1024232832}
I20260709 12:24:38.438171 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.423969 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.602895 12704 raft_consensus.cc:2368] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:38.601534 14922 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.603287 12706 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:38.562955 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:38.606137 14983 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:38.607014 14983 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:38.608305 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.610520 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 1630) took 1363 ms. Trace:
I20260709 12:24:38.611008 12555 rpcz_store.cc:276] 0709 12:24:37.246700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.247554 (+   854us) service_pool.cc:224] Handling call
0709 12:24:38.610064 (+1362510us) spinlock_profiling.cc:243] Waited 462 ms on lock 0x7b5400373f54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.610310 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1061745024}
I20260709 12:24:38.612670 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.568091 14913 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.572117 14944 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:38.573850 12597 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:38.574441 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.493373 14864 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.576279 14656 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.594717 14737 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.609257 12554 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.614749 12559 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:24:38.630867 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 56775.3us
I20260709 12:24:38.634089 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.635912 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.636432 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 1635) took 1304 ms. Trace:
I20260709 12:24:38.636914 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.491472 14741 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.638535 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.639411 14741 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.640548 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:38.643097 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:38.654609 12701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 358) took 1849 ms (client timeout 2043 ms). Trace:
I20260709 12:24:38.655125 13201 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:38.644464 12708 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:38.636958 12707 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:38.661901 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:38.608760 14983 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.664125 14656 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:38.664690 14656 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:38.665674 14855 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.666162 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.665920 14656 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:38.655160 12701 rpcz_store.cc:269] 0709 12:24:36.805265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.824824 (+ 19559us) service_pool.cc:224] Handling call
0709 12:24:38.654078 (+1829254us) spinlock_profiling.cc:243] Waited 975 ms on lock 0x7b54000fd2d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.654336 (+   258us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2241808256}
I20260709 12:24:38.636924 12558 rpcz_store.cc:276] 0709 12:24:37.331640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.342758 (+ 11118us) service_pool.cc:224] Handling call
0709 12:24:38.636028 (+1293270us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b540033fc54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.636249 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276358400}
I20260709 12:24:38.657068 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.658128 13231 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:38.687939 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.689950 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.691601 14774 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:38.692052 14973 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:38.693176 12703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1600) took 1502 ms (client timeout 1950 ms). Trace:
W20260709 12:24:38.693725 12703 rpcz_store.cc:269] 0709 12:24:37.175109 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.176579 (+  1470us) service_pool.cc:224] Handling call
0709 12:24:38.657087 (+1480508us) spinlock_profiling.cc:243] Waited 474 ms on lock 0x7b54000fcb54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.677298 (+ 20211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1089249664}
W20260709 12:24:38.694809 14659 consensus_meta.cc:287] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.006s
I20260709 12:24:38.695111 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.695375 14659 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.686138 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.691666 12555 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:38.698977 12558 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:38.699772 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:38.701071 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 78962.5us
I20260709 12:24:38.701781 12554 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:38.702030 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.703735 12627 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:38.705307 12707 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:38.709877 14855 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.710777 14972 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:38.711069 14923 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:38.712397 14445 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.713184 14445 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.715312 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 370) took 1206 ms. Trace:
I20260709 12:24:38.715852 12699 rpcz_store.cc:276] 0709 12:24:37.509125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.579422 (+ 70297us) service_pool.cc:224] Handling call
0709 12:24:37.579849 (+   427us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.676988 (+ 97139us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:37.677023 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:37.677067 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:37.677100 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.714686 (+1037586us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b54000fcdd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:38.714782 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.715058 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222925056}
I20260709 12:24:38.724174 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.721000 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:38.733254 14920 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:38.733800 14920 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.705646 14944 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.734192 14920 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:38.734233 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 160676us
I20260709 12:24:38.736141 14944 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.727557 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.724831 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.728184 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.771369 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.773507 14864 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:24:38.774845 14864 raft_consensus.cc:3055] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:38.775367 14864 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:38.724571 14778 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:38.778083 14778 raft_consensus.cc:697] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:38.779539 14778 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.786001 14659 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:38.786845 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.788086 12701 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:38.789461 14973 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:38.789996 14973 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:38.790412 14973 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:38.792168 12707 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 12:24:38.792878 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1613) took 1254 ms. Trace:
I20260709 12:24:38.793182 12707 rpcz_store.cc:276] 0709 12:24:37.538928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.721942 (+1183014us) service_pool.cc:224] Handling call
0709 12:24:38.770033 (+ 48091us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.792581 (+ 22548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.792807 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.794135 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 1634) took 1465 ms. Trace:
I20260709 12:24:38.794564 12551 rpcz_store.cc:276] 0709 12:24:37.328306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.336610 (+  8304us) service_pool.cc:224] Handling call
0709 12:24:38.793823 (+1457213us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b5400319a54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.793959 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":608105856}
I20260709 12:24:38.795079 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 373) took 1113 ms. Trace:
I20260709 12:24:38.795454 12707 rpcz_store.cc:276] 0709 12:24:37.681461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.794041 (+1112580us) service_pool.cc:224] Handling call
0709 12:24:38.794461 (+   420us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.794775 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.794802 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.794839 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:38.794867 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.794917 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.795014 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.800343 12699 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:38.803220 14922 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:38.805917 14818 consensus_meta.cc:287] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.780s	user 0.020s	sys 0.000s
I20260709 12:24:38.809089 14922 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:38.809605 14922 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:38.810041 14922 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:38.814045 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1614) took 1121 ms. Trace:
I20260709 12:24:38.814355 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:24:38.814697 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 115525us
I20260709 12:24:38.817760 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1631) took 1563 ms. Trace:
I20260709 12:24:38.818183 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38728 (request call id 1896) took 1134 ms. Trace:
I20260709 12:24:38.819070 12550 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:38.818176 12556 rpcz_store.cc:276] 0709 12:24:37.253824 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.253999 (+   175us) service_pool.cc:224] Handling call
0709 12:24:37.311451 (+ 57452us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.809624 (+498173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.817255 (+1007631us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b540035e154. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:38.817579 (+   324us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1137248640}
I20260709 12:24:38.818744 12552 rpcz_store.cc:276] 0709 12:24:37.683171 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.799562 (+116391us) service_pool.cc:224] Handling call
0709 12:24:38.817812 (+1018250us) spinlock_profiling.cc:243] Waited 73.4 ms on lock 0x7b540018b854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.817987 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168731392}
I20260709 12:24:38.824370 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1639) took 1447 ms. Trace:
I20260709 12:24:38.825116 12550 rpcz_store.cc:276] 0709 12:24:37.376576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.034363 (+657787us) service_pool.cc:224] Handling call
0709 12:24:38.818392 (+784029us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.819482 (+  1090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.824152 (+  4670us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b540018b850. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.824298 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789377792}
I20260709 12:24:38.827154 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1615) took 1069 ms. Trace:
I20260709 12:24:38.828634 12699 rpcz_store.cc:276] 0709 12:24:37.757735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.802321 (+1044586us) service_pool.cc:224] Handling call
0709 12:24:38.803706 (+  1385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.805621 (+  1915us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.805859 (+   238us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.806398 (+   539us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:38.806797 (+   399us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.826351 (+ 19554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.826928 (+   577us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.832923 14923 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:38.814960 12707 rpcz_store.cc:276] 0709 12:24:37.693140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.801683 (+1108543us) service_pool.cc:224] Handling call
0709 12:24:38.813253 (+ 11570us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.813669 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.813692 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.813763 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:38.813794 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.813849 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.813963 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.833689 14923 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.836444 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1591) took 2138 ms. Trace:
I20260709 12:24:38.835093 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 657) took 1155 ms. Trace:
I20260709 12:24:38.846825 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1709) took 1071 ms. Trace:
I20260709 12:24:38.847293 12627 rpcz_store.cc:276] 0709 12:24:37.775124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.775261 (+   137us) service_pool.cc:224] Handling call
0709 12:24:38.846576 (+1071315us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b540012f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.846745 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2069014784}
I20260709 12:24:38.849581 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 374) took 1143 ms. Trace:
I20260709 12:24:38.850025 12708 rpcz_store.cc:276] 0709 12:24:37.706276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.844465 (+1138189us) service_pool.cc:224] Handling call
0709 12:24:38.848807 (+  4342us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.849157 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.849183 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.849265 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:38.849311 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.849368 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.849504 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.850834 14917 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:38.776693 14864 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:38.843616 13229 rpcz_store.cc:276] 0709 12:24:37.679479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:37.728263 (+ 48784us) service_pool.cc:224] Handling call
0709 12:24:38.834623 (+1106360us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54004a29d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.834866 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1546838400}
I20260709 12:24:38.856639 12703 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:38.859565 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.864651 13229 raft_consensus.cc:2368] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:38.865257 14936 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.865954 14876 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:38.866448 14876 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:38.866814 14876 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.866943 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1616) took 1057 ms. Trace:
W20260709 12:24:38.867599 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 163926us
I20260709 12:24:38.868675 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:38.869279 14818 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:38.872581 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.873003 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.867532 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46335.2us
I20260709 12:24:38.865286 14774 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:38.874387 12597 leader_election.cc:400] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:24:38.874697 12597 leader_election.cc:403] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:38.875365 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.876274 12705 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:38.876120 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:38.868482 14960 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:38.865954 14936 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.878389 14960 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:24:38.879108 14960 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:38.880112 14936 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:38.880699 14936 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:38.881071 14936 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:38.867388 12699 rpcz_store.cc:276] 0709 12:24:37.810175 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.857273 (+1047098us) service_pool.cc:224] Handling call
0709 12:24:38.866240 (+  8967us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.866632 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.866656 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.866713 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:38.866744 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.866796 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.866893 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.883340 12706 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
W20260709 12:24:38.881637 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 84687.9us
I20260709 12:24:38.843196 12702 rpcz_store.cc:276] 0709 12:24:36.697620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.700066 (+  2446us) service_pool.cc:224] Handling call
0709 12:24:37.872666 (+1172600us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:37.873386 (+   720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.835953 (+962567us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54000d07d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.836174 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2695909120}
I20260709 12:24:38.886401 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.895336 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 372) took 1214 ms. Trace:
I20260709 12:24:38.897253 12701 rpcz_store.cc:276] 0709 12:24:37.680980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.788805 (+1107825us) service_pool.cc:224] Handling call
0709 12:24:38.789305 (+   500us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.891635 (+102330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.891670 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.894996 (+  3326us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:38.895045 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.895116 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.895282 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.902797 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.897778 14972 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:38.901079 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:38.893689 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.927404 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.933202 13229 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:24:38.930639 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 653) took 2090 ms (client timeout 1729 ms). Trace:
I20260709 12:24:38.934703 12706 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:38.937572 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:38.939549 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 375) took 1120 ms. Trace:
I20260709 12:24:38.942632 12707 rpcz_store.cc:276] 0709 12:24:37.819379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.860332 (+1040953us) service_pool.cc:224] Handling call
0709 12:24:38.927794 (+ 67462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.939108 (+ 11314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.939159 (+    51us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.939207 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:38.939239 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.939301 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.939477 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:38.884145 14917 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.947307 14936 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:38.948236 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.948925 14936 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:38.966380 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 97869.7us
W20260709 12:24:38.966140 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:38.957381 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 74973.4us
I20260709 12:24:38.988061 12597 leader_election.cc:400] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:24:38.949100 13231 raft_consensus.cc:2376] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4. Re-sending same reply.
I20260709 12:24:38.974541 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1618) took 1083 ms. Trace:
I20260709 12:24:38.969774 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.958127 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:38.960790 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.950606 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.952596 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:38.955616 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.951820 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:38.970688 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:38.965080 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.967063 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:39.007104 13227 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:38.988516 12597 leader_election.cc:403] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.004590 12708 rpcz_store.cc:276] 0709 12:24:37.891060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.851060 (+960000us) service_pool.cc:224] Handling call
0709 12:24:38.885202 (+ 34142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.901449 (+ 16247us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.901482 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:38.913814 (+ 12332us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:38.927357 (+ 13543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:38.927445 (+    88us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.974319 (+ 46874us) spinlock_profiling.cc:243] Waited 33.7 ms on lock 0x7b54002a1050. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.974471 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":77593344}
I20260709 12:24:38.970000 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:39.010174 12699 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:39.010735 12627 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:38.979223 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:38.980333 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:38.958012 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:39.016820 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.018970 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:39.019289 13233 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.024420 12555 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:38.956826 14972 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:38.969522 12455 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.032982 12556 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.033967 13228 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:38.951220 14855 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.021929 14445 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:39.037438 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 177107us
I20260709 12:24:38.970229 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:38.957393 14920 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:39.042424 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 112638us
I20260709 12:24:39.043951 12626 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:39.045431 13234 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:38.936990 13230 rpcz_store.cc:269] 0709 12:24:36.797671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.802930 (+  5259us) service_pool.cc:224] Handling call
0709 12:24:38.887383 (+2084453us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b54001987d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:38.887571 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":402230144}
I20260709 12:24:39.051499 14778 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.052201 14778 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:39.065702 13226 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:39.066408 14972 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.068027 12455 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 4, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 4 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.070984 12455 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 4, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:39.065620 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.086374 12550 raft_consensus.cc:2410] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:38.953611 14921 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.049850 13229 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:39.065239 13233 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:39.040050 14774 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:24:39.097615 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:39.096730 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 61689.7us
W20260709 12:24:39.101081 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 113217us
W20260709 12:24:39.109858 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.112099 14917 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:39.112831 14917 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:39.113981 12553 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:39.104755 14741 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:39.119050 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 142001us
I20260709 12:24:39.091557 14972 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:39.118937 14917 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.127605 14917 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:39.127825 15001 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:24:39.080781 14445 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:39.131672 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.134711 14923 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:39.135468 14923 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.136168 14944 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.136839 14944 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.135210 14818 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:39.128226 14917 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.074445 14897 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
I20260709 12:24:39.146888 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:39.148581 13233 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.073308 14973 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.073151 12455 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:39.095347 14778 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.141425 14741 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.139647 12552 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:39.107304 14855 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:39.173839 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 44586.5us
I20260709 12:24:39.184865 13226 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:39.187364 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:39.183887 12625 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:39.193482 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.196043 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1653) took 1272 ms. Trace:
I20260709 12:24:39.182515 12455 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:39.196424 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.196532 12557 rpcz_store.cc:276] 0709 12:24:37.923341 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.337107 (+413766us) service_pool.cc:224] Handling call
0709 12:24:38.337388 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:38.337671 (+   283us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:24:38.683454 (+345783us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.150873 (+467419us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.154995 (+  4122us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:39.168544 (+ 13549us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.178106 (+  9562us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.195835 (+ 17729us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136519,"prepare.queue_time_us":366314,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":177430,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":23798,"thread_start_us":346425,"threads_started":3,"wal-append.queue_time_us":233898}
W20260709 12:24:39.197140 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 174460us
W20260709 12:24:39.188463 14880 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.579s	user 0.015s	sys 0.002s
I20260709 12:24:39.213388 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:39.222383 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1905) took 1237 ms. Trace:
I20260709 12:24:39.197961 14983 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.223078 12559 rpcz_store.cc:276] 0709 12:24:37.978881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.706087 (+727206us) service_pool.cc:224] Handling call
0709 12:24:38.800417 (+ 94330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.026864 (+226447us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.026904 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.032918 (+  6014us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:39.032981 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.216339 (+183358us) spinlock_profiling.cc:243] Waited 219 ms on lock 0x7b5400298954. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:39.216385 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.216533 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":502894464}
I20260709 12:24:39.225164 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:39.228154 13229 raft_consensus.cc:2368] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:39.165570 14847 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.187s
I20260709 12:24:39.227264 14913 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.232534 14960 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.216936 14917 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.233757 12625 raft_consensus.cc:2393] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:39.238078 13228 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:39.239553 14973 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:39.239778 14855 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:39.240221 14889 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:24:39.224911 14880 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.241571 14922 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.241887 14944 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.242777 14921 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:39.243461 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.245035 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.249285 14802 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:39.253523 12455 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 5, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:39.252501 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:39.270869 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.270493 12455 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 4, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:39.278587 12523 leader_election.cc:400] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:39.279124 12523 leader_election.cc:403] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.279668 14889 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:39.280345 14889 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.284713 13229 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:39.278666 12455 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:39.274459 14920 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:39.275063 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:39.275339 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 117632us
W20260709 12:24:39.275143 14999 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260709 12:24:39.276217 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 129739us
I20260709 12:24:39.265532 14802 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.291270 14659 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.291136 14917 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:39.292032 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 98633.8us
W20260709 12:24:39.292263 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47330.7us
I20260709 12:24:39.294274 14922 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:39.293783 14741 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.295424 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.296169 14921 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:39.273218 14931 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.265791 14913 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:39.332767 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 105301us
I20260709 12:24:39.327965 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:39.334652 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:39.337913 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 264245us
I20260709 12:24:39.341010 13233 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:39.354270 14774 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.354990 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.354342 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:39.354347 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.355011 14913 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.332381 14659 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.357949 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:39.360394 14960 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.361423 14960 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.360949 14889 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.361876 14960 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.362332 14960 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.362532 14889 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.365975 14774 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:39.367231 14774 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:39.369225 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.369976 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.371212 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1871) took 1189 ms. Trace:
I20260709 12:24:39.371721 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:39.371619 12700 rpcz_store.cc:276] 0709 12:24:38.181941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.869989 (+688048us) service_pool.cc:224] Handling call
0709 12:24:38.870493 (+   504us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.871093 (+   600us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.871120 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.871746 (+   626us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.197714 (+325968us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:39.197758 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.197848 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.370853 (+173005us) raft_consensus.cc:1685] finished
0709 12:24:39.370882 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.371015 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":142,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":325559,"threads_started":1,"wal-append.queue_time_us":464301}
I20260709 12:24:39.373656 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.375849 14960 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.318779 14973 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:24:39.378055 14802 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.379859 14802 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.383090 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 547) took 1446 ms. Trace:
I20260709 12:24:39.383673 12553 rpcz_store.cc:276] 0709 12:24:37.937026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.559951 (+622925us) service_pool.cc:224] Handling call
0709 12:24:38.560488 (+   537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:39.114556 (+554068us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.382753 (+268197us) spinlock_profiling.cc:243] Waited 553 ms on lock 0x7b540035eb54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:39.383007 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1272355584}
I20260709 12:24:39.385581 14823 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:39.386180 14823 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.387495 14960 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:39.349665 14917 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:39.394734 15007 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:39.394093 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 72509.7us
I20260709 12:24:39.398002 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.398187 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.399051 12633 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:39.399886 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.401206 15013 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.347285 14818 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:24:39.409204 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 376) took 1003 ms. Trace:
I20260709 12:24:39.437691 12703 rpcz_store.cc:276] 0709 12:24:38.405901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.890836 (+484935us) service_pool.cc:224] Handling call
0709 12:24:38.936618 (+ 45782us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.044276 (+107658us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.044317 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:39.111201 (+ 66884us) log.cc:844] Serialized 26 byte log entry
0709 12:24:39.316944 (+205743us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:39.316990 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.317062 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.408878 (+ 91816us) raft_consensus.cc:1685] finished
0709 12:24:39.408918 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.409119 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4509,"raft.run_cpu_time_us":212,"raft.run_wall_time_us":26372,"thread_start_us":205293,"threads_started":1,"wal-append.queue_time_us":295570}
W20260709 12:24:39.410254 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 114957us
I20260709 12:24:39.427279 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.430243 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.415185 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 626) took 1259 ms. Trace:
I20260709 12:24:39.428143 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:39.435967 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 456908us
I20260709 12:24:39.410943 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.448412 12556 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:39.442914 12626 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:39.409538 14596 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:39.442085 14921 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.454030 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:39.405380 14880 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:39.454030 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.457525 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.457983 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 377) took 1051 ms. Trace:
I20260709 12:24:39.442677 13232 rpcz_store.cc:276] 0709 12:24:38.155344 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.557242 (+401898us) service_pool.cc:224] Handling call
0709 12:24:38.558630 (+  1388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:38.559609 (+   979us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.559645 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:38.971713 (+412068us) spinlock_profiling.cc:243] Waited 15.7 ms on lock 0x7b4c0008d6c0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e92db7a20 00007f0e92dc8a29 00007f0e92d8e644 00007f0e92db5f2d 00007f0e92db5b93 00007f0e94ae618b 00007f0e94ae6cb5 00007f0e94ae8004 00007f0e94ae7729 00007f0e94aecd96 00007f0e94ae1adb
0709 12:24:38.972559 (+   846us) log.cc:844] Serialized 548 byte log entry
0709 12:24:39.265658 (+293099us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:39.265694 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.265761 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.414613 (+148852us) raft_consensus.cc:1685] finished
0709 12:24:39.414642 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.414956 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36201856,"thread_start_us":292685,"threads_started":1,"wal-append.queue_time_us":439458}
I20260709 12:24:39.413044 14864 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.406561 14973 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:39.455557 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 182972us
I20260709 12:24:39.472455 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.474139 12625 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:39.406985 12633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:39.476994 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.358997 14659 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.478291 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.453445 14972 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:39.446280 15007 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.486493 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:39.468253 12705 rpcz_store.cc:276] 0709 12:24:38.406221 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:38.876959 (+470738us) service_pool.cc:224] Handling call
0709 12:24:38.890470 (+ 13511us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:38.903450 (+ 12980us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:38.903481 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:38.904116 (+   635us) log.cc:844] Serialized 52 byte log entry
0709 12:24:39.146775 (+242659us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:39.450517 (+303742us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.450976 (+   459us) log.cc:844] Serialized 14 byte log entry
0709 12:24:39.451163 (+   187us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.451305 (+   142us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:39.451352 (+    47us) raft_consensus.cc:1685] finished
0709 12:24:39.451363 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.457152 (+  5789us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7115,"raft.run_cpu_time_us":288,"raft.run_wall_time_us":12329,"spinlock_wait_cycles":10269568,"thread_start_us":508146,"threads_started":2,"wal-append.queue_time_us":431478}
I20260709 12:24:39.458443 14596 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:39.465780 14921 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:39.499190 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 99404.4us
I20260709 12:24:39.482038 14931 raft_consensus.cc:2764] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:39.499588 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.504894 12707 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:39.513298 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.515786 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:39.481398 14973 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:24:39.519430 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 108563us
I20260709 12:24:39.501312 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.514298 12625 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:39.526199 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:39.530889 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 176609us
I20260709 12:24:39.531867 12674 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:39.523825 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:39.503432 14921 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.387529 14823 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.516906 15007 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:39.542817 12523 leader_election.cc:400] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:39.543205 12523 leader_election.cc:403] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:39.546437 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.547152 12627 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:39.549093 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.549803 12625 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:39.561489 12703 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.568488 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.572690 12703 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:39.582055 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:39.583210 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 65637.9us
I20260709 12:24:39.585216 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.586277 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:39.553159 14998 log.cc:927] Time spent T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.491s	user 0.004s	sys 0.001s
W20260709 12:24:39.577880 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 111912us
I20260709 12:24:39.590775 12625 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:39.553076 14880 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.597998 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:39.600889 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 76992.5us
I20260709 12:24:39.601794 12522 leader_election.cc:400] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:39.602777 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.573457 14778 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:39.604827 15005 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.610209 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.611562 12631 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:39.590598 14917 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:39.619591 14897 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.620131 14897 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:39.620565 14897 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.617062 14880 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:39.622504 14880 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.623854 12630 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
W20260709 12:24:39.624208 14876 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.739s	user 0.011s	sys 0.000s
I20260709 12:24:39.624608 14876 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:39.625051 15010 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:39.625694 15006 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:39.626875 12629 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: [3.4-3.4]
I20260709 12:24:39.627717 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.627895 15006 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:39.628325 15006 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:39.629104 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:39.629781 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.630390 12632 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:39.632076 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.618525 14778 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:39.633869 14656 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.634814 14778 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.633772 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.593364 14920 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.633819 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.628338 12634 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
W20260709 12:24:39.636907 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 106853us
W20260709 12:24:39.637506 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 55525.3us
I20260709 12:24:39.568368 14973 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.640617 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:39.643769 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46709us
I20260709 12:24:39.645430 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.638651 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.650928 15010 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:39.651048 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:39.652129 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.654820 14656 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:39.655246 14656 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:39.655624 14656 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.654246 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.659361 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.618108 14823 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.669049 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.677580 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:39.676662 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:39.685105 12557 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:39.688616 12556 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:39.617874 14972 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:24:39.691498 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:39.664378 15005 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:39.701763 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 111330us
I20260709 12:24:39.672149 15010 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.677143 14922 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:39.703923 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:39.710037 15006 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.711786 15006 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.714601 15025 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.715741 15005 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:39.706075 14923 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:39.680799 14802 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.704667 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 64125.5us
I20260709 12:24:39.734616 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:39.738502 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:39.617434 14596 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.740162 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.635412 15007 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.745781 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:39.680565 14897 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.706423 15010 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.717562 14917 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:39.748576 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:39.703635 14876 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:39.703259 14737 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:39.747362 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44987.7us
I20260709 12:24:39.749842 12557 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:39.753224 12555 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:39.753688 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:39.758986 12558 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:39.719305 14922 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:39.735579 14889 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:39.716809 15005 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.742762 14818 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:39.703259 14920 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.752426 14741 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:39.735162 14972 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:39.735402 14802 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.770949 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:39.769938 12703 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:39.758455 15010 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.754437 14917 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:39.776510 15024 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:39.760970 14973 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.747700 14921 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.781585 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.782001 14741 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:39.782686 12707 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:39.784085 12705 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:39.763731 14922 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:39.800920 12700 raft_consensus.cc:2410] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:39.767907 14818 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:39.805176 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.808251 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:39.798333 14917 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:39.818234 12552 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:39.829890 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:39.833555 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 228720us
I20260709 12:24:39.804713 14818 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:39.797588 14774 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:39.774565 14889 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:39.785481 14737 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.808389 14983 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.808682 14923 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:39.845203 14741 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.849469 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:39.857710 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.863698 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.866619 12703 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:39.867506 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 95523.1us
I20260709 12:24:39.870451 12702 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.870610 12629 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:39.871779 14983 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.872941 15031 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:39.873660 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.874303 13226 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:39.874642 14923 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:39.876626 14737 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:39.876969 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:39.877322 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.877686 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.878317 12627 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
W20260709 12:24:39.886710 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 57871.2us
I20260709 12:24:39.894690 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.897610 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.907681 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.908355 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:39.909494 12634 raft_consensus.cc:2410] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:39.876681 14889 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:39.931902 12630 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:39.932492 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 157716us
I20260709 12:24:39.925817 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:39.935308 12707 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:39.928135 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 185726us
W20260709 12:24:39.937933 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:39.941937 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.942575 12699 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
W20260709 12:24:39.960273 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 65646.1us
I20260709 12:24:39.958606 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:39.921037 15013 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:24:39.974035 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:39.978070 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:39.979930 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:39.970556 14897 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:39.984764 14923 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:39.993477 12551 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:39.997581 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.025527 12633 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:40.135167 12633 raft_consensus.cc:614] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:40.077848 12703 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:40.135921 14596 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:39.995294 15049 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:40.134295 15046 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:24:40.136749 14983 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.138828 15052 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:40.138672 15049 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.139240 15052 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:40.013875 12522 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.140177 15052 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.141358 15038 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.141813 15038 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.142238 15038 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.038645 12699 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.143687 14917 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:39.997581 15030 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260709 12:24:40.019371 14921 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:40.149832 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 167690us
I20260709 12:24:40.150708 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.151850 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.151742 14445 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:40.151895 14944 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:40.152957 14936 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:40.153184 14445 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.064046 15013 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:39.995014 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.153380 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.981050 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.157124 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.158205 12557 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:24:40.007059 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54093.1us
I20260709 12:24:40.015632 12628 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:40.161911 12554 raft_consensus.cc:2410] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:40.154130 14802 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.167588 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.172106 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:40.174494 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 195661us
I20260709 12:24:40.173470 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.179394 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.180799 15048 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:40.051277 12702 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:40.182212 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.181896 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.182087 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.185789 12703 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.185997 12708 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:40.181573 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.096887 14960 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:24:40.188376 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:39.981035 14920 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.192351 12559 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:40.194108 12552 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:40.195533 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.198948 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.199821 12554 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:40.154755 14921 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.153664 14445 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:40.204679 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54054.2us
I20260709 12:24:40.207587 12522 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.210525 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.212186 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.171644 14802 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.212899 12551 raft_consensus.cc:2376] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4. Re-sending same reply.
I20260709 12:24:40.104592 15045 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.218472 12555 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.193712 14983 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.181350 15048 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:40.220432 15047 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:40.220340 15048 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.221060 15047 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.223019 12707 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:40.154575 14897 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 12:24:40.227399 12706 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:24:40.009864 14847 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.196s
I20260709 12:24:40.181035 14917 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.229995 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.109432 14656 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.201367 15035 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:24:40.223826 15006 consensus_meta.cc:287] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.512s	user 0.012s	sys 0.000s
W20260709 12:24:40.234730 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 67203us
I20260709 12:24:40.047565 15010 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.217641 15052 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.178272 14913 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
W20260709 12:24:40.235139 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46882.1us
I20260709 12:24:40.195981 14944 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.040s
I20260709 12:24:40.154450 15013 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.239576 12598 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.240042 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 485) took 1110 ms. Trace:
I20260709 12:24:40.068951 14818 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.242506 15029 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.244596 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.245986 12628 rpcz_store.cc:276] 0709 12:24:39.129717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:39.156916 (+ 27199us) service_pool.cc:224] Handling call
0709 12:24:39.369658 (+212742us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:40.239873 (+870215us) spinlock_profiling.cc:243] Waited 508 ms on lock 0x7b540012fa54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:40.239999 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1177482368}
I20260709 12:24:40.235062 14876 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.248422 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.229935 15005 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.251298 15036 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:40.251489 15037 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:24:40.239477 14960 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.253829 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.255924 12704 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:40.260035 12699 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:40.260195 12625 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:40.260978 15055 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.261596 15055 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.262022 15055 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.265084 13228 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.266547 15029 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.265875 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.266921 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.267377 15013 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.267536 13230 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.265908 14913 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.268502 14913 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.268864 14913 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.269152 14656 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.269757 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.271525 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.273468 15031 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.274006 15031 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.274569 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.276118 12559 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:40.247038 14855 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:40.245893 14920 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.252065 15006 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.276767 13227 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.267123 15029 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.284391 15057 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.287639 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.288733 12558 raft_consensus.cc:2368] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:40.282071 15037 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.295075 15037 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.249922 15038 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.297492 15042 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:40.298642 14656 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.298463 15042 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.299352 15038 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.299240 14656 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.300019 15038 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:40.301318 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.301878 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.302942 12627 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:40.288203 15062 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:24:40.305644 15049 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.243237 14922 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.308642 14922 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:40.309590 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.309973 12700 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:40.311543 12522 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.282923 14855 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.314692 14855 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.317921 14920 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.319236 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.320822 14920 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.323257 15020 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.324012 15020 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.285355 15045 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.326460 14931 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:40.326186 15045 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.326906 14931 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:40.328902 14921 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.329792 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.329667 15011 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:40.331421 15011 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.331789 15011 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:40.332644 15011 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.313215 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.334719 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:40.327936 14931 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.335635 15049 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.336730 15005 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.336807 14880 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.337333 15005 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.337849 15005 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.338218 14983 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.338809 14983 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.341097 14880 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.341609 14864 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:40.341985 14864 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:40.342762 14864 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.343359 14880 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.321027 13233 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.346073 15020 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.285239 14960 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:40.346102 12600 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:40.318619 15010 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:40.338143 15059 log.cc:927] Time spent T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.157s	user 0.000s	sys 0.003s
I20260709 12:24:40.347311 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.365712 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.366047 15011 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.367472 15006 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.367851 15006 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.368207 15006 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.369827 14921 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.375056 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.357988 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.344020 14864 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.362192 14774 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:40.377929 14774 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.378355 14774 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.382758 15042 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.390170 15043 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:40.390674 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.391433 12558 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:40.392529 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.362625 13230 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:40.362996 15010 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.405151 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.405830 12627 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.406091 13229 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:40.407048 15061 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 12:24:40.407158 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.408115 13228 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:40.363828 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.357762 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.359136 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.396039 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:24:40.409109 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 50091.6us
I20260709 12:24:40.370765 14921 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:40.399420 14659 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:40.404989 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.405700 15010 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.287635 15057 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.409240 12551 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.399755 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.401741 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.419787 12552 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.402745 15043 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:40.346597 14818 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.411561 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.415360 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.415823 12674 leader_election.cc:400] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:40.416119 12557 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.418533 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:40.420830 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 248791us
I20260709 12:24:40.430416 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.432163 15029 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.417200 15052 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.433637 15052 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.434019 15052 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.435146 14983 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.436108 14855 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.437217 12553 raft_consensus.cc:1240] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:24:40.438946 15057 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.439555 15057 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.440080 15057 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.400444 14922 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:24:40.442078 14802 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.442803 14802 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:40.417030 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.429201 12674 leader_election.cc:403] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.447794 12630 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:40.410506 12522 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.444320 13232 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:40.417204 15042 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.414932 14659 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:40.474236 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62698us
W20260709 12:24:40.477705 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 67306.1us
I20260709 12:24:40.478447 12522 leader_election.cc:400] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:40.415681 15031 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.479246 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.426748 15043 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.442816 14855 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:40.473841 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 231407us
I20260709 12:24:40.469944 15042 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.506249 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.509042 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.477458 14921 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.510134 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.481763 14983 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.515558 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.421530 14913 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.490411 15043 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:40.516723 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.517002 12558 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:40.538154 12700 raft_consensus.cc:2368] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:24:40.512992 15042 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.478116 14944 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.044s
I20260709 12:24:40.533713 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.534622 15057 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.535385 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.474586 14737 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:24:40.476367 15005 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.505851 14960 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.563126 15005 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.564414 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.529726 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.565640 12703 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.566812 15073 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:40.551406 15042 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:40.544152 15067 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:40.518730 14920 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:40.554915 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.559863 14774 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.569291 12522 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:40.571822 12630 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:40.584363 12633 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:40.591914 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.592700 12630 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.518172 15006 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.600553 12704 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:40.596422 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.602038 13227 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.595464 14972 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.579363 15055 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.604588 12703 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:40.568369 15005 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:40.610688 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 371166us
I20260709 12:24:40.629101 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.615602 12627 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:40.624377 15042 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.625865 14913 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.626427 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.626571 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.595849 14923 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.627209 15069 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:24:40.630681 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.634377 13227 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:40.634346 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.627709 15010 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.520852 14659 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.639642 12630 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:40.643056 12554 raft_consensus.cc:2368] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:40.649266 12552 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:40.652990 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:40.602362 14921 consensus_queue.cc:1059] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:24:40.654309 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.655066 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.657723 12552 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.645253 15013 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.638131 14936 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.650851 14922 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.665197 14922 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:40.665632 14922 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.645530 14923 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.671294 14923 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.671721 14656 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.664698 15074 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.650633 14920 raft_consensus.cc:2764] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:24:40.627910 14972 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.677337 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.636293 15052 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.642125 15057 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:40.680559 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.641948 14445 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.687443 15055 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.688848 15006 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.690177 14774 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.672550 14944 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.673350 15013 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.752853 12631 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.694164 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.727641 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.751358 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.695938 15042 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:40.714682 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.770113 12629 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:40.757956 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.754878 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.770982 12632 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.771339 13227 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:40.756356 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.700644 14972 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.701695 15025 consensus_queue.cc:1059] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:40.707149 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:40.798767 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 91710.3us
I20260709 12:24:40.708751 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.712502 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:40.800324 12703 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.653554 14913 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:24:40.726639 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.727563 12702 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.697539 15074 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.698266 15045 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.769888 12700 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:40.751664 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.752053 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:40.769827 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 75723.7us
I20260709 12:24:40.725121 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.726559 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:40.734799 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 104195us
I20260709 12:24:40.814970 12674 leader_election.cc:400] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:40.815239 12674 leader_election.cc:403] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:40.816555 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.817575 12627 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:40.718488 12626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:40.714565 12523 leader_election.cc:400] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
W20260709 12:24:40.819223 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 104856us
W20260709 12:24:40.713882 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51497.9us
I20260709 12:24:40.691962 12551 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:40.780078 12552 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:40.755285 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.800356 12554 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.730764 14923 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.764660 15076 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.721649 15037 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.843513 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.847057 15026 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:40.797910 14936 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.853823 14936 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.856122 14936 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.803359 14920 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.810412 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.726169 15010 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.823521 13232 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:40.830256 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.735052 15005 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.867826 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.833628 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.868671 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:40.834546 14656 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.803791 12708 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:40.704813 15047 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:40.735370 15048 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:40.871899 15048 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:40.840943 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 55252.1us
I20260709 12:24:40.887692 13198 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.858362 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.860057 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.889967 12634 raft_consensus.cc:2368] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
W20260709 12:24:40.890549 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.804040 12550 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:40.700690 15016 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
I20260709 12:24:40.801476 14897 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:40.805740 14737 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:40.864960 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 54658.1us
I20260709 12:24:40.868968 12625 raft_consensus.cc:2368] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:40.837028 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.841095 14923 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.864337 14445 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:40.927314 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:40.928009 12706 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:40.929184 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:40.934055 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:40.935562 12703 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:40.871073 14656 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.871620 14922 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.938022 14922 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:40.873564 15077 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 12:24:40.874248 12708 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:40.838973 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:40.877873 12552 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:40.882781 15074 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:40.884143 15013 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.893957 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:40.952477 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 113577us
I20260709 12:24:40.898057 12559 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:40.948381 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.926630 12632 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:40.938067 14656 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:40.872349 15079 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.213s
I20260709 12:24:40.939580 12705 raft_consensus.cc:2368] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:40.940237 12554 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:40.941694 12633 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:40.942054 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:40.887300 15036 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.933259 12627 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:40.973104 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.946259 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:40.887844 15073 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.951042 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.926483 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.898319 15045 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.960678 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.964341 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.979769 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:40.980296 12703 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.980634 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:40.899011 15005 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:40.903010 14778 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.068s
I20260709 12:24:40.974095 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.942185 14917 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:40.938855 14897 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:40.943473 14774 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.969484 15025 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:40.982697 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.864908 15076 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.983431 12631 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:40.983549 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.983767 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.004667 12632 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:40.887076 14920 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:40.956418 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:40.985638 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:40.987049 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:41.006435 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50165us
I20260709 12:24:40.988992 12706 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.007362 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.975140 14737 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:40.991670 15083 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:40.927023 14855 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:24:40.995302 15029 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:40.993538 15056 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:40.994241 14983 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:40.901441 15043 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:41.023516 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 70359.9us
I20260709 12:24:40.986064 15042 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:24:40.908545 15010 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:40.968498 14913 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:40.972239 15036 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:40.965706 14921 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:40.987771 14659 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:40.988118 15035 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:41.011696 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:40.992779 15052 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.016844 12703 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:40.978513 14876 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
I20260709 12:24:41.001672 15025 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:40.994691 12702 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.005708 14917 raft_consensus.cc:697] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:41.010316 14922 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.160218 12553 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:41.105611 15036 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.080358 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:41.081647 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 106772us
I20260709 12:24:41.081909 12671 leader_election.cc:400] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
W20260709 12:24:41.197818 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 116034us
I20260709 12:24:41.083395 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:41.198606 12671 leader_election.cc:400] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
W20260709 12:24:41.198922 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 117600us
I20260709 12:24:41.199373 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:41.090844 12706 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:24:41.200024 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:41.092170 12701 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:41.094331 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:40.978235 15048 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.005913 14774 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.093626 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:41.146534 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 134929us
I20260709 12:24:41.152320 12704 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:41.190747 14936 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:41.150895 15035 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.153091 15073 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:41.192682 14944 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.193241 15025 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.013082 15047 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.014024 15074 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:41.201252 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:41.202155 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:41.203190 13228 raft_consensus.cc:2410] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:41.205222 12631 raft_consensus.cc:2410] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:41.105319 14913 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.216737 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:41.105978 15049 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:24:41.202989 14876 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.204152 15052 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.223763 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:41.206063 14921 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:41.209295 15007 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.207370 15035 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.224668 15047 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:41.243907 15047 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.239972 14855 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:41.245319 14855 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:41.246140 14913 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.246212 14855 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.247357 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:41.248472 15045 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.249446 15070 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.250311 15070 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:41.261518 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 60111.2us
I20260709 12:24:41.215669 15073 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:41.217901 15074 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:41.264038 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 44931.2us
I20260709 12:24:41.225842 14922 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:41.210296 14936 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.268000 14917 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.268502 15043 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.266018 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:41.269495 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:41.270044 12631 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.272639 12634 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:41.258545 14983 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:41.205449 14897 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.261083 14923 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.276844 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:41.267403 15074 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.265625 15010 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.210278 15005 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.208822 14737 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.278698 13228 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:41.273667 15043 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:41.271123 14936 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.286257 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:41.287851 15007 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:41.288437 15007 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.291297 15010 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:41.279903 15085 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260709 12:24:41.264781 14876 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.276633 14921 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.275698 14922 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:41.308339 15043 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:41.308012 14920 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.302405 14921 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.310309 15076 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.313016 15099 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.326377 15070 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:41.331013 15098 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:41.331638 15091 log.cc:927] Time spent T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:24:41.332363 15043 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.332767 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.335122 12626 raft_consensus.cc:606] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:41.338168 15097 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:24:41.345453 12626 raft_consensus.cc:614] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:41.298066 15010 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.327646 14774 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.343966 15070 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.361048 15070 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.364557 14921 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.310513 15073 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.353300 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.366587 12628 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
W20260709 12:24:41.365391 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.368080 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:41.369038 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.371595 14445 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:41.371840 14876 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.372222 14445 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.372269 14922 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:41.373220 15089 log.cc:927] Time spent T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260709 12:24:41.374564 14445 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.375263 15010 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.377874 14983 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.342417 15099 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.393873 12631 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
W20260709 12:24:41.371719 15095 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:24:41.434931 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.435865 12628 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:41.425185 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:41.378342 14983 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.463841 12704 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
W20260709 12:24:41.642975 15109 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
I20260709 12:24:41.463244 15010 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.657872 12634 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:41.659204 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.659984 12634 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:41.621224 14921 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.664597 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:41.670660 12634 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:41.655095 15076 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.687569 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:41.685674 15102 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:24:41.692891 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:41.686486 15045 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.655360 15010 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.701190 15099 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.683573 15025 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.708560 13226 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:41.709079 15010 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.693012 15076 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.684317 14921 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.707031 15045 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.686905 14855 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.693583 14737 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.709542 15025 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.723387 15076 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.725888 14921 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.783376 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1936) took 1197 ms. Trace:
I20260709 12:24:41.783938 12553 rpcz_store.cc:276] 0709 12:24:40.586146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.681181 (+ 95035us) service_pool.cc:224] Handling call
0709 12:24:40.683086 (+  1905us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.200075 (+516989us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.783041 (+582966us) spinlock_profiling.cc:243] Waited 423 ms on lock 0x7b54001d24d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:41.783291 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":972259200}
I20260709 12:24:41.720463 14855 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.719461 14737 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.796993 14983 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:41.806847 15045 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:41.810261 15035 consensus_meta.cc:287] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.544s	user 0.003s	sys 0.006s
I20260709 12:24:41.810940 15035 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.811920 13227 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.812268 14855 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:41.813100 15074 consensus_meta.cc:287] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260709 12:24:41.814332 14737 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.813679 15074 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.810328 14847 raft_consensus.cc:3055] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:41.805250 15106 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:41.818681 13227 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
W20260709 12:24:41.815858 15036 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.606s	user 0.008s	sys 0.003s
I20260709 12:24:41.816588 14847 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:41.834079 15006 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.826803 15036 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.838519 14855 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.838100 15006 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.841028 15073 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.843804 14855 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.851264 15074 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.852989 15006 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.853466 15036 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.847586 15073 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.859076 15035 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.863802 14855 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.844498 14847 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.870244 14847 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.873142 12630 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:41.874004 12630 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:41.861598 15006 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.876405 12630 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.878995 12630 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.882072 12598 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:41.883500 15096 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.592s	user 0.002s	sys 0.009s
I20260709 12:24:41.884028 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:41.885968 14774 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:41.888224 14864 consensus_queue.cc:1059] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.888756 14659 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:41.889186 15048 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.889418 14864 raft_consensus.cc:3055] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:41.886622 15079 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.889938 14864 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:41.890918 14864 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.894100 14931 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.892419 14864 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.895740 12631 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:41.896384 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2133) took 1045 ms. Trace:
I20260709 12:24:41.896695 12631 rpcz_store.cc:276] 0709 12:24:40.851111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.895080 (+1043969us) service_pool.cc:224] Handling call
0709 12:24:41.895402 (+   322us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.896133 (+   731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.896329 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:41.880180 15006 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.898186 12631 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:24:41.899526 15006 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.913316 12630 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:24:41.913775 12630 pending_rounds.cc:85] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 2
I20260709 12:24:41.932060 15073 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.916428 15006 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:41.935153 15006 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:41.942158 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1648) took 1048 ms. Trace:
I20260709 12:24:41.942575 12701 rpcz_store.cc:276] 0709 12:24:40.893696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.948160 (+ 54464us) service_pool.cc:224] Handling call
0709 12:24:41.941932 (+993772us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b5400129654. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:41.942088 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125674240}
I20260709 12:24:41.947230 15006 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:41.951943 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:41.914011 12630 pending_rounds.cc:107] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:24:41.953719 12630 raft_consensus.cc:2889] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:41.954972 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.951905 12597 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:41.956979 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:41.964731 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:41.966024 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:41.963208 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:41.968232 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:41.968205 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:41.976922 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:41.977501 13226 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:41.977624 13228 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:41.962487 15118 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:41.982090 15118 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:41.982439 15118 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:41.962711 14737 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:24:41.972584 12702 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:41.986637 13234 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:41.965503 15079 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.996618 14737 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:41.999205 14737 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:41.998487 15007 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:41.961969 14774 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:42.002012 14737 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:42.002108 14774 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.020081 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:43778 (request call id 24) took 1301 ms. Trace:
I20260709 12:24:42.020550 12626 rpcz_store.cc:276] 0709 12:24:40.718187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.718360 (+   173us) service_pool.cc:224] Handling call
0709 12:24:42.019875 (+1301515us) spinlock_profiling.cc:243] Waited 516 ms on lock 0x7b5400371254. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94ae5853 00007f0e99ab360a 00007f0e930397d4 00007f0e93039762 00007f0e93039691 00007f0e9303960c 00007f0e930388c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:42.019989 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1187748096}
I20260709 12:24:42.030229 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.036405 12704 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:42.036909 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.037153 12706 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:42.031248 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.038790 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 408) took 1259 ms. Trace:
I20260709 12:24:42.039147 12699 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:42.039191 12707 rpcz_store.cc:276] 0709 12:24:40.779365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.788313 (+  8948us) service_pool.cc:224] Handling call
0709 12:24:40.788642 (+   329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:40.955308 (+166666us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:40.955363 (+    55us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:40.955429 (+    66us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:40.955506 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.038570 (+1083064us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54003c6ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:42.038620 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.038736 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":382662016}
I20260709 12:24:42.041999 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1940) took 1225 ms. Trace:
I20260709 12:24:42.042411 12550 rpcz_store.cc:276] 0709 12:24:40.816079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.898684 (+ 82605us) service_pool.cc:224] Handling call
0709 12:24:40.898986 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.014113 (+115127us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.014146 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:41.014182 (+    36us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:41.014215 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.041773 (+1027558us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400298454. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:42.041822 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.041946 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":243897728}
I20260709 12:24:42.047434 13233 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:42.049896 14659 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:42.050355 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.051004 14659 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:42.051379 14659 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:42.048384 15045 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.052587 15035 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:42.052402 15045 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.053102 15035 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.057929 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:42.058866 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:42.059367 15040 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.063687 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:42.068157 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:42.074107 15074 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.074528 15074 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.068470 15006 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.074857 15074 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.075048 15006 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.075516 15006 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.080289 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.082888 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:42.083621 12630 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:42.052136 14659 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.072993 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:42.087502 12626 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:42.089537 14897 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:42.236267 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:42.145064 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.238090 12633 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
W20260709 12:24:42.191474 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.239490 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 114464us
I20260709 12:24:42.239957 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:42.240599 12705 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 400) took 1514 ms (client timeout 1751 ms). Trace:
I20260709 12:24:42.241341 12702 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260709 12:24:42.241055 12705 rpcz_store.cc:269] 0709 12:24:40.726157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.726290 (+   133us) service_pool.cc:224] Handling call
0709 12:24:42.240316 (+1514026us) spinlock_profiling.cc:243] Waited 126 ms on lock 0x7b54003ea8d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:42.240470 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":289271680}
W20260709 12:24:42.243280 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 246456us
I20260709 12:24:42.241514 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.246548 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2143) took 1053 ms. Trace:
I20260709 12:24:42.248885 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:42.079329 15119 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:42.262755 12625 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:42.258338 12628 rpcz_store.cc:276] 0709 12:24:41.190646 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.684125 (+493479us) service_pool.cc:224] Handling call
0709 12:24:41.691753 (+  7628us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:41.691896 (+   143us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:41.697084 (+  5188us) log.cc:844] Serialized 14 byte log entry
0709 12:24:41.945389 (+248305us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b1800411880. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:24:41.985611 (+ 40222us) log.cc:844] Serialized 14 byte log entry
0709 12:24:42.244078 (+258467us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.244129 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:42.244175 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.244242 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.244341 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10155,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":67,"raft.queue_time_us":10001,"raft.run_cpu_time_us":221,"raft.run_wall_time_us":10923,"spinlock_wait_cycles":29804800,"thread_start_us":289363,"threads_started":2,"wal-append.queue_time_us":299972}
I20260709 12:24:42.269798 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.070775 15068 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.168s
I20260709 12:24:42.270536 12703 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:42.087229 14737 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:42.280562 12703 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:42.280895 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:42.282680 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.283824 12703 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:42.285470 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.286309 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:42.287257 13231 raft_consensus.cc:2410] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:42.289930 15043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.004s	sys 0.010s
W20260709 12:24:42.290412 15043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.004s	sys 0.010s
I20260709 12:24:42.294942 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.152697 15007 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.297528 12704 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:42.069644 15040 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.235832 15048 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:42.245095 15073 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:42.264153 14596 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.307753 13229 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:42.139918 15020 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.151s
I20260709 12:24:42.263367 14855 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:42.296322 14897 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:42.268134 15119 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:42.271041 14659 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.398388 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.383570 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.264016 15036 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.135s
I20260709 12:24:42.462158 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 656) took 1445 ms. Trace:
I20260709 12:24:42.291077 14847 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.117s
I20260709 12:24:42.462592 13227 rpcz_store.cc:276] 0709 12:24:41.016523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.016783 (+   260us) service_pool.cc:224] Handling call
0709 12:24:42.461990 (+1445207us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b5400510c54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:42.462096 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1413334400}
I20260709 12:24:42.465795 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:42.402015 14917 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.399343 14922 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.458788 15119 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:42.471700 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:42.401877 14596 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:42.494043 12701 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:42.398766 15048 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.457942 14855 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.495900 14897 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.383931 15007 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:42.498989 15128 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:24:42.501511 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2137) took 1649 ms. Trace:
I20260709 12:24:42.506449 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.467444 14774 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.382715 14737 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.543979 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.494968 15068 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.467610 15055 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.547996 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:42.548568 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.550474 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:42.563465 12633 raft_consensus.cc:2368] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:42.551040 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.553023 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.553156 12550 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:42.512775 14596 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.567399 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:42.567669 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.568035 12559 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.549651 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.551785 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.547443 12630 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:42.555023 12631 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:42.556704 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.570768 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.571201 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.572120 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:42.572480 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:42.572793 12550 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:42.404052 15073 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.576386 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.577014 12554 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:42.577579 12557 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:42.474156 15069 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.542292 12629 rpcz_store.cc:276] 0709 12:24:40.852161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.023793 (+1171632us) service_pool.cc:224] Handling call
0709 12:24:42.024165 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:42.024517 (+   352us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.024544 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:42.024981 (+   437us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.242854 (+217873us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:42.242894 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.242959 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.501275 (+258316us) raft_consensus.cc:1685] finished
0709 12:24:42.501296 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.501448 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":254,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":102,"thread_start_us":217537,"threads_started":1,"wal-append.queue_time_us":268848}
I20260709 12:24:42.568341 12553 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:42.574051 13198 leader_election.cc:400] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:42.585019 13198 leader_election.cc:403] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:42.585130 12628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:42.569177 12551 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:42.585707 12628 raft_consensus.cc:606] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:42.585826 12632 raft_consensus.cc:2410] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:42.546065 14864 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:42.591092 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.502128 14917 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.599092 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.600888 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.512673 14922 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.578400 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.546814 15099 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:42.576027 15131 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.582337 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:42.639467 12555 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:42.584614 14847 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.562896 14774 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:42.717522 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 135262us
I20260709 12:24:42.743871 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:42.596135 14931 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:42.721395 12554 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:42.716931 14921 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:42.740419 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.740552 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.633790 15043 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.568908 15055 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.751914 12627 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:42.568414 15068 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.760203 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.596767 15032 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.152s
I20260709 12:24:42.762634 12627 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:42.609220 14864 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.595566 15069 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.749182 15036 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.780200 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.753585 14921 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.789312 12559 raft_consensus.cc:2410] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:42.748147 15099 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:42.768224 15076 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.046s	sys 0.088s
I20260709 12:24:42.772732 14983 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.829492 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:42.845515 14855 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:42.846932 15127 log.cc:927] Time spent T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:24:42.783277 15139 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.830390 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.849678 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:42.851471 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.741993 15131 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:42.787658 15137 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.817953 15121 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.799624 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:42.862758 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 117464us
I20260709 12:24:42.878965 12559 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:42.862685 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.880120 12631 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:42.751250 15043 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.824364 15066 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:42.832855 15076 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.047s	sys 0.089s
W20260709 12:24:42.867751 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.873624 15048 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:42.874493 15045 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:42.876012 15055 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:42.864037 15139 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.879191 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:42.908032 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 339861us
I20260709 12:24:42.909801 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:42.835517 15056 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:42.920532 15122 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
I20260709 12:24:42.921599 15141 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:42.923256 12626 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 12:24:42.924484 15130 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:24:42.924652 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:42.925230 15124 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
W20260709 12:24:42.930565 13232 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.665s	user 0.006s	sys 0.003s
I20260709 12:24:42.934216 15142 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:42.934645 15068 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:42.869083 14847 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260709 12:24:42.943225 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 64071.7us
I20260709 12:24:42.934929 15055 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.886611 14855 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.947649 12633 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:42.945290 12552 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:42.950675 13232 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
W20260709 12:24:42.976132 13233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 649) took 2299 ms (client timeout 1736 ms). Trace:
I20260709 12:24:42.985486 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 667) took 1027 ms. Trace:
I20260709 12:24:42.983182 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:42.994220 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 165319us
I20260709 12:24:42.940802 15144 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.923287 15099 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:42.950050 15132 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:24:42.935451 15133 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:43.020344 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.031086 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.031591 13232 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:43.023602 13229 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:42.941021 15048 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:42.983525 15113 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 1.172s	user 0.000s	sys 0.018s
W20260709 12:24:42.999145 13233 rpcz_store.cc:269] 0709 12:24:40.676823 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:40.676970 (+   147us) service_pool.cc:224] Handling call
0709 12:24:42.975925 (+2298955us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b540080acd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:42.976038 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3146489600}
I20260709 12:24:42.999269 13235 rpcz_store.cc:276] 0709 12:24:41.957999 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.958204 (+   205us) service_pool.cc:224] Handling call
0709 12:24:41.978712 (+ 20508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.979021 (+   309us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.979037 (+    16us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.985550 (+  6513us) log.cc:844] Serialized 26 byte log entry
0709 12:24:42.263863 (+278313us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:42.263903 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:42.263975 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:42.985275 (+721300us) raft_consensus.cc:1685] finished
0709 12:24:42.985293 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:42.985430 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3269,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":267170,"threads_started":1,"wal-append.queue_time_us":577301}
W20260709 12:24:43.000031 14960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.006s
I20260709 12:24:42.953671 15138 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:42.986931 15006 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.911s	user 0.009s	sys 0.000s
I20260709 12:24:42.969846 15148 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:42.970216 14737 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:42.977975 15073 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:42.986783 15147 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.031984 12708 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:42.977808 14596 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:43.046788 14960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.009s	sys 0.006s
I20260709 12:24:42.888339 15137 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.974136 14921 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.034010 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:42.973495 14823 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.037554 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.063015 13227 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:43.017661 14855 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.017957 15055 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.977698 15136 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.051621 14917 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.025547 15032 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.053387 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:43.054854 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 143605us
W20260709 12:24:43.048559 15118 consensus_meta.cc:287] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.066s	user 0.008s	sys 0.005s
I20260709 12:24:42.974982 15043 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:42.993623 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:42.919306 15066 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.036628 15146 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:43.069911 15045 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:43.069325 13233 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:42.969916 15141 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.029588 15144 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.075169 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:42.903805 15121 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:42.999398 15142 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.039004 15048 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.081488 12600 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:43.068298 14922 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.038614 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.054880 15006 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.090521 14897 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.095237 15118 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:43.098112 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 104712us
I20260709 12:24:43.098836 14855 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.099776 15066 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:43.100584 14659 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
I20260709 12:24:43.100160 15146 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.076766 14864 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:43.069787 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 142462us
I20260709 12:24:43.167232 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:43.114995 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 121304us
I20260709 12:24:43.167717 15144 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.158820 14737 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.168792 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:43.169090 15119 consensus_meta.cc:287] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.628s	user 0.005s	sys 0.006s
I20260709 12:24:43.056104 15148 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.170274 14596 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:43.172257 15148 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.072263 14823 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.174880 15121 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.175078 15118 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.175662 14823 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.049787 15133 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.093746 15069 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.177618 15043 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.177737 15141 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.178112 15043 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.178373 14960 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:43.178617 15043 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.179082 14931 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.179638 14931 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.180014 15146 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:43.148887 15055 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.150089 15048 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.091396 15032 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.170324 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.182840 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:43.183233 15032 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:43.052537 15138 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.148046 15151 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.110261 15045 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.079187 15134 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:24:43.185611 15141 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.186192 15141 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:43.152038 15142 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.186587 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.145859 14922 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:43.153162 15137 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.142110 15131 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.130970 15068 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
W20260709 12:24:43.154759 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 73373.8us
I20260709 12:24:43.173574 15153 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:43.178812 15069 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:43.208264 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.185180 15138 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.064616 15147 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.187872 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:43.190249 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 119591us
I20260709 12:24:43.187898 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:43.187330 15045 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.178828 14960 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:43.199587 15146 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.158147 15139 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:43.202137 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 118506us
W20260709 12:24:43.189960 15074 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.003s
I20260709 12:24:43.241657 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.221839 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:43.242498 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 54713.6us
I20260709 12:24:43.243279 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.251482 13226 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:43.251794 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.204488 15055 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.200491 15020 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:43.202006 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:43.255689 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53765.9us
W20260709 12:24:43.213495 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 54563.3us
I20260709 12:24:43.210904 15137 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.260320 12523 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.262157 15073 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:43.263551 15115 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 1.452s	user 0.010s	sys 0.010s
I20260709 12:24:43.252976 14823 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.265197 14659 raft_consensus.cc:993] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:43.265288 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 513) took 1903 ms. Trace:
I20260709 12:24:43.268325 13199 leader_election.cc:400] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4.
I20260709 12:24:43.187289 15141 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.240783 15144 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.166081 14897 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.242982 15153 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:43.270035 15047 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.274101 14960 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.255112 15020 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:43.256388 15074 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.276582 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.244700 15138 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.220746 15142 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 12:24:43.298205 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.298774 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.271375 14823 raft_consensus.cc:1081] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:24:43.245891 15146 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:43.282280 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.314749 12522 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.289784 15144 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:43.284402 12551 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 8. (term mismatch)
W20260709 12:24:43.318265 12599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.011s	sys 0.020s
I20260709 12:24:43.285048 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.319059 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.285065 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.254779 15055 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.294874 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.295600 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.321161 12559 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:43.258659 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.199470 15119 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.301869 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.271016 14931 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:43.293078 15133 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.325433 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.302762 15161 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.291896 15048 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.289331 15047 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.264633 15152 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.094s
I20260709 12:24:43.295708 15139 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.305375 14897 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.305478 14774 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.406477 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.407903 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.409345 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.305780 15147 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.306883 15016 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.414251 15016 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.414717 15016 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.415113 15138 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:43.416414 15170 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.056s	user 0.000s	sys 0.005s
I20260709 12:24:43.324007 14855 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.324324 15055 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.307227 15153 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.309996 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:43.374612 15020 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.423592 15020 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:43.265800 12634 rpcz_store.cc:276] 0709 12:24:41.361869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.684442 (+322573us) service_pool.cc:224] Handling call
0709 12:24:41.684923 (+   481us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:41.688350 (+  3427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:41.688398 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:41.691410 (+  3012us) log.cc:844] Serialized 26 byte log entry
0709 12:24:41.770437 (+ 79027us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:41.770496 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:41.770599 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:43.240657 (+1470058us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:43.264960 (+ 24303us) raft_consensus.cc:1685] finished
0709 12:24:43.264981 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.265189 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1244,"raft.queue_time_us":3699,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":155,"spinlock_wait_cycles":8871680,"thread_start_us":57508,"threads_started":1,"wal-append.queue_time_us":114594}
I20260709 12:24:43.285758 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.425814 12550 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:43.318930 12551 pending_rounds.cc:85] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 7
W20260709 12:24:43.319114 12599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.011s	sys 0.020s
I20260709 12:24:43.426717 12551 pending_rounds.cc:107] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 12:24:43.427068 12551 raft_consensus.cc:2889] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:43.427524 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.267477 14864 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:43.290731 15137 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.325516 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.430622 12557 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:43.278230 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.431321 15137 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:43.431599 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 153451us
I20260709 12:24:43.432021 15137 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.330190 12553 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:43.432439 15043 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.432447 15137 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.433593 15137 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.318320 14960 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.434554 15074 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:43.316011 15146 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.437268 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.437783 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.438210 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.439170 15056 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.439539 15056 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.439849 15056 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:43.365450 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 114645us
I20260709 12:24:43.325088 14921 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260709 12:24:43.443087 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.443346 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.443742 12634 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:43.444512 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.444610 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.403752 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.457338 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.403281 15047 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.404343 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.367535 15119 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.405651 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.405929 15152 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:43.374425 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 55454.2us
I20260709 12:24:43.472577 12704 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.314823 15006 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.441124 14778 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.446134 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.479913 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.480541 12632 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:43.481366 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.481909 12632 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
W20260709 12:24:43.484999 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.449986 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.445277 12634 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:43.488750 12550 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:43.455914 12553 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:43.456439 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.460060 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.492779 12626 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 1.
I20260709 12:24:43.460729 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.324635 15144 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.469444 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.497874 12703 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:43.498106 12702 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:43.473683 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.476428 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.477322 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:43.499727 12704 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:43.446214 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.500535 12629 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:43.487083 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.496464 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.502345 12632 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:43.496662 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.497367 12631 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:43.499763 12555 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.478086 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.499788 12626 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.505209 13232 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:43.505774 13232 pending_rounds.cc:85] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 5
I20260709 12:24:43.506084 13232 pending_rounds.cc:107] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260709 12:24:43.506390 13232 raft_consensus.cc:2889] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:43.463744 15074 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:43.516613 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.514060 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.517920 12553 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:43.509087 12701 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:43.474072 12551 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38720
I20260709 12:24:43.461369 14897 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.513677 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.514746 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.514844 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.522971 12522 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:43.519455 12551 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:24:43.515509 12600 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.820s (SENT) [suppressed 7 similar messages]
I20260709 12:24:43.523614 12551 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.520854 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:43.525660 12631 raft_consensus.cc:2368] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6.
I20260709 12:24:43.474820 13230 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:43.527120 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.528035 12703 raft_consensus.cc:2393] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 2: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:43.528247 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.530319 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.530930 12550 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:43.528553 12558 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.531409 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.532984 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.536072 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.345615 15048 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.537045 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.529202 12631 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:43.535291 12522 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:43.540729 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.542913 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.508123 15136 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.514189 15138 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:43.542695 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.546756 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.553753 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.554167 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.554852 12632 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:43.556155 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.558342 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.558988 12702 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:43.559751 15099 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:43.563148 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.564963 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:43.565948 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.565990 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:43.567504 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.568120 12700 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:43.561328 15068 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.537039 15118 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.546373 14917 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:43.573611 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:43.575287 12632 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:43.547410 15138 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:43.578438 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:43.579452 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:43.580279 15173 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:43.580453 15166 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.580819 15169 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.580914 15157 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.581369 15162 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:43.585351 13198 leader_election.cc:400] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6.
I20260709 12:24:43.595396 13198 leader_election.cc:403] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:43.527689 14897 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.544039 15006 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:43.575064 14917 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:43.569634 14855 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 12:24:43.603907 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:43.605505 15035 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.575225 15136 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:43.577977 15118 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:43.588367 15131 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.593571 15032 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:43.601049 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.580951 15048 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:43.571230 15148 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 12:24:43.587409 15138 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.576148 15068 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.632447 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1748) took 1169 ms. Trace:
I20260709 12:24:43.705822 12627 rpcz_store.cc:276] 0709 12:24:42.463178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.465476 (+  2298us) service_pool.cc:224] Handling call
0709 12:24:43.632277 (+1166801us) spinlock_profiling.cc:243] Waited 285 ms on lock 0x7b540025e9d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:43.632388 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":656267520}
I20260709 12:24:43.631888 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 523) took 1060 ms. Trace:
I20260709 12:24:43.707882 12555 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:43.707038 12630 rpcz_store.cc:276] 0709 12:24:42.571874 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.584976 (+ 13102us) service_pool.cc:224] Handling call
0709 12:24:42.640186 (+ 55210us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:42.823285 (+183099us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:42.823321 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:42.823370 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:42.823397 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.631629 (+808232us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400210cd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:43.631683 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:43.631826 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":420634496}
I20260709 12:24:43.684890 12626 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:24:43.699090 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:43.624150 14917 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:43.622978 14973 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:43.756497 12630 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:43.760762 12630 raft_consensus.cc:606] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:43.699330 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 98379.7us
I20260709 12:24:43.761466 12630 raft_consensus.cc:614] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:43.599726 15157 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.621600 15025 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.592617 15173 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.599560 15162 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.625344 14823 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:43.761842 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:43.769718 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.628334 15121 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:43.612455 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:43.756026 15140 log.cc:927] Time spent T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.799s	user 0.007s	sys 0.000s
I20260709 12:24:43.682291 12703 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:43.698190 15045 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.703953 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 141685us
W20260709 12:24:43.777984 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 165601us
I20260709 12:24:43.778295 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.771443 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.767906 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.594484 15169 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.594753 15166 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.777617 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2148) took 1697 ms. Trace:
I20260709 12:24:43.779722 12625 rpcz_store.cc:276] 0709 12:24:42.079868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.080049 (+   181us) service_pool.cc:224] Handling call
0709 12:24:43.777437 (+1697388us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b540043eed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:43.777557 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":418157952}
I20260709 12:24:43.780282 12674 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:43.781355 12625 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:43.775025 14921 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.786242 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:43.786352 12625 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:43.778901 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.626205 15131 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.703238 15035 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.636180 15137 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.760552 14973 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:43.732975 15153 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:43.777070 14823 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:43.801455 15176 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260709 12:24:43.772018 15016 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.788828 14921 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.832262 12523 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:43.833572 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.775246 15032 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.793048 14922 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:43.772467 15036 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.792503 15035 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:43.704157 15074 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 12:24:43.792794 15079 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:43.827072 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48418.7us
I20260709 12:24:43.831162 12631 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:43.826195 14983 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:43.791360 15151 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.779649 15121 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.838248 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.844549 13227 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:43.609383 15056 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:43.792241 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 233366us
I20260709 12:24:43.836066 12551 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:43.789016 15045 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.848503 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:43.842124 15006 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:43.842712 15073 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:43.837811 14737 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.841017 15032 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.842315 14922 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:43.879453 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 97660.2us
I20260709 12:24:43.840236 15177 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.846040 15035 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.884245 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.849898 14897 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:43.892242 15151 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.892608 15151 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:43.892989 15151 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.885833 12699 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:43.850487 15079 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.895474 15079 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:43.859592 14983 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.899027 14983 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.861155 12558 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:43.846593 15180 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:43.878832 15139 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:43.910367 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:43.879653 15006 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:43.937315 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:43.859457 15055 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.940985 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.888808 15032 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:43.925984 15178 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
W20260709 12:24:43.927054 15179 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:24:43.935911 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:43.924100 15165 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.902061 14922 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.941676 13235 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:43.956328 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.906647 15180 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:43.928944 15079 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.891211 15177 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:24:43.943257 15006 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.888320 14774 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:24:43.948598 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:43.840898 15153 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:43.978122 12551 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.948695 15068 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:43.972698 15074 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.013441 14921 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.014415 15016 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.009788 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:44.019694 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1753) took 1253 ms. Trace:
I20260709 12:24:43.934260 14973 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.021579 14973 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:44.027964 15188 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:24:43.979682 15137 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.033589 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:44.034507 15055 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.034765 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:44.035362 13229 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:44.036180 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:44.036710 15020 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.004s
I20260709 12:24:44.037358 15173 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.037926 15169 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.037979 14983 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.040144 15079 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.040459 14983 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.041014 15079 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.041899 15131 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.042460 15131 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.042526 15035 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.042971 15131 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.044916 15035 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.045024 15131 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.046051 12702 raft_consensus.cc:2410] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:24:44.046470 12706 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.046852 15153 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.047706 15056 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.047564 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:44.013609 15183 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:43.973557 15180 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:44.051162 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 831913us
I20260709 12:24:44.029443 15166 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:44.094019 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 214866us
I20260709 12:24:44.095148 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:44.095870 12551 raft_consensus.cc:2376] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5. Re-sending same reply.
I20260709 12:24:44.056448 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:44.058264 15148 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:44.110659 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.111634 12555 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:44.058871 14823 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.060779 15025 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6.
I20260709 12:24:44.061739 15162 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.061475 15079 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.062601 15121 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.063162 15007 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.063344 15169 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:44.064131 15043 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:44.071461 15047 consensus_meta.cc:287] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.595s	user 0.006s	sys 0.004s
I20260709 12:24:44.161818 15047 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:44.072837 15146 consensus_meta.cc:287] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.635s	user 0.010s	sys 0.000s
I20260709 12:24:44.012315 15068 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:44.178164 14922 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.180096 15032 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.180567 14922 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.182704 15006 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.184917 15006 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.185115 15031 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:44.185756 15031 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.152562 14960 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:44.103802 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.105147 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.188925 12556 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:44.112555 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.020118 12628 rpcz_store.cc:276] 0709 12:24:42.767029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.767296 (+   267us) service_pool.cc:224] Handling call
0709 12:24:43.030976 (+263680us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.031178 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:43.047363 (+ 16185us) log.cc:844] Serialized 14 byte log entry
0709 12:24:43.155833 (+108470us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.155881 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:43.155922 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:43.155987 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.019533 (+863546us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b540025d0d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:44.019634 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":16330,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":33,"raft.queue_time_us":12941,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":605593472,"thread_start_us":108164,"threads_started":1,"wal-append.queue_time_us":126221}
W20260709 12:24:44.115411 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 59055us
I20260709 12:24:44.189936 12522 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:44.190100 12558 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.118337 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:44.190706 12555 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:44.114166 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 221364us
I20260709 12:24:44.119628 15055 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:44.133932 15056 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:44.149159 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:44.097086 15183 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:44.148729 15144 consensus_meta.cc:287] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.002s
I20260709 12:24:44.165020 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:44.174937 15146 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.167301 15162 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:44.176190 13230 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:44.147367 14921 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:44.073522 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 182940us
I20260709 12:24:44.119266 15139 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:44.147607 15016 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.117620 15148 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.191111 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:44.660322 12628 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.153482 14917 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.661638 15055 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.662142 15146 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.182721 15073 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:44.674232 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.674657 15073 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.676093 15056 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.274302 15035 consensus_queue.cc:1059] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.389s
W20260709 12:24:44.331949 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 413921us
I20260709 12:24:44.663661 14917 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.187353 15138 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.664157 15183 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.382561 15040 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.678182 12628 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:44.678375 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:44.218145 12555 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:44.664949 15016 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.187855 15031 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.279026 15032 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.662874 15139 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.666950 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:44.683595 12631 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.195664 12627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:44.684612 12627 raft_consensus.cc:606] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:44.685550 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 342247us
W20260709 12:24:44.685719 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 520744us
I20260709 12:24:44.687460 15148 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.688122 15031 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.688588 15031 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.689518 15138 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.690640 15031 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.691213 15031 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.691491 14960 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:44.692049 14960 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:44.291141 15006 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:44.668879 15144 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.224663 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:44.332722 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 371135us
I20260709 12:24:44.670737 12552 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:44.719545 12597 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:44.662887 15162 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.178227 15151 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.215181 15079 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.232959 13232 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:44.676821 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:44.680588 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:44.747673 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 65421us
I20260709 12:24:44.213838 13231 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:44.694095 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.765751 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:44.679386 15047 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.748553 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:44.772298 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:44.717173 15006 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.722306 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:44.966192 15016 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:44.782236 12557 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:44.971865 15193 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:44.944731 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.972994 15146 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.973551 15146 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.975991 15146 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:44.973526 15141 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260709 12:24:44.976964 15043 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:44.978446 15043 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.825505 15194 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.980497 15043 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:44.944242 15180 consensus_meta.cc:287] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.831s	user 0.008s	sys 0.000s
I20260709 12:24:44.946199 15056 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.944942 15040 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:44.747077 14741 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:44.983807 15040 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.984601 14741 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.941377 15200 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.987043 15200 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:44.989915 15200 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:44.982914 15180 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:44.994817 15180 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:44.835062 15202 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260709 12:24:44.792834 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:44.723485 14973 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.996568 15055 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:44.798740 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 50288.4us
I20260709 12:24:44.997323 15006 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.824955 15199 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:44.778165 14774 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:44.972981 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 250775us
I20260709 12:24:45.004367 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:45.013513 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 335179us
W20260709 12:24:45.014988 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 790378us
W20260709 12:24:44.728021 15076 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.015s	sys 0.018s
W20260709 12:24:44.966964 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 247529us
I20260709 12:24:44.867590 12631 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:24:45.022516 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 336200us
I20260709 12:24:45.023999 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.080420 12550 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:45.031416 12557 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:44.970988 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:45.082207 12552 raft_consensus.cc:2368] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:24:45.032657 12708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:58482
I20260709 12:24:45.017553 15193 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.082525 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:45.083045 12708 raft_consensus.cc:606] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:45.083865 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:45.027391 15200 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.088626 12708 raft_consensus.cc:614] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:45.089521 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:45.089823 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:45.101377 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 61627.2us
I20260709 12:24:45.103153 12550 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:45.099269 13201 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:45.103874 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:45.107412 12522 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:45.114522 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:45.110338 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 601) took 1001 ms. Trace:
I20260709 12:24:45.115659 12553 rpcz_store.cc:276] 0709 12:24:44.108799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.108941 (+   142us) service_pool.cc:224] Handling call
0709 12:24:44.109264 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.673548 (+564284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.673592 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.673648 (+    56us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.673692 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.110027 (+436335us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b54001d0bd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:45.110093 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.110258 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1297198464}
I20260709 12:24:45.117753 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.118544 12553 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:45.119791 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.121963 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.121543 15200 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.122725 12625 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:45.124509 15047 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:45.125082 15047 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.125442 15047 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.125315 15200 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:45.121176 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:45.127295 12553 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:45.128584 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.146032 15040 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:45.147325 15162 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:45.148581 15144 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.111479 15193 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.111842 14917 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.153097 14917 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:45.153622 14917 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.157557 14922 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:45.158219 14922 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.158696 14922 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.080217 15016 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:45.084380 15076 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.020s	sys 0.025s
I20260709 12:24:45.163771 15157 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:45.169031 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.169727 12627 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:45.169762 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.171439 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:45.172118 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 64828.8us
I20260709 12:24:44.826046 15196 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.297s
I20260709 12:24:45.174010 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:45.174098 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.175424 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.181478 15180 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:45.181907 15209 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:45.182032 15180 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:45.181959 15055 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:45.183372 15055 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:45.183089 15180 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.183822 15055 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.176059 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.184911 12628 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.185863 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.171525 15056 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:45.187142 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.080729 15199 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:45.176357 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.193957 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.194804 13227 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:45.197207 12552 raft_consensus.cc:2410] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:45.177543 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.177798 12627 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:45.193262 12628 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:45.187805 13229 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:45.220237 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:45.035445 14973 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.165731 14864 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:45.152422 15193 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.223788 12674 leader_election.cc:400] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:24:45.226951 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.193928 15144 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.240446 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.241901 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.243000 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.250136 12627 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:45.251462 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.244539 12674 leader_election.cc:403] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:24:45.223435 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.244796 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.245833 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.242615 15040 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:45.247689 14960 consensus_meta.cc:287] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.555s	user 0.012s	sys 0.000s
I20260709 12:24:45.247869 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:24:45.237316 15073 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 12:24:45.252318 12628 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:45.257762 12552 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:45.255946 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 707) took 1293 ms. Trace:
I20260709 12:24:45.261102 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.260057 12674 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:45.257509 12633 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:45.261102 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.220680 15043 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.043s
I20260709 12:24:45.263170 12706 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:45.260900 15200 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.264006 12550 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:45.261983 13234 rpcz_store.cc:276] 0709 12:24:43.958133 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.958306 (+   173us) service_pool.cc:224] Handling call
0709 12:24:43.958634 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:43.973618 (+ 14984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.973663 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.002234 (+ 28571us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.218696 (+216462us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:44.218752 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.218842 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.251044 (+1032202us) raft_consensus.cc:1685] finished
0709 12:24:45.251071 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.251227 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16035,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":13204,"thread_start_us":155487,"threads_started":1,"wal-append.queue_time_us":711748}
I20260709 12:24:45.264746 15118 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.258862 15040 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.265872 15040 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.267266 12550 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:45.248540 14864 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:45.269948 15203 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260709 12:24:45.270624 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 688) took 1239 ms. Trace:
I20260709 12:24:45.223824 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.271034 13230 rpcz_store.cc:276] 0709 12:24:44.031673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.041282 (+  9609us) service_pool.cc:224] Handling call
0709 12:24:45.270423 (+1229141us) spinlock_profiling.cc:243] Waited 70.9 ms on lock 0x7b540054e054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:45.270564 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163091840}
I20260709 12:24:45.271456 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 685) took 1240 ms. Trace:
I20260709 12:24:45.272171 15194 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:45.272500 15183 consensus_meta.cc:287] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.594s	user 0.001s	sys 0.010s
I20260709 12:24:45.272631 15194 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:45.272935 15183 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.275202 15183 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:45.275816 15183 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.276232 15183 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.276701 15055 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.258225 12708 raft_consensus.cc:2393] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:45.269546 15073 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.278599 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 600) took 1172 ms. Trace:
I20260709 12:24:45.283411 12559 rpcz_store.cc:276] 0709 12:24:44.106393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.108451 (+  2058us) service_pool.cc:224] Handling call
0709 12:24:44.147810 (+ 39359us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.672809 (+524999us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.672853 (+    44us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.672907 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.672953 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.273237 (+600284us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54001d15d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:45.273279 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.273394 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206783232}
I20260709 12:24:45.279141 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.280939 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.285597 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.286670 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.287460 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.281334 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.289726 12628 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.271876 13235 rpcz_store.cc:276] 0709 12:24:44.030765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.055450 (+ 24685us) service_pool.cc:224] Handling call
0709 12:24:44.075593 (+ 20143us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.076054 (+   461us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.076095 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.076630 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.332366 (+255736us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.332427 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.332528 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.271249 (+938721us) raft_consensus.cc:1685] finished
0709 12:24:45.271273 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.271399 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1480,"raft.queue_time_us":98,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":9181,"thread_start_us":255342,"threads_started":1,"wal-append.queue_time_us":931272}
I20260709 12:24:45.219601 15162 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:45.215665 15056 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:45.295171 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.249727 15144 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.299605 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.304749 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.256991 14741 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.308288 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.312676 12708 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:45.313536 12553 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:45.225548 15148 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.071s
W20260709 12:24:45.310549 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 159218us
I20260709 12:24:45.315008 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:45.316474 12628 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:45.273068 15194 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.318956 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:45.320760 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.277503 14960 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.308955 15144 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.311142 15198 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.327546 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.328327 12708 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.322449 15035 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:45.307304 15056 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.310549 14917 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.326874 15210 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.320115 14922 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.357674 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 593) took 1255 ms. Trace:
I20260709 12:24:45.307593 15162 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.348884 14855 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:45.373821 12551 rpcz_store.cc:276] 0709 12:24:44.102076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.107844 (+  5768us) service_pool.cc:224] Handling call
0709 12:24:44.108153 (+   309us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.115314 (+  7161us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.115360 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.153956 (+ 38596us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.709034 (+555078us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:45.349535 (+640501us) log.cc:844] Serialized 14 byte log entry
0709 12:24:45.357304 (+  7769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.357393 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.357474 (+    81us) raft_consensus.cc:1685] finished
0709 12:24:45.357485 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.357614 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6728,"raft.queue_time_us":32457,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"thread_start_us":766228,"threads_started":2,"wal-append.queue_time_us":970429}
W20260709 12:24:45.388983 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 309025us
I20260709 12:24:45.313917 15199 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.363056 15035 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:45.370950 15210 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.400343 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.375746 15016 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:45.330858 15198 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.404654 12705 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.412081 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.376123 14864 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:45.419098 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 204644us
I20260709 12:24:45.429697 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:45.410109 15210 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.434950 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.416348 15209 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:45.393090 14855 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.456271 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.482892 12700 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:45.485929 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:45.490108 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.491776 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 180426us
I20260709 12:24:45.499419 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:45.500201 12700 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:45.500699 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.500969 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.501242 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.501749 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.502051 12551 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:45.502327 12557 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
W20260709 12:24:45.506017 12703 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1671) took 1969 ms (client timeout 1527 ms). Trace:
W20260709 12:24:45.506407 12703 rpcz_store.cc:269] 0709 12:24:43.536465 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.536895 (+   430us) service_pool.cc:224] Handling call
0709 12:24:45.505848 (+1968953us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54002a1054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:45.505958 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279131008}
I20260709 12:24:45.454377 15186 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:45.507387 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.508373 12559 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:45.555313 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.557361 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:45.574821 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.575877 13235 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:45.576081 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.577726 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.578181 12632 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:45.579871 12631 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:45.581032 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:45.580684 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.581794 12552 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:45.509953 12705 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:45.585559 12700 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:45.586376 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.587160 13235 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:45.486816 15183 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:45.557591 12557 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:45.594420 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:45.597852 12550 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.596899 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.595113 12631 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:45.599048 12705 raft_consensus.cc:2368] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3.
I20260709 12:24:45.600963 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 533) took 2028 ms. Trace:
I20260709 12:24:45.594306 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.601969 12634 rpcz_store.cc:276] 0709 12:24:43.573048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.582572 (+  9524us) service_pool.cc:224] Handling call
0709 12:24:43.597676 (+ 15104us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.815412 (+217736us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:43.815446 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:43.815494 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:43.815525 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.600677 (+1785152us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400116054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:45.600744 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.600894 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498499328}
I20260709 12:24:45.603718 12559 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:45.489674 15055 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.497318 15180 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.496605 15217 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.612586 15118 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:45.613803 14855 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:45.614485 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.617856 14922 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:45.569501 15016 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.584908 15147 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:45.624086 15066 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:45.627501 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.627701 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.628238 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.628310 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.658849 13229 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:45.659140 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 592) took 1564 ms. Trace:
I20260709 12:24:45.629477 12550 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:45.659579 12558 rpcz_store.cc:276] 0709 12:24:44.094650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.094788 (+   138us) service_pool.cc:224] Handling call
0709 12:24:44.095099 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.190499 (+ 95400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.658898 (+1468399us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54003502d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:45.659082 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":218060160}
W20260709 12:24:45.630455 15218 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:24:45.610589 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.556339 15148 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.670416 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.671104 13235 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:45.609164 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:45.638155 15180 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.642365 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:45.606346 15136 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.648885 12708 raft_consensus.cc:2410] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:45.647507 15055 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:45.656386 13228 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:45.689049 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.688498 15055 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:45.689939 15221 log.cc:927] Time spent T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:24:45.604744 15048 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:45.661477 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:45.662461 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:45.734695 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 73364us
I20260709 12:24:45.735203 12634 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:45.588452 15186 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.572794 15213 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:45.609784 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.740655 12631 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.640940 14960 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.504835 15035 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.679593 12552 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:45.683797 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.658183 15066 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:45.744246 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:45.745010 12708 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:45.745870 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.650563 12632 raft_consensus.cc:2368] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6.
I20260709 12:24:45.747108 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.747711 12632 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:45.684427 12704 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:45.748138 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.684608 15011 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:45.648289 15217 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.684685 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:45.684427 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.677398 13230 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:45.686746 15136 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.687808 14917 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:45.655556 15056 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:45.803598 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:45.667852 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:45.660883 15147 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.683640 15180 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.734114 15048 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:45.768179 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:45.769043 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 189197us
I20260709 12:24:45.799708 12708 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.607674 15209 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:45.710482 15231 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:45.681133 15148 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:45.860922 12634 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:45.809322 12631 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:24:46.009950 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:45.742719 14864 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:46.005618 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:45.861338 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:46.012472 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 244414us
I20260709 12:24:45.965356 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:46.012307 12632 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:46.158377 13229 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:46.159010 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:46.173730 12551 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.095s	sys 0.089s
W20260709 12:24:46.174371 12551 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.095s	sys 0.089s
W20260709 12:24:45.799692 15218 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
W20260709 12:24:45.866761 15233 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 12:24:46.228276 13228 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.538s	user 0.008s	sys 0.000s
W20260709 12:24:45.866173 15227 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:24:46.230736 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.238030 12701 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:24:45.804247 15138 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:45.861052 15223 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:24:46.233145 13228 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:45.823372 15147 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:46.267541 15194 consensus_meta.cc:287] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.942s	user 0.007s	sys 0.001s
I20260709 12:24:46.268013 12708 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:46.268501 12625 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:45.861646 15198 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:46.189831 15232 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260709 12:24:46.162299 15219 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:46.343703 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.385849 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 542) took 1070 ms. Trace:
I20260709 12:24:45.797710 15011 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.403347 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.406026 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.407644 14864 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:46.407896 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:46.408640 15235 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:46.226819 15032 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.175s
I20260709 12:24:46.343267 15162 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.386521 12632 rpcz_store.cc:276] 0709 12:24:45.314527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.279517 (+964990us) service_pool.cc:224] Handling call
0709 12:24:46.384749 (+105232us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.384992 (+   243us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.385035 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:46.385098 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:46.385146 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.385224 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.385383 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:46.399164 12705 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.594s	user 0.016s	sys 0.002s
I20260709 12:24:46.463981 12705 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:46.161893 15231 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.427937 13229 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.432363 14864 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:46.434151 15222 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.696s	user 0.000s	sys 0.001s
W20260709 12:24:46.464967 15144 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.139s	user 0.012s	sys 0.000s
W20260709 12:24:46.465204 13230 consensus_meta.cc:287] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.505s	user 0.005s	sys 0.004s
I20260709 12:24:46.435817 15243 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:24:46.436612 15073 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.462509 15235 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.438964 15208 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:46.028133 15066 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.441570 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1974) took 1422 ms. Trace:
W20260709 12:24:46.445999 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 706) took 2498 ms (client timeout 1544 ms). Trace:
I20260709 12:24:46.446940 15139 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.393361 15011 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:45.751905 15213 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.358258 15194 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.450412 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1781) took 1164 ms. Trace:
I20260709 12:24:46.451272 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1733) took 1232 ms. Trace:
I20260709 12:24:46.423050 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:46.398231 15226 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.208s	user 0.000s	sys 0.000s
I20260709 12:24:46.378666 15219 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.424060 12625 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:46.477388 15242 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:46.513911 15242 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:46.514961 15242 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:46.457721 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 289220us
I20260709 12:24:46.449858 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:46.465080 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.236802 15056 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:46.502182 15235 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.398317 15136 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:46.471827 12455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 322) took 13205 ms (client timeout 15000 ms). Trace:
I20260709 12:24:46.560165 15056 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.562825 15056 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:46.558280 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.560676 12455 rpcz_store.cc:269] 0709 12:24:33.266280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:33.277106 (+ 10826us) service_pool.cc:224] Handling call
0709 12:24:46.471722 (+13194616us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:39.929287 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:40.047977 (+118690us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:40.048047 (+    70us) write_op.cc:435] Acquired schema lock
0709 12:24:40.048082 (+    35us) tablet.cc:662] Decoding operations
0709 12:24:40.049074 (+   992us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:40.049160 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:40.049194 (+    34us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:24:40.049937 (+   743us) tablet.cc:701] Row locks acquired
0709 12:24:40.049980 (+    43us) write_op.cc:260] PREPARE: finished
0709 12:24:40.050148 (+   168us) write_op.cc:270] Start()
0709 12:24:40.050302 (+   154us) write_op.cc:276] Timestamp: P: 1783599880050085 usec, L: 0
0709 12:24:40.050321 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:24:40.106702 (+ 56381us) log.cc:844] Serialized 3241 byte log entry
0709 12:24:40.346614 (+239912us) spinlock_profiling.cc:243] Waited 3.15 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:40.472808 (+126194us) op_driver.cc:464] REPLICATION: finished
0709 12:24:40.679499 (+206691us) write_op.cc:301] APPLY: starting
0709 12:24:40.746478 (+ 66979us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:40.746713 (+   235us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:40.746755 (+    42us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:40.747758 (+  1003us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:40.748060 (+   302us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:24:40.748105 (+    45us) write_op.cc:312] APPLY: finished
0709 12:24:40.748434 (+   329us) log.cc:844] Serialized 65 byte log entry
0709 12:24:40.829811 (+ 81377us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:40.861111 (+ 31300us) write_op.cc:454] Released schema lock
0709 12:24:40.892405 (+ 31294us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:40.994618 (+102213us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:40.994650 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87377,"reported_tablets":12,"spinlock_wait_cycles":11776,"child_traces":[["op",{"apply.queue_time_us":171538,"apply.run_cpu_time_us":3577,"apply.run_wall_time_us":326452,"num_ops":8,"prepare.queue_time_us":154981,"prepare.run_cpu_time_us":9679,"prepare.run_wall_time_us":277146,"raft.queue_time_us":64197,"raft.run_cpu_time_us":5537,"raft.run_wall_time_us":76202,"replication_time_us":422279,"spinlock_wait_cycles":7238400,"thread_start_us":212664,"threads_started":4,"wal-append.queue_time_us":54677,"wal-append.run_cpu_time_us":13626,"wal-append.run_wall_time_us":1585220}]]}
I20260709 12:24:46.564801 15146 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:24:46.567091 15146 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:46.567484 15146 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:46.475461 12456 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 3, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 3 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.401046 15055 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.400501 15048 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.568842 15048 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:46.515785 12699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1677) took 2817 ms (client timeout 1741 ms). Trace:
I20260709 12:24:46.572016 12456 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 3 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:46.573029 12699 rpcz_store.cc:269] 0709 12:24:43.698704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.698831 (+   127us) service_pool.cc:224] Handling call
0709 12:24:46.515449 (+2816618us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400420ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.515653 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":387760512}
W20260709 12:24:46.486692 15040 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.220s	user 0.011s	sys 0.000s
I20260709 12:24:46.480425 15148 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.481317 15217 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.538477 15169 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:46.591216 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:46.592085 12552 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:46.592558 15040 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.539022 12705 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:46.593036 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:46.488631 15047 consensus_meta.cc:287] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.362s	user 0.008s	sys 0.004s
I20260709 12:24:46.540150 13229 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:46.540258 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:46.598896 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 58721.8us
I20260709 12:24:46.541955 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:46.511307 15210 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.050s	user 0.009s	sys 0.000s
I20260709 12:24:46.522413 15045 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.547295 12628 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:46.626562 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:46.627151 12628 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.627282 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:46.628705 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:46.548046 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:46.492434 13232 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 704) took 2555 ms (client timeout 1589 ms). Trace:
I20260709 12:24:46.629801 12456 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 2, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 2 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:46.630932 13232 rpcz_store.cc:269] 0709 12:24:43.936913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.937049 (+   136us) service_pool.cc:224] Handling call
0709 12:24:46.492207 (+2555158us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54005b27d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.492344 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":489484032}
I20260709 12:24:46.494626 13230 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:46.497669 13228 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:46.498493 15243 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:46.494359 15144 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.499207 15231 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:46.499399 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2169) took 1304 ms. Trace:
I20260709 12:24:46.552983 15180 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:46.552032 15239 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260709 12:24:46.553342 15244 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:24:46.501204 12553 rpcz_store.cc:276] 0709 12:24:45.019668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.136846 (+117178us) service_pool.cc:224] Handling call
0709 12:24:45.137936 (+  1090us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.319467 (+181531us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.441293 (+1121826us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b540035f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:46.441501 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":403303680}
I20260709 12:24:46.682149 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.682585 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:46.501343 13231 rpcz_store.cc:269] 0709 12:24:43.947227 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.949476 (+  2249us) service_pool.cc:224] Handling call
0709 12:24:46.445763 (+2496287us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b540064fad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.445922 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":397602176}
I20260709 12:24:46.501080 15066 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.495666 15138 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:46.503888 15213 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:46.696580 12672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.007s	sys 0.035s
I20260709 12:24:46.504048 12633 rpcz_store.cc:276] 0709 12:24:45.286331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.288575 (+  2244us) service_pool.cc:224] Handling call
0709 12:24:45.288950 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.289214 (+   264us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.289251 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.294653 (+  5402us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.443310 (+148657us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:45.443353 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.443418 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.450086 (+1006668us) raft_consensus.cc:1685] finished
0709 12:24:46.450119 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.450330 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":112781,"threads_started":1,"wal-append.queue_time_us":268094}
W20260709 12:24:46.697189 12672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.007s	sys 0.035s
I20260709 12:24:46.506956 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 544) took 1017 ms. Trace:
I20260709 12:24:46.513229 15147 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.493125 15186 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.502977 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1941) took 1155 ms. Trace:
I20260709 12:24:46.504063 15194 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:46.536990 15242 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:46.475174 15006 consensus_meta.cc:287] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.394s	user 0.012s	sys 0.001s
I20260709 12:24:46.506697 15025 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:46.506235 15219 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:46.491698 15200 consensus_meta.cc:287] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.227s	user 0.009s	sys 0.002s
I20260709 12:24:46.507054 12630 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:46.718333 12630 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:46.506507 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1778) took 1225 ms. Trace:
I20260709 12:24:46.719276 12627 rpcz_store.cc:276] 0709 12:24:45.281186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.281383 (+   197us) service_pool.cc:224] Handling call
0709 12:24:45.281688 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.297147 (+ 15459us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.297181 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.304625 (+  7444us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.638938 (+334313us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:45.638976 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.639060 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.506296 (+867236us) raft_consensus.cc:1685] finished
0709 12:24:46.506315 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.506450 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15012,"raft.queue_time_us":15516,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8817,"thread_start_us":313261,"threads_started":1,"wal-append.queue_time_us":432138}
I20260709 12:24:46.506085 14973 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.575942 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:46.577178 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:46.724846 12557 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:46.726068 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:46.727198 12550 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:46.727408 12557 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 12:24:46.578444 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:46.578568 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:46.578981 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:46.731518 12559 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.574776 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.733691 12699 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:46.734687 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.580993 12701 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:46.736178 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.547324 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:46.588318 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:46.601900 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.738255 12705 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:46.738835 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1687) took 1104 ms. Trace:
I20260709 12:24:46.739208 12705 rpcz_store.cc:276] 0709 12:24:45.634280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.595859 (+961579us) service_pool.cc:224] Handling call
0709 12:24:46.738769 (+142910us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.619081 15210 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:46.741575 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 163209us
I20260709 12:24:46.742057 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 598) took 2627 ms. Trace:
W20260709 12:24:46.743705 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 155535us
I20260709 12:24:46.621613 15169 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:24:46.632095 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.640956 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.742600 12554 rpcz_store.cc:276] 0709 12:24:44.105769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.106506 (+   737us) service_pool.cc:224] Handling call
0709 12:24:44.106838 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.107196 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.107228 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.107699 (+   471us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.665575 (+1557876us) spinlock_profiling.cc:243] Waited 3.27 ms on lock 0x7b18004e0040. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b0d1 00007f0e94aa6a0f
0709 12:24:45.742351 (+ 76776us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:45.769591 (+ 27240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.769734 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.551378 (+781644us) spinlock_profiling.cc:243] Waited 17 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:46.731195 (+179817us) raft_consensus.cc:1685] finished
0709 12:24:46.731218 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.731357 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3074,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":7192,"spinlock_wait_cycles":46676096,"thread_start_us":76518,"threads_started":1,"wal-append.queue_time_us":2317688}
I20260709 12:24:46.649209 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1680) took 1146 ms. Trace:
I20260709 12:24:46.651580 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1685) took 1060 ms. Trace:
I20260709 12:24:46.750499 12708 rpcz_store.cc:276] 0709 12:24:45.591602 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.745638 (+154036us) service_pool.cc:224] Handling call
0709 12:24:46.651375 (+905737us) spinlock_profiling.cc:243] Waited 53.2 ms on lock 0x7b54003c6ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.651509 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122404608}
I20260709 12:24:46.632000 12456 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 3, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:46.617528 12522 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:46.751832 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 134442us
I20260709 12:24:46.500700 15208 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:46.658339 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.668219 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:46.757702 12632 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.676705 12628 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:46.758903 13201 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:46.759034 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:46.749591 12704 rpcz_store.cc:276] 0709 12:24:45.502668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.503764 (+  1096us) service_pool.cc:224] Handling call
0709 12:24:45.684254 (+180490us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.748753 (+ 64499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.648947 (+900194us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540042b150. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.649124 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":414441856}
I20260709 12:24:46.759601 12628 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:46.760375 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:46.654734 12629 rpcz_store.cc:276] 0709 12:24:45.194632 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.196244 (+  1612us) service_pool.cc:224] Handling call
0709 12:24:45.209710 (+ 13466us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.210306 (+   596us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.210343 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.210811 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.418611 (+207800us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:45.418644 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.418709 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.499132 (+1080423us) raft_consensus.cc:1685] finished
0709 12:24:46.499154 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.499334 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151,"raft.queue_time_us":964,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":26810,"thread_start_us":157294,"threads_started":1,"wal-append.queue_time_us":359476}
I20260709 12:24:46.683360 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.682228 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:46.689924 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:46.696729 12552 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:46.504216 12555 rpcz_store.cc:276] 0709 12:24:45.219328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.276892 (+ 57564us) service_pool.cc:224] Handling call
0709 12:24:45.277224 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.277600 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.277639 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.278091 (+   452us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.418331 (+140240us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:45.418370 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.418436 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.450982 (+1032546us) raft_consensus.cc:1685] finished
0709 12:24:46.451013 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.451184 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1462,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":13181,"thread_start_us":139936,"threads_started":1,"wal-append.queue_time_us":234673}
I20260709 12:24:46.505084 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.637045 15040 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:46.698482 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.764787 13228 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:46.699807 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:46.699394 12625 rpcz_store.cc:276] 0709 12:24:45.489320 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.345048 (+855728us) service_pool.cc:224] Handling call
0709 12:24:46.423828 (+ 78780us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.506712 (+ 82884us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.506904 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.648319 15243 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:46.785579 12630 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.786727 15076 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:46.654342 14774 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:46.786582 15243 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.787142 15076 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:46.787477 14774 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.787875 15243 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.704516 12702 rpcz_store.cc:276] 0709 12:24:45.347859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.348011 (+   152us) service_pool.cc:224] Handling call
0709 12:24:45.506137 (+158126us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.507364 (+  1227us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.507395 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.507853 (+   458us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.739340 (+231487us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:45.739394 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.739473 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.501726 (+762253us) raft_consensus.cc:1685] finished
0709 12:24:46.501746 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.502717 (+   971us) spinlock_profiling.cc:243] Waited 143 ms on lock 0x7b54002a1050. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.502911 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":123600,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":139,"spinlock_wait_cycles":329961728,"thread_start_us":134840,"threads_started":1,"wal-append.queue_time_us":920912}
W20260709 12:24:46.788414 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 106273us
I20260709 12:24:46.789034 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.706311 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1945) took 1274 ms. Trace:
I20260709 12:24:46.630193 15047 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.789791 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1686) took 1190 ms. Trace:
I20260709 12:24:46.708674 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:46.790171 15217 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.790794 15217 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.696697 15138 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:46.730005 12558 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:46.790143 12702 rpcz_store.cc:276] 0709 12:24:45.607028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.788778 (+1181750us) service_pool.cc:224] Handling call
0709 12:24:46.789717 (+   939us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.607295 15146 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.620980 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:46.706029 12671 connection.cc:256] RPC call timeout handler was delayed by -1.4328230959999928s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2202s for a response
W20260709 12:24:46.805131 12671 connection.cc:256] RPC call timeout handler was delayed by -1.2965422560000661s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19490000000000002s for a response
I20260709 12:24:46.744953 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:46.706364 15158 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:46.752013 12456 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 5, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:46.723694 15006 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.755712 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1683) took 1183 ms. Trace:
I20260709 12:24:46.752458 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:46.767441 15180 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.771036 14973 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:46.759625 15230 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:46.717873 15025 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:46.775446 15210 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.731518 15056 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:46.777020 15151 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.777680 15245 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:46.778143 15186 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:46.778276 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.730048 15200 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:24:46.828167 14823 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.828337 15048 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:46.782107 15144 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.782202 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.851727 12708 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:46.782460 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:46.782994 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.853806 12701 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:46.747187 15194 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:46.857117 12625 raft_consensus.cc:2410] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 4 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:46.783561 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.857890 12705 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:46.783730 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.858897 13232 raft_consensus.cc:2368] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:24:46.784747 15147 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:46.668949 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 716) took 1027 ms. Trace:
I20260709 12:24:46.787774 15076 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.841548 15230 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:46.792158 12557 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:46.793339 12630 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.793888 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:46.877755 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 83942.2us
I20260709 12:24:46.878124 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.878621 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.878751 12705 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:46.791635 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:46.796113 12559 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:46.796649 13226 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:46.879670 12629 raft_consensus.cc:2393] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:46.797117 12633 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:46.798066 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:46.848469 14823 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.761274 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:46.802212 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:46.791311 15047 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:46.809592 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:46.891808 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 89689.5us
I20260709 12:24:46.813628 12553 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:46.789557 12707 rpcz_store.cc:276] 0709 12:24:45.431483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.431682 (+   199us) service_pool.cc:224] Handling call
0709 12:24:45.432027 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.473173 (+ 41146us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.473526 (+   353us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.474082 (+   556us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.743640 (+269558us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:45.743691 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.743756 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.552748 (+808992us) spinlock_profiling.cc:243] Waited 27.1 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:46.697709 (+144961us) raft_consensus.cc:1685] finished
0709 12:24:46.697732 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.706218 (+  8486us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20037,"raft.queue_time_us":155083,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":13711,"spinlock_wait_cycles":62314240,"thread_start_us":214839,"threads_started":2,"wal-append.queue_time_us":931803}
I20260709 12:24:46.814646 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:46.791181 15217 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:46.815342 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 70458.9us
I20260709 12:24:46.898381 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.819466 12699 rpcz_store.cc:276] 0709 12:24:45.572343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.734392 (+1162049us) service_pool.cc:224] Handling call
0709 12:24:46.755632 (+ 21240us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.899968 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.824726 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.828266 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.834728 12632 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:46.901667 13229 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:46.835353 13233 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:24:46.836522 12551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.010s	sys 0.015s
I20260709 12:24:46.840262 12556 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:46.804339 15236 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:46.810170 15208 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:46.842428 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:46.759469 14960 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:46.847256 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:46.854954 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.856081 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 420004us
W20260709 12:24:46.859707 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 676) took 1675 ms (client timeout 2138 ms). Trace:
I20260709 12:24:46.856484 12706 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:46.862377 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.844156 14774 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:46.820160 15158 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.869503 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.869719 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.912300 12708 raft_consensus.cc:2410] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 5 because replica has last-logged OpId of term: 3 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
W20260709 12:24:46.849977 15016 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.102s	user 0.019s	sys 0.010s
I20260709 12:24:46.919968 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 715) took 1293 ms. Trace:
I20260709 12:24:46.880596 15043 raft_consensus.cc:2764] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 12:24:46.849887 15048 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:46.881685 12554 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:46.760375 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.925376 12633 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:46.883591 12628 raft_consensus.cc:2376] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5. Re-sending same reply.
I20260709 12:24:46.856745 15235 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:46.836288 14973 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:46.891736 15186 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:46.893481 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:46.896483 15121 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:46.819957 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 67566us
W20260709 12:24:46.919735 15016 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.173s	user 0.019s	sys 0.010s
I20260709 12:24:46.904632 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.904788 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.937548 12705 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:46.841672 15056 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:46.906405 13227 rpcz_store.cc:269] 0709 12:24:45.184038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.214691 (+ 30653us) service_pool.cc:224] Handling call
0709 12:24:46.859478 (+1644787us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540080acd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:46.859630 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3642549120}
I20260709 12:24:46.907784 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.939302 15196 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:46.939736 15196 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.940186 15196 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:46.908783 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.898505 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:46.942207 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.880957 15157 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:46.943526 15157 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:46.943676 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.910243 12630 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:46.944470 15157 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:46.945520 12630 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1780) took 1659 ms (client timeout 1602 ms). Trace:
I20260709 12:24:46.945657 14897 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:46.945817 15157 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.946251 14897 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:46.722851 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:46.883113 15147 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.916254 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1966) took 2235 ms. Trace:
I20260709 12:24:46.892508 14823 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.876237 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:46.928732 12704 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:46.928637 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:46.815454 12703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.183s	user 0.017s	sys 0.006s
W20260709 12:24:46.951169 12703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.319s	user 0.017s	sys 0.006s
I20260709 12:24:46.862987 13230 rpcz_store.cc:276] 0709 12:24:45.626743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.627442 (+   699us) service_pool.cc:224] Handling call
0709 12:24:46.654223 (+1026781us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:46.862311 15194 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.933729 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.933928 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:46.931747 15048 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.967903 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.897579 12629 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:46.934628 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:46.911763 15245 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:46.995338 14960 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:46.935282 12522 leader_election.cc:400] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6.
W20260709 12:24:46.902436 12551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.727s	user 0.010s	sys 0.015s
I20260709 12:24:46.909996 15236 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:47.002002 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:46.939962 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 130594us
I20260709 12:24:46.920976 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.939886 12597 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.072608 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.072973 12702 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:47.073331 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 133543us
I20260709 12:24:46.920364 13226 rpcz_store.cc:276] 0709 12:24:45.626373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.626878 (+   505us) service_pool.cc:224] Handling call
0709 12:24:45.627263 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.879840 (+1252577us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.919745 (+ 39905us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54006f68d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:46.919916 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677279104}
I20260709 12:24:47.074033 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:47.071321 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:46.947851 12556 rpcz_store.cc:276] 0709 12:24:44.681323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.683251 (+  1928us) service_pool.cc:224] Handling call
0709 12:24:44.683579 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.902700 (+2219121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.915956 (+ 13256us) spinlock_profiling.cc:243] Waited 2.16 s on lock 0x7b5400102554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:46.916184 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4959222528}
I20260709 12:24:46.947134 12627 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
W20260709 12:24:46.945902 12630 rpcz_store.cc:269] 0709 12:24:45.286079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.286459 (+   380us) service_pool.cc:224] Handling call
0709 12:24:46.506946 (+1220487us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54003032a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a62dc0 00007f0e94aeee18 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:46.785203 (+278257us) spinlock_profiling.cc:243] Waited 58.7 ms on lock 0x7b54003032a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a6906f 00007f0e94ae1f60 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2
0709 12:24:46.945369 (+160166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161116672}
I20260709 12:24:46.926762 14774 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:46.931066 15047 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:46.936857 15186 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:46.982614 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:46.947234 15213 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:46.994040 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:46.895793 15025 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.005604 12522 leader_election.cc:403] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:24:46.937999 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:47.012264 15121 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.064390 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:46.997951 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:46.922731 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 60433.8us
W20260709 12:24:47.076634 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.075845 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 154953us
W20260709 12:24:47.076109 12706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 1935) took 1798 ms (client timeout 2007 ms). Trace:
I20260709 12:24:47.002144 15245 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:47.095539 12629 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.008145 14960 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:46.965142 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:47.148782 12705 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 6
W20260709 12:24:47.142949 12706 rpcz_store.cc:269] 0709 12:24:45.277979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.278909 (+   930us) service_pool.cc:224] Handling call
0709 12:24:47.075937 (+1797028us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54002a1a54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:47.076050 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3613624064}
I20260709 12:24:46.998786 15230 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:47.155119 15025 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.156978 13234 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:47.076243 15242 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 12:24:47.117134 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:47.115097 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:47.259591 12701 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:47.260038 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1690) took 1581 ms. Trace:
I20260709 12:24:47.260325 12701 rpcz_store.cc:276] 0709 12:24:45.678854 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.063210 (+1384356us) service_pool.cc:224] Handling call
0709 12:24:47.259990 (+196780us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:47.117667 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 43706.7us
I20260709 12:24:47.261178 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:47.131685 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.262306 12597 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:46.953363 14922 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.121s
W20260709 12:24:47.138881 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 144936us
I20260709 12:24:47.140502 15213 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:47.143635 13199 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:47.140341 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:47.199988 15245 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:47.147336 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 212252us
I20260709 12:24:47.300228 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:47.009666 15006 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:47.075379 12559 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:47.176656 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 684) took 3146 ms. Trace:
W20260709 12:24:47.179196 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.197578 15144 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6.
W20260709 12:24:47.176605 15250 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.156s	user 0.000s	sys 0.000s
W20260709 12:24:47.119869 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.070261 15136 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:47.166088 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1783) took 1879 ms. Trace:
I20260709 12:24:47.427104 12634 rpcz_store.cc:276] 0709 12:24:45.286835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.158852 (+872017us) service_pool.cc:224] Handling call
0709 12:24:46.269640 (+110788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.421780 (+152140us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.421828 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.422464 (+   636us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.851206 (+428742us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:46.851241 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.851304 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.165897 (+314593us) raft_consensus.cc:1685] finished
0709 12:24:47.165916 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.166032 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":137289,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":111,"thread_start_us":428440,"threads_started":1,"wal-append.queue_time_us":572425}
I20260709 12:24:47.174162 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 1983) took 1667 ms. Trace:
I20260709 12:24:47.429018 12551 rpcz_store.cc:276] 0709 12:24:45.507095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.507964 (+   869us) service_pool.cc:224] Handling call
0709 12:24:45.508259 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.174867 (+666608us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.174914 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.175492 (+   578us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.005863 (+830371us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:47.005903 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.005969 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.173976 (+168007us) raft_consensus.cc:1685] finished
0709 12:24:47.173996 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.174109 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68934,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":11646,"thread_start_us":1496188,"threads_started":2,"wal-append.queue_time_us":941031}
I20260709 12:24:47.112708 15040 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:24:47.188194 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:47.158854 14960 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:47.171156 15254 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:24:47.195125 15158 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:47.172079 15258 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:24:47.456671 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1790) took 2008 ms. Trace:
W20260709 12:24:47.183106 15257 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:24:47.193576 15169 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:47.457170 12631 rpcz_store.cc:276] 0709 12:24:45.448786 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.233738 (+784952us) service_pool.cc:224] Handling call
0709 12:24:46.257141 (+ 23403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.408841 (+151700us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.408875 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.417641 (+  8766us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.797536 (+379895us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:46.797576 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.798092 (+   516us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.456423 (+658331us) raft_consensus.cc:1685] finished
0709 12:24:47.456450 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.456604 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":150360,"raft.queue_time_us":150702,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":379273,"threads_started":1,"wal-append.queue_time_us":493598}
I20260709 12:24:47.458530 15169 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.459122 15169 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.113201 15055 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.118256 15229 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:47.462076 15229 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:47.462637 15229 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:47.438153 15136 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.196810 15236 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:47.197430 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50923.2us
I20260709 12:24:47.465581 12708 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:47.468050 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1681) took 1963 ms. Trace:
I20260709 12:24:47.247332 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:47.076155 15068 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.188115 14823 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:47.139482 15198 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:24:47.444578 14973 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:47.135320 14864 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:47.472596 14864 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.472956 14864 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.254747 12702 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:47.475064 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:47.475364 12702 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:47.475904 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1689) took 1832 ms. Trace:
I20260709 12:24:47.476181 12702 rpcz_store.cc:276] 0709 12:24:45.643271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.474963 (+1831692us) service_pool.cc:224] Handling call
0709 12:24:47.475199 (+   236us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.475716 (+   517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.475860 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:47.170070 15252 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.203s	user 0.000s	sys 0.000s
I20260709 12:24:47.117715 14774 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:47.263484 12597 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.271433 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:47.100400 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:47.493513 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 393233us
I20260709 12:24:47.494341 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:47.139609 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:47.275043 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 131470us
I20260709 12:24:47.398830 15231 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:47.279173 14922 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:47.285564 15031 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:47.286746 12552 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:47.287772 12553 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:47.512676 12553 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:47.288328 15200 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:47.290905 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2166) took 2121 ms. Trace:
I20260709 12:24:47.515326 12626 rpcz_store.cc:276] 0709 12:24:45.169840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.171157 (+  1317us) service_pool.cc:224] Handling call
0709 12:24:47.290677 (+2119520us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b540043eed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:47.290827 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4610108800}
I20260709 12:24:47.292910 15146 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.345039 15194 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:47.356738 15217 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.299547 15213 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:47.266958 15048 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.389954 12629 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:47.381801 15036 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:47.256156 15246 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.074146 14897 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:47.270988 15121 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:47.415807 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 101216us
W20260709 12:24:47.421047 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.420653 13233 rpcz_store.cc:276] 0709 12:24:44.030446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.055513 (+ 25067us) service_pool.cc:224] Handling call
0709 12:24:46.447322 (+2391809us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.911502 (+464180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.175040 (+263538us) spinlock_profiling.cc:243] Waited 388 ms on lock 0x7b540064fad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:47.176409 (+  1369us) spinlock_profiling.cc:243] Waited 2.35 s on lock 0x7b540064fad0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:47.176558 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6305194112}
I20260709 12:24:47.537529 13232 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:47.421500 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:47.431907 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:47.423698 15180 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:47.429250 15230 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.446466 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:47.450495 12700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1692) took 1448 ms (client timeout 1631 ms). Trace:
I20260709 12:24:47.455084 15265 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:47.554486 12700 rpcz_store.cc:269] 0709 12:24:46.002283 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.504825 (+502542us) service_pool.cc:224] Handling call
0709 12:24:47.450255 (+945430us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54000fc3d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:47.450423 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1523533696}
I20260709 12:24:47.555953 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:47.468451 12708 rpcz_store.cc:276] 0709 12:24:45.506640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.467106 (+1960466us) service_pool.cc:224] Handling call
0709 12:24:47.467447 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.467646 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.467682 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.467734 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:47.467778 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.467873 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.467987 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.506429 15231 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:47.497632 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:47.560680 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 63138.2us
I20260709 12:24:47.277969 12705 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
W20260709 12:24:47.502485 15219 consensus_meta.cc:287] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.768s	user 0.005s	sys 0.005s
I20260709 12:24:47.462504 15186 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:47.505098 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1947) took 2001 ms. Trace:
W20260709 12:24:47.496942 15138 consensus_meta.cc:287] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.693s	user 0.009s	sys 0.001s
I20260709 12:24:47.505630 14774 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:47.508072 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 244645us
I20260709 12:24:47.589666 12703 rpcz_store.cc:276] 0709 12:24:45.503744 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.507364 (+  3620us) service_pool.cc:224] Handling call
0709 12:24:45.589045 (+ 81681us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.631093 (+ 42048us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.631125 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.631826 (+   701us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.951565 (+1319739us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:46.951612 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.951681 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:47.504845 (+553164us) raft_consensus.cc:1685] finished
0709 12:24:47.504871 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.505028 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":41630,"raft.queue_time_us":41806,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":1319179,"threads_started":1,"wal-append.queue_time_us":1341764}
I20260709 12:24:47.591162 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.427255 15056 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:47.508309 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 236941us
I20260709 12:24:47.509491 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1695) took 1046 ms. Trace:
I20260709 12:24:47.507717 14922 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:47.511724 14823 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:47.487840 15136 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:47.513545 12553 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.514971 15200 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:47.514775 15235 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.515139 15040 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.514473 15151 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.568464 15242 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.516480 15158 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:47.504509 15229 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:47.550586 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 118809us
W20260709 12:24:47.649156 12523 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.817s (SENT)
I20260709 12:24:47.558234 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1956) took 1089 ms. Trace:
I20260709 12:24:47.658923 12708 rpcz_store.cc:276] 0709 12:24:46.469373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.557097 (+1087724us) service_pool.cc:224] Handling call
0709 12:24:47.557568 (+   471us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.557799 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.557837 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.557892 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:47.557942 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.558014 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.558167 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.486292 12627 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:47.661178 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 437) took 1116 ms. Trace:
I20260709 12:24:47.593825 12702 rpcz_store.cc:276] 0709 12:24:46.462873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.476881 (+1014008us) service_pool.cc:224] Handling call
0709 12:24:47.508970 (+ 32089us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.509148 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.509172 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.509215 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:47.509245 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.509298 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.509397 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.662674 12702 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:47.663318 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 439) took 1118 ms. Trace:
I20260709 12:24:47.553894 15045 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260709 12:24:47.665076 12708 rpcz_store.cc:276] 0709 12:24:46.544393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.660173 (+1115780us) service_pool.cc:224] Handling call
0709 12:24:47.660553 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.660774 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.660811 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.660865 (+    54us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:47.660912 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.660981 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.661112 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.602419 15066 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.636281 12553 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:47.560051 15230 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:47.639428 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 216427us
I20260709 12:24:47.534736 15036 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.559811 15025 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.560231 15180 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:47.584110 15068 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.562844 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:47.689073 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:47.689430 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 126702us
I20260709 12:24:47.690876 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:47.692255 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:47.587438 15208 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:47.588212 15219 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.593976 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:47.636459 15259 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:24:47.703553 12699 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 12:24:47.704751 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 110849us
W20260709 12:24:47.651960 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.705696 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:47.707903 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:47.710129 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:47.711491 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.668826 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 443) took 1067 ms. Trace:
I20260709 12:24:47.635766 15056 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.670848 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 368565us
I20260709 12:24:47.667385 15242 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.536412 15246 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.597041 12707 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:47.657168 15136 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:47.718084 12522 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:47.656955 15215 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:47.631631 15121 consensus_queue.cc:1059] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:24:47.694113 12551 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:47.634647 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1696) took 1130 ms. Trace:
I20260709 12:24:47.696193 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:47.663597 12702 rpcz_store.cc:276] 0709 12:24:46.544851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.662173 (+1117322us) service_pool.cc:224] Handling call
0709 12:24:47.662511 (+   338us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.663035 (+   524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.663263 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.639065 15186 consensus_queue.cc:1059] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:47.603268 15138 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.712409 12708 rpcz_store.cc:276] 0709 12:24:46.601880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.666992 (+1065112us) service_pool.cc:224] Handling call
0709 12:24:47.667289 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.667473 (+   184us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.667508 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.668515 (+  1007us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:47.668554 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.668607 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.668778 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.716037 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 434) took 1172 ms. Trace:
I20260709 12:24:47.766335 12707 rpcz_store.cc:276] 0709 12:24:46.543644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.937756 (+394112us) service_pool.cc:224] Handling call
0709 12:24:47.715979 (+778223us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.767760 12707 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:47.642765 12703 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:47.770824 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 436) took 1226 ms. Trace:
I20260709 12:24:47.771234 12703 rpcz_store.cc:276] 0709 12:24:46.544168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.591371 (+1047203us) service_pool.cc:224] Handling call
0709 12:24:47.642592 (+ 51221us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.770546 (+127954us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.770762 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.747426 13228 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:47.748265 13229 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:47.747766 12700 rpcz_store.cc:276] 0709 12:24:46.504270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.563699 (+1059429us) service_pool.cc:224] Handling call
0709 12:24:47.634010 (+ 70311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.634241 (+   231us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:47.634278 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:47.634331 (+    53us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:47.634376 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.634445 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:47.634580 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:47.747809 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:47.716379 15148 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.015s
I20260709 12:24:47.718521 14823 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:47.718650 15193 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.719538 13226 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:47.719907 15198 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:47.699973 15047 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:47.747496 15243 consensus_meta.cc:287] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.959s	user 0.007s	sys 0.008s
I20260709 12:24:47.783864 12703 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:47.746662 15151 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.743768 15136 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:47.795666 12558 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:47.698984 15068 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:47.800304 12553 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:24:47.763857 14960 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:47.743005 15056 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:47.782445 15148 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.006s	sys 0.016s
I20260709 12:24:47.680781 14922 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:47.797086 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 283644us
I20260709 12:24:47.833171 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:47.841576 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.823401 12553 pending_rounds.cc:85] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
W20260709 12:24:47.824047 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 105997us
I20260709 12:24:47.842374 12553 pending_rounds.cc:107] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:47.842712 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:47.670639 15231 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.786108 14823 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.813962 15121 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.777323 15066 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:24:47.701303 15200 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:47.802044 15235 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:47.746574 15236 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:24:47.842736 12553 raft_consensus.cc:2889] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:47.830938 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:47.847734 15243 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:47.807703 15048 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:47.854548 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:47.812930 15217 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:47.763922 15215 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.872751 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:47.873564 12553 raft_consensus.cc:2410] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:47.854439 15045 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:47.854645 14823 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:47.879170 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 48313.3us
W20260709 12:24:47.877332 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 87038.8us
W20260709 12:24:47.851864 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 193027us
I20260709 12:24:47.886371 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:47.892261 13198 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:47.894243 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:47.845124 15158 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
W20260709 12:24:47.902311 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.913748 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.915755 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 74242.1us
I20260709 12:24:47.916515 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:47.864452 15194 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:47.853426 15272 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 12:24:47.878582 15151 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:47.925146 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:47.937500 12553 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:47.839358 15180 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:47.892148 15269 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.252s	user 0.001s	sys 0.000s
I20260709 12:24:47.862694 15121 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:47.888284 15283 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:47.945690 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:47.940127 13201 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:47.890060 15048 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:47.912725 15229 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:47.935738 15230 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:47.939069 15208 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:47.896872 15118 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:24:47.872016 15136 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:47.939728 15151 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:47.895367 15210 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 12:24:47.924010 15047 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:24:47.960134 15025 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:47.976200 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 85584.2us
I20260709 12:24:47.946445 15246 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:47.959487 15036 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:47.973809 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:47.980356 12703 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:47.960192 14960 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:47.984094 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2184) took 1289 ms. Trace:
I20260709 12:24:47.984483 12627 rpcz_store.cc:276] 0709 12:24:46.694708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.118020 (+423312us) service_pool.cc:224] Handling call
0709 12:24:47.118345 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.661661 (+543316us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.983870 (+322209us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54002ec7d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:47.984040 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":813376256}
W20260709 12:24:47.985924 15278 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:24:47.967074 15280 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:47.982493 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 60575.5us
I20260709 12:24:47.977671 15243 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:47.971478 15148 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:47.969452 15242 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:48.024078 12703 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:47.976703 15219 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:47.980856 15025 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:47.990099 15136 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:48.032440 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.009368 15280 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:48.029692 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:48.037696 15282 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:24:48.037776 15286 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:48.038426 15286 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:48.039419 15286 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.016800 15274 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:47.989032 15208 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:48.017023 15138 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:48.013031 15284 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:48.017040 14864 consensus_meta.cc:287] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.544s	user 0.010s	sys 0.006s
W20260709 12:24:48.079310 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 100078us
I20260709 12:24:48.087909 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 1949) took 2480 ms. Trace:
I20260709 12:24:48.164014 12699 rpcz_store.cc:276] 0709 12:24:45.607762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.470207 (+1862445us) service_pool.cc:224] Handling call
0709 12:24:47.486224 (+ 16017us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:47.704031 (+217807us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.087628 (+383597us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b54003c7dd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:48.087843 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":499103616}
I20260709 12:24:48.089947 12708 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:48.165048 12708 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:48.165081 13198 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:48.023491 15151 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.168437 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:48.168934 15151 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.169720 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:48.035643 15235 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:48.110072 14922 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.026253 15243 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.116552 12551 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:24:48.122004 15267 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.536s	user 0.004s	sys 0.001s
I20260709 12:24:48.123939 15199 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:48.128986 15200 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.132776 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:48.133069 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 621) took 1209 ms. Trace:
I20260709 12:24:48.142630 15193 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:48.152575 15231 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.155632 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:48.158524 12553 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:48.031838 15025 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.033038 15055 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.071163 15273 log.cc:927] Time spent T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:24:48.105967 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 226799us
I20260709 12:24:48.048484 15280 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.035193 15148 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:48.072631 15076 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.189s	user 0.005s	sys 0.005s
I20260709 12:24:48.054926 15274 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.054531 15068 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:48.177734 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.160283 15284 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:48.180210 15243 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:48.248788 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1691) took 2492 ms. Trace:
I20260709 12:24:48.186578 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:48.187906 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:48.189460 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:48.189100 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:48.165943 12708 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.192548 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:48.196550 12556 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
W20260709 12:24:48.196771 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 280318us
I20260709 12:24:48.263836 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:48.196453 12558 rpcz_store.cc:276] 0709 12:24:46.923438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.923620 (+   182us) service_pool.cc:224] Handling call
0709 12:24:46.923932 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.812884 (+888952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.132752 (+319868us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54001ecb54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:48.132991 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2004398336}
I20260709 12:24:48.266839 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:48.201354 15147 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.248s	user 0.009s	sys 0.002s
I20260709 12:24:48.163763 15056 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:48.215742 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.197170 15157 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.251s	user 0.008s	sys 0.004s
W20260709 12:24:48.225492 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 60407.7us
I20260709 12:24:48.225616 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:48.103780 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 681) took 1432 ms. Trace:
I20260709 12:24:48.181874 15235 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:48.235987 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:48.237622 15270 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.395s	user 0.000s	sys 0.001s
I20260709 12:24:48.069996 15045 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:48.191318 15199 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:48.269634 12553 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:48.172926 14864 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.273885 12631 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:48.282042 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:48.284755 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.160173 15208 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.289083 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:48.287995 13228 rpcz_store.cc:276] 0709 12:24:46.671228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.826194 (+154966us) service_pool.cc:224] Handling call
0709 12:24:48.103524 (+1277330us) spinlock_profiling.cc:243] Waited 844 ms on lock 0x7b54007b93d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:48.103700 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1941486464}
W20260709 12:24:48.326299 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.339097 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.482342 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.192006 14960 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:48.487326 12628 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.492071 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:48.492779 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:48.502509 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.262454 12706 rpcz_store.cc:276] 0709 12:24:45.756595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.476001 (+1719406us) service_pool.cc:224] Handling call
0709 12:24:47.476248 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.476419 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:47.641507 (+165088us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.248451 (+606944us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.248505 (+    54us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.248548 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.248607 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.248726 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40786,"prepare.queue_time_us":270281,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":8389,"raft.queue_time_us":106910,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":24069,"spinlock_wait_cycles":62595072,"thread_start_us":749218,"threads_started":3,"wal-append.queue_time_us":339238}
I20260709 12:24:48.237170 15215 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:48.345916 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 90735us
I20260709 12:24:48.369102 15121 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:48.287127 15147 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.247258 15274 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:48.273236 15284 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.398123 15199 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:48.402366 14864 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:48.396605 15299 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.237s	user 0.000s	sys 0.000s
W20260709 12:24:48.280356 15213 consensus_meta.cc:287] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.752s	user 0.011s	sys 0.000s
I20260709 12:24:48.237217 15031 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.348452 12701 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:48.347251 15158 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:48.347713 15314 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.222741 15193 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:48.481544 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 181007us
I20260709 12:24:48.234253 15055 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:48.526393 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:48.289141 15048 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:48.550938 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 264367us
I20260709 12:24:48.247695 15076 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.557226 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:48.550500 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 120109us
I20260709 12:24:48.484050 15066 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:48.579078 12706 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:48.589434 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1703) took 2082 ms. Trace:
I20260709 12:24:48.590915 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:48.583290 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:48.574965 15229 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:48.589839 12705 rpcz_store.cc:276] 0709 12:24:46.506572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.590810 (+1084238us) service_pool.cc:224] Handling call
0709 12:24:47.591246 (+   436us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.793949 (+202703us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.150979 (+357030us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b180049e760. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e946934bc 00007f0e919e148b 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fb455 00007f0e984e33c7 00007f0e94af59a7 00007f0e94b050bf
0709 12:24:48.151150 (+   171us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.589109 (+437959us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.589159 (+    50us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.589202 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.589264 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.589362 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49919,"prepare.queue_time_us":37761,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":42,"raft.queue_time_us":77111,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8235,"spinlock_wait_cycles":40668544,"thread_start_us":629481,"threads_started":3}
I20260709 12:24:48.503074 15210 consensus_queue.cc:1059] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.082s
W20260709 12:24:48.589604 15169 consensus_meta.cc:287] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.130s	user 0.013s	sys 0.000s
I20260709 12:24:48.615234 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:48.658093 12523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.222s (SENT) [suppressed 36 similar messages]
I20260709 12:24:48.589027 15199 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:48.677217 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:48.686004 12706 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:48.576398 15213 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:48.618798 15319 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:24:48.644999 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:48.683094 12628 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:48.588893 14864 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:48.594826 15196 consensus_meta.cc:287] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.654s	user 0.012s	sys 0.001s
I20260709 12:24:48.557744 15121 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.031s
W20260709 12:24:48.621295 15245 consensus_meta.cc:287] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.246s	user 0.012s	sys 0.000s
I20260709 12:24:48.626901 12598 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:48.603675 15229 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:48.623051 15146 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.101s	user 0.008s	sys 0.001s
I20260709 12:24:48.713507 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:48.713943 15320 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:24:48.598060 15314 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.699519 13230 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:48.717518 12705 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:24:48.571951 15148 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.624377 15235 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:48.581533 15286 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.091s
I20260709 12:24:48.594120 15066 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:48.711301 15301 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 12:24:48.740283 15048 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:48.687727 15169 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:48.757476 13226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.004s	sys 0.012s
W20260709 12:24:48.762624 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 135791us
W20260709 12:24:49.304724 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.720620 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:48.762991 12557 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:24:48.748363 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 133217us
I20260709 12:24:49.406900 15297 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:49.407471 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:49.405141 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.407949 15297 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:48.815093 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.839682 12703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.008s	sys 0.019s
W20260709 12:24:49.410091 12703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.208s	user 0.009s	sys 0.019s
W20260709 12:24:49.410563 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.790954 12704 raft_consensus.cc:2410] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:48.800297 12700 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.412547 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1810) took 1169 ms. Trace:
W20260709 12:24:49.308668 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.310063 13199 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.006s	sys 0.009s
W20260709 12:24:49.414105 13199 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.006s	sys 0.009s
W20260709 12:24:49.414685 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 655527us
W20260709 12:24:48.832468 13198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.000s	sys 0.021s
W20260709 12:24:49.416283 13198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.000s	sys 0.022s
W20260709 12:24:49.416704 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 1.12918e+06us
W20260709 12:24:48.833621 14823 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.937s	user 0.008s	sys 0.002s
I20260709 12:24:49.418246 14823 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.419643 15243 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.751327 14864 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.421888 14864 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.423760 15242 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:49.305600 12552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.001s	sys 0.010s
I20260709 12:24:49.424790 15242 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:49.425688 12552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.001s	sys 0.010s
I20260709 12:24:48.605978 15045 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.426302 15055 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.428539 15242 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:48.755273 15186 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:48.615639 15194 raft_consensus.cc:2764] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:49.430230 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:48.761256 15196 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.431169 13227 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:49.431720 15297 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:48.798146 15213 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.432763 12627 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:49.433092 15213 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.433708 15196 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.434310 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:49.434054 15213 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.840801 15208 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.436213 12632 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:48.965377 15193 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:48.784435 15198 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:48.770530 15229 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:48.721974 15261 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:48.770843 15245 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.439487 15261 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:48.614703 15312 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.197s
I20260709 12:24:49.442024 15056 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.442376 15245 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:49.049329 15322 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260709 12:24:49.442830 15056 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.445608 12702 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:49.413058 12630 rpcz_store.cc:276] 0709 12:24:48.242598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.242746 (+   148us) service_pool.cc:224] Handling call
0709 12:24:48.243141 (+   395us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.243581 (+   440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.243621 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.244133 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.365595 (+121462us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:48.365656 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.365748 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.411959 (+1046211us) raft_consensus.cc:1685] finished
0709 12:24:49.412005 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.412296 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1483,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":73,"thread_start_us":120964,"threads_started":1,"wal-append.queue_time_us":524843}
W20260709 12:24:49.359172 15068 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.002s	sys 0.008s
I20260709 12:24:49.447854 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 731) took 1284 ms. Trace:
I20260709 12:24:49.359045 15291 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:49.448256 13230 rpcz_store.cc:276] 0709 12:24:48.163593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.167799 (+  4206us) service_pool.cc:224] Handling call
0709 12:24:48.168074 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.842100 (+674026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.447297 (+605197us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b540062f2d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:49.447630 (+   333us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1055489280}
I20260709 12:24:49.448923 15291 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:49.450521 12523 leader_election.cc:336] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.500s (SENT)
I20260709 12:24:49.451185 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:49.372380 15305 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:49.372623 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.453969 15305 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.454856 15261 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.457808 15031 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:49.458417 15031 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:24:49.458747 12523 leader_election.cc:336] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.542s (SENT)
I20260709 12:24:49.460263 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:49.380324 15121 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:49.460573 15031 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:49.381321 15307 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.548s	user 0.010s	sys 0.000s
W20260709 12:24:49.393627 13226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.169s	user 0.012s	sys 0.012s
I20260709 12:24:49.382946 15314 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.394223 15235 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:49.410349 15295 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:49.413648 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.317560 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 633) took 1133 ms. Trace:
I20260709 12:24:49.435127 13229 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.457886 15076 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:49.420668 15243 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.386837 15066 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:49.395758 12628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1805) took 1206 ms (client timeout 1571 ms). Trace:
I20260709 12:24:48.818499 15327 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.461072 15292 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:49.453122 15291 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.462791 14823 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:49.486918 12628 rpcz_store.cc:269] 0709 12:24:48.188770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.188895 (+   125us) service_pool.cc:224] Handling call
0709 12:24:49.395032 (+1206137us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b540012f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:49.395423 (+   391us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":519299456}
W20260709 12:24:49.521260 15330 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.146s	user 0.000s	sys 0.002s
W20260709 12:24:49.524674 15315 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
W20260709 12:24:49.526829 15333 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:24:49.527872 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 730) took 1486 ms. Trace:
I20260709 12:24:49.529469 15310 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:49.529968 15310 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:49.530643 15169 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.531379 15310 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.528364 13226 rpcz_store.cc:276] 0709 12:24:48.041979 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.042122 (+   143us) service_pool.cc:224] Handling call
0709 12:24:48.073792 (+ 31670us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:48.171194 (+ 97402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.171234 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:48.172887 (+  1653us) log.cc:844] Serialized 52 byte log entry
0709 12:24:49.505813 (+1332926us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:49.505945 (+   132us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.506088 (+   143us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.520359 (+ 14271us) spinlock_profiling.cc:243] Waited 15.4 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:49.527495 (+  7136us) raft_consensus.cc:1685] finished
0709 12:24:49.527513 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.527792 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":179991,"raft.queue_time_us":101376,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":9073,"spinlock_wait_cycles":35531648,"thread_start_us":1237368,"threads_started":1,"wal-append.queue_time_us":1178385}
I20260709 12:24:49.518937 15229 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.538138 15056 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.537900 15327 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.539921 15229 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:49.543226 15296 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:49.473850 12551 rpcz_store.cc:276] 0709 12:24:48.183989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.184509 (+   520us) service_pool.cc:224] Handling call
0709 12:24:48.184944 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.185363 (+   419us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.185418 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.186004 (+   586us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.246093 (+ 60089us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.246129 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.246208 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.300546 (+1054338us) raft_consensus.cc:1685] finished
0709 12:24:49.300624 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.317291 (+ 16667us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":239,"raft.queue_time_us":1079,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":31781,"thread_start_us":59393,"threads_started":1,"wal-append.queue_time_us":312051}
W20260709 12:24:49.545991 12701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 1704) took 2751 ms (client timeout 2675 ms). Trace:
W20260709 12:24:49.546464 12701 rpcz_store.cc:269] 0709 12:24:46.794379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.260947 (+466568us) service_pool.cc:224] Handling call
0709 12:24:49.545564 (+2284617us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54000d07d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:49.545749 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498921856}
I20260709 12:24:49.553544 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:49.554174 12704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 447) took 2868 ms (client timeout 2022 ms). Trace:
I20260709 12:24:49.461901 15121 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.482457 15213 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.506131 15055 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.507756 15235 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:49.509523 12522 connection.cc:256] RPC call timeout handler was delayed by -1.1411969199998566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15960000000000002s for a response
W20260709 12:24:49.512112 15284 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.952s	user 0.011s	sys 0.016s
I20260709 12:24:49.515832 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:49.516445 15304 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.902s	user 0.003s	sys 0.000s
W20260709 12:24:49.519282 15324 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.137s	user 0.001s	sys 0.000s
W20260709 12:24:49.554662 12704 rpcz_store.cc:269] 0709 12:24:46.686083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.981612 (+295529us) service_pool.cc:224] Handling call
0709 12:24:49.553789 (+2572177us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003ebcd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:49.553955 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3780339072}
I20260709 12:24:49.495739 15292 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:49.537221 15200 consensus_meta.cc:287] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.334s	user 0.004s	sys 0.016s
I20260709 12:24:49.581878 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:49.541205 15327 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:49.613396 12522 connection.cc:256] RPC call timeout handler was delayed by -1.1321969199998421s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16060000000000002s for a response
W20260709 12:24:49.620370 12522 connection.cc:256] RPC call timeout handler was delayed by -1.1294969199998377s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16090000000000002s for a response
W20260709 12:24:49.620772 12522 connection.cc:256] RPC call timeout handler was delayed by -1.0286969200001295s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17210000000000003s for a response
W20260709 12:24:49.631316 15025 consensus_meta.cc:287] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.394s	user 0.012s	sys 0.006s
I20260709 12:24:49.631944 15025 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.632612 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2185) took 2936 ms. Trace:
W20260709 12:24:49.633347 14774 consensus_meta.cc:287] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.997s	user 0.010s	sys 0.005s
I20260709 12:24:49.633944 14774 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.634074 15292 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.635273 12633 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:49.635455 15292 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.636286 14864 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.640537 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2182) took 2952 ms. Trace:
I20260709 12:24:49.633203 12632 rpcz_store.cc:276] 0709 12:24:46.695868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.142540 (+446672us) service_pool.cc:224] Handling call
0709 12:24:47.256997 (+114457us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.436722 (+2179725us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.632118 (+195396us) spinlock_profiling.cc:243] Waited 2.18 s on lock 0x7b5400344ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:49.632483 (+   365us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5010638720}
I20260709 12:24:49.623144 15310 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.642243 12633 rpcz_store.cc:276] 0709 12:24:46.685656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.927074 (+241418us) service_pool.cc:224] Handling call
0709 12:24:46.937562 (+ 10488us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.635683 (+2698121us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.637428 (+  1745us) spinlock_profiling.cc:243] Waited 2.7 s on lock 0x7b54002134d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:49.637658 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6203385088}
I20260709 12:24:49.636317 14774 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.659648 15047 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:49.659752 15284 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:49.661175 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 145567us
I20260709 12:24:49.659703 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:49.670475 15047 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.668797 12700 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:49.678170 12699 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:49.673537 15047 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:49.691310 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 268580us
I20260709 12:24:49.651819 15200 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:49.703578 13229 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:49.691324 15055 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.721354 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:49.723227 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 264573us
W20260709 12:24:49.723798 15231 consensus_meta.cc:287] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.430s	user 0.007s	sys 0.014s
W20260709 12:24:49.724140 12523 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.557s (SENT)
I20260709 12:24:49.724493 15331 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.724947 15343 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.725521 15331 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.725864 15343 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.728371 15343 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.729027 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:49.729735 13227 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:49.732197 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:49.733161 12632 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:49.696086 15327 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.723500 13232 raft_consensus.cc:2368] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:49.724766 12523 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:49.734766 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:49.703740 15297 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:49.733839 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:49.738865 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:49.744151 12633 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:49.744563 12558 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.748732 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:49.724582 15199 consensus_meta.cc:287] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.994s	user 0.019s	sys 0.001s
I20260709 12:24:49.748588 12701 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:49.744215 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:49.734216 15025 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:49.718822 14774 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.751477 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1804) took 1564 ms. Trace:
I20260709 12:24:49.752910 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:49.763293 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.764274 12554 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
W20260709 12:24:49.764556 15274 consensus_meta.cc:287] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.207s	user 0.015s	sys 0.006s
I20260709 12:24:49.765110 15274 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.765558 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:49.766268 12633 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:49.767246 15274 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.768013 15297 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.733860 15327 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.770174 15297 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.771210 15327 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:49.771405 15280 consensus_meta.cc:287] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.514s	user 0.009s	sys 0.014s
I20260709 12:24:49.761832 13226 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:24:49.761304 12627 rpcz_store.cc:276] 0709 12:24:48.187505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.187626 (+   121us) service_pool.cc:224] Handling call
0709 12:24:49.734947 (+1547321us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54002116d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:49.751419 (+ 16472us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2691485568}
W20260709 12:24:49.783515 14922 consensus_meta.cc:287] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.570s	user 0.015s	sys 0.007s
I20260709 12:24:49.783579 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:24:49.785856 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 61771.7us
W20260709 12:24:49.787091 15323 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260709 12:24:49.788487 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1705) took 2993 ms. Trace:
I20260709 12:24:49.791769 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:49.793141 15311 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.794245 15146 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.794869 15146 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.798719 15121 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.779258 13233 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.734436 15056 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 12:24:49.806646 13234 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:24:49.804298 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:49.809525 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 58321.5us
I20260709 12:24:49.811000 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:49.811386 15311 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:49.811874 12631 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:49.812094 15311 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:49.772202 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:49.812984 12630 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:49.763339 15246 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:49.779951 14864 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.814568 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:49.820138 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:49.821076 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 300168us
W20260709 12:24:49.818001 15338 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.184s	user 0.001s	sys 0.000s
I20260709 12:24:49.829015 12625 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:49.825677 13228 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.811421 15235 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.835093 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:49.835103 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 48579.1us
I20260709 12:24:49.775820 15280 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.788954 12707 rpcz_store.cc:276] 0709 12:24:46.794621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.768815 (+974194us) service_pool.cc:224] Handling call
0709 12:24:47.769174 (+   359us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:48.199614 (+430440us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.199657 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:48.270924 (+ 71267us) log.cc:844] Serialized 52 byte log entry
0709 12:24:48.530095 (+259171us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:48.532114 (+  2019us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.584498 (+ 52384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.624250 (+ 39752us) spinlock_profiling.cc:243] Waited 4.58 ms on lock 0x7b48000339d8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e99a14aa1 00007f0e99a0bb37 00007f0e99a0b9ca 00007f0e99b0326f 00007f0e99b02f37 00007f0e99b1755c 00007f0e99b17508 00007f0e99b17488 00007f0e99b17443 00007f0e99b166ec 00007f0e98a40a96
0709 12:24:48.738669 (+114419us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540041ffd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:48.738749 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.518208 (+779459us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:49.788026 (+269818us) raft_consensus.cc:1685] finished
0709 12:24:49.788045 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.788264 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78550,"prepare.queue_time_us":658,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":153109,"raft.run_cpu_time_us":2514,"raft.run_wall_time_us":44253,"spinlock_wait_cycles":264839552,"thread_start_us":228866,"threads_started":2,"wal-append.queue_time_us":480519}
I20260709 12:24:49.837682 12631 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:49.779877 15055 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.841529 15347 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:49.840229 15200 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:49.842576 15200 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.842399 15347 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.842974 15200 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.843134 15056 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:49.843526 15056 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:49.843782 15055 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.843890 15056 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.845196 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.826289 14774 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.841871 15295 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:49.847049 15295 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:49.848404 14774 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.848083 15295 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.848963 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:49.850922 14864 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:49.851320 14864 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.851652 14864 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.844708 15347 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:49.854285 15199 consensus_queue.cc:1059] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:49.863911 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.864748 15295 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.862061 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:49.867733 12558 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:49.867003 15121 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:49.873349 15121 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:49.874025 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.874415 15121 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.876050 15121 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.877236 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.877578 15048 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:49.878114 15048 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:49.878357 13228 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:49.879550 15284 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:49.880851 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.868371 12523 leader_election.cc:336] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.596s (SENT)
I20260709 12:24:49.881480 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:49.882455 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:49.882550 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:49.884534 13233 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:49.889657 12554 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.844703 15246 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.893683 14960 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:49.894340 15246 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:49.894375 14960 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.894858 15327 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.895668 15327 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:49.896925 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.897166 14960 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:49.898030 15327 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:49.899253 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:49.900231 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.901077 15327 raft_consensus.cc:2764] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:49.899860 15348 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.902426 15348 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:49.902856 15348 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.905869 15280 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:49.906864 14960 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:49.906826 15311 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.908177 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:49.909654 15327 raft_consensus.cc:2764] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:49.910495 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2003) took 1683 ms. Trace:
I20260709 12:24:49.911800 15055 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:49.911816 12598 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:49.914340 15199 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:49.915050 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52917.7us
I20260709 12:24:49.915102 15199 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:49.905268 12554 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:49.918004 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:49.918586 15199 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:49.919636 12523 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.602s (SENT)
I20260709 12:24:49.919806 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:49.920203 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:49.921818 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:49.940814 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.964910 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 143229us
I20260709 12:24:49.917889 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:49.886183 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:49.974687 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:49.977154 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 115329us
I20260709 12:24:49.978415 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:49.979177 12634 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:49.985002 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:49.985648 15303 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:49.986200 15303 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:49.986388 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:49.986545 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 227676us
I20260709 12:24:49.987227 15303 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:49.987802 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:49.989992 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:49.990262 15208 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:49.990348 15045 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:49.990916 12629 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:49.993860 15345 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.994360 15345 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:49.994864 15345 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:49.989267 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:49.999698 15031 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:49.963387 15348 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:49.999717 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 81951.5us
I20260709 12:24:50.002239 15348 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:50.002635 15316 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.622s	user 0.001s	sys 0.000s
I20260709 12:24:50.002532 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.003798 15246 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:50.004699 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 85115.4us
W20260709 12:24:50.005541 12523 leader_election.cc:336] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.606s (SENT)
I20260709 12:24:50.006011 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.007640 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:50.007784 12523 leader_election.cc:336] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.609s (SENT)
W20260709 12:24:50.008543 15335 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.632s	user 0.001s	sys 0.002s
I20260709 12:24:50.010768 15302 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.008364 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.003324 12597 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.009814 15274 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.022439 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.030390 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.025830 15327 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.917459 12552 rpcz_store.cc:276] 0709 12:24:48.227469 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.227616 (+   147us) service_pool.cc:224] Handling call
0709 12:24:48.278904 (+ 51288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.279158 (+   254us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.279474 (+   316us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.744308 (+464834us) spinlock_profiling.cc:243] Waited 8.76 ms on lock 0x7b18004e05e0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:24:49.836046 (+1091738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.859321 (+ 23275us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:49.861856 (+  2535us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.881150 (+ 19294us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.910441 (+ 29291us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":127,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":20273,"raft.queue_time_us":56289,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":9076,"spinlock_wait_cycles":20150016,"thread_start_us":1063753,"threads_started":2,"wal-append.queue_time_us":1275228}
I20260709 12:24:50.027235 15246 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:50.041340 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.038443 13199 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.038915 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.039767 12557 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:50.042335 12700 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:50.032969 15213 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:50.047187 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.048779 13198 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.049680 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:50.051971 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44213.5us
I20260709 12:24:50.054127 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.041042 15235 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.039412 15343 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:50.055720 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.062042 15348 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.050969 15047 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:50.068058 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.063822 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.041453 15246 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:50.073426 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.074277 12634 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:50.073558 15045 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.077019 15045 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.077370 15045 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.077823 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.078728 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.079377 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.080156 12706 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.084069 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.084311 15118 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.084878 15118 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.085601 15169 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.085886 15350 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.087078 15118 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.058830 15291 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:50.088508 15291 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.056444 15231 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:24:50.045020 15274 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.092890 15347 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:50.093577 15347 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.095599 15219 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:50.096339 15219 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:50.097648 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.098186 15350 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:50.070917 15314 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.070055 12707 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.098932 15350 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.100126 15200 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.101090 15219 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.101823 15350 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.089948 12634 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:50.102350 15200 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.058439 15213 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:50.104430 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.104393 15213 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.095654 15347 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:50.108165 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.071331 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.111956 12707 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.081154 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.061173 12671 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.116606 12704 raft_consensus.cc:2368] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7.
I20260709 12:24:50.116467 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.118606 13233 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:50.118709 15343 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:50.119812 15343 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.122078 15243 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.122521 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 445) took 3503 ms. Trace:
I20260709 12:24:50.122872 12702 rpcz_store.cc:276] 0709 12:24:46.619072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.748253 (+1129181us) service_pool.cc:224] Handling call
0709 12:24:47.748537 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.446148 (+1697611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.122254 (+676106us) spinlock_profiling.cc:243] Waited 1.7 s on lock 0x7b54002a2954. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:50.122452 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3901654784}
I20260709 12:24:50.124037 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.124265 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 705) took 1961 ms. Trace:
I20260709 12:24:50.124624 13232 rpcz_store.cc:276] 0709 12:24:48.162482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.169477 (+  6995us) service_pool.cc:224] Handling call
0709 12:24:50.124043 (+1954566us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b54005b27d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:50.124188 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3375002880}
I20260709 12:24:50.124704 15243 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:50.124653 12702 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:50.066327 15235 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:50.074832 15246 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.130509 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:50.131494 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.133184 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.134032 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.049853 15327 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.131994 12699 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.100180 15305 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.138335 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.141357 12707 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.141745 12634 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:50.130718 15235 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.150321 13228 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:24:50.144068 12523 leader_election.cc:336] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.672s (SENT)
I20260709 12:24:50.146538 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.135558 15245 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.113687 14864 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.116227 15056 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.156062 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.136994 15340 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.158528 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.159436 15314 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:50.165637 13230 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:50.186714 15341 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.187151 15341 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.187482 15341 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.172089 14864 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.155529 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.188495 12706 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:50.190956 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.191730 12558 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:50.192546 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:50.195173 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 141758us
I20260709 12:24:50.116379 15208 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:24:50.143837 14774 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.199753 12707 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:50.178401 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.177616 15291 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.172204 15297 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:50.180616 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.183983 12633 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:50.185302 15340 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.193133 12558 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:50.190302 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.208907 12706 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:50.173122 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.137844 15350 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:50.195003 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.202482 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.204413 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.195143 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.211877 15340 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.215209 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.215739 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.216100 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.214898 12555 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.214901 12550 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:50.217015 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.219043 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.220819 12552 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:50.214948 14774 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:50.223228 14774 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.226238 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.212026 15297 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.227564 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.229393 12558 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:50.245718 12550 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:50.226259 14864 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:50.243603 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.246450 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.247167 12707 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:50.258656 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:50.274048 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 101137us
I20260709 12:24:50.230312 15297 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.243729 15350 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.228792 15199 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:50.227180 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:50.278568 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 142734us
I20260709 12:24:50.278609 12598 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.236632 15243 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.281281 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.284590 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.242674 15291 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:50.292065 15332 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.566s	user 0.000s	sys 0.002s
I20260709 12:24:50.298547 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 458) took 2136 ms. Trace:
I20260709 12:24:50.298998 12703 rpcz_store.cc:276] 0709 12:24:48.162243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.162384 (+   141us) service_pool.cc:224] Handling call
0709 12:24:48.162666 (+   282us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:48.163049 (+   383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:48.163091 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:48.163569 (+   478us) log.cc:844] Serialized 26 byte log entry
0709 12:24:49.410937 (+1247368us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:49.411016 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.411175 (+   159us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.291416 (+880241us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:50.298237 (+  6821us) raft_consensus.cc:1685] finished
0709 12:24:50.298266 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.298464 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2607,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":2686,"spinlock_wait_cycles":48312064,"thread_start_us":1208901,"threads_started":1,"wal-append.queue_time_us":1530743}
I20260709 12:24:50.264081 14864 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.293087 12555 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:50.236467 15245 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.281807 15121 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.317373 12707 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:50.293157 15327 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.322746 15345 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.323592 15056 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.320307 14960 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.326906 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:50.327099 12523 leader_election.cc:336] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.721s (SENT)
I20260709 12:24:50.327222 15235 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.286258 13230 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:50.335368 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 439607us
I20260709 12:24:50.320165 12699 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:50.327626 12523 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.285369 15199 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:24:50.344072 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 139811us
I20260709 12:24:50.338056 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.309885 14864 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.351856 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.353044 15169 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:50.354104 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.357064 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.357772 12552 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.359375 12559 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:50.361074 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.361779 12555 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.361701 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.362946 12559 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:50.366438 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.366894 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.367704 12555 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:50.368165 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.368422 15121 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.312047 15245 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:50.372272 12559 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.325304 15345 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.375839 12552 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
W20260709 12:24:50.378134 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 57646.1us
I20260709 12:24:50.374379 12699 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:50.381465 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.382231 15180 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.382452 12699 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:50.382951 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1809) took 2180 ms. Trace:
I20260709 12:24:50.383347 12626 rpcz_store.cc:276] 0709 12:24:48.241973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.242280 (+   307us) service_pool.cc:224] Handling call
0709 12:24:48.242584 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.242778 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:48.283124 (+ 40346us) log.cc:844] Serialized 14 byte log entry
0709 12:24:50.333022 (+2049898us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b18003582a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e946934bc 00007f0e919e148b 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a
0709 12:24:50.333252 (+   230us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.333328 (+    76us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.338510 (+  5182us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.368628 (+ 30118us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.373919 (+  5291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67104,"prepare.queue_time_us":40202,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":18953,"raft.queue_time_us":5265,"spinlock_wait_cycles":29434368,"thread_start_us":277911,"threads_started":1,"wal-append.queue_time_us":1295858}
W20260709 12:24:50.385375 15352 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260709 12:24:50.385679 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.390486 15118 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.345953 15235 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.396858 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:50.378942 12523 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.751s (SENT)
I20260709 12:24:50.397795 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:50.399214 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.396526 15118 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.404677 15118 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.372252 15245 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.343884 15243 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.412606 15199 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.425549 12634 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:50.426224 15359 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260709 12:24:50.426723 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:50.427330 12634 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.427477 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:50.429983 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.431033 15147 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:50.431644 15147 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.434214 15045 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.434661 15146 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:50.436892 15355 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260709 12:24:50.425612 12630 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:50.439216 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:50.440277 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:50.440277 12700 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:50.431154 15331 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.447172 15047 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.490132 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:50.448154 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:50.448304 15243 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.455721 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.457856 12522 leader_election.cc:400] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:50.495402 12522 leader_election.cc:403] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:24:50.422752 15296 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.458096 15076 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.460724 12628 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
W20260709 12:24:50.462936 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.491159 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.491430 12633 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:50.499406 12630 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:50.500674 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.502733 12634 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
W20260709 12:24:50.505777 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 126862us
I20260709 12:24:50.500648 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.436305 15045 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.507629 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:50.505211 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 58782.1us
I20260709 12:24:50.509783 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 732) took 2311 ms. Trace:
W20260709 12:24:50.511232 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.512413 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.512964 12708 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.515659 13234 rpcz_store.cc:276] 0709 12:24:48.198792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.198946 (+   154us) service_pool.cc:224] Handling call
0709 12:24:48.235222 (+ 36276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.810994 (+1575772us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.509506 (+698512us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b54001586d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:50.509694 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3447248256}
I20260709 12:24:50.514848 15047 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.521557 15047 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.521876 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.523062 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.523712 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.524119 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.524395 12559 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:50.524593 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.524703 15341 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.525279 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:50.525528 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:50.525677 12554 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.519647 13230 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:50.526204 12628 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:50.500488 15076 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:24:50.528379 15370 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:24:50.527913 15076 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.529215 15076 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.529529 12626 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
W20260709 12:24:50.530254 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 159557us
I20260709 12:24:50.531093 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:50.515187 12523 leader_election.cc:336] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.917s (SENT)
I20260709 12:24:50.539824 12633 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:50.504288 15235 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:50.516564 15345 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:50.543045 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.546654 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.547719 12552 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:50.545691 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.548781 12559 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.549470 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.551630 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.552245 12554 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:50.552480 15198 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:50.553606 12523 leader_election.cc:336] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.974s (SENT)
I20260709 12:24:50.554104 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:50.555387 12523 leader_election.cc:336] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.007s (SENT)
I20260709 12:24:50.555809 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.557049 15300 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:50.558218 14864 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.558542 15300 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.559666 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.559607 15246 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.560290 14864 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.560635 15300 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.560909 13226 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:50.557588 15314 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:50.561800 15314 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.562165 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.540416 15296 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:50.547001 15345 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:50.541858 15235 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.563372 15345 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.563597 15235 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.563894 15314 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:50.564565 15056 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.565129 12671 leader_election.cc:400] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
W20260709 12:24:50.557596 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 99925.7us
I20260709 12:24:50.575948 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.576695 15350 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:50.565831 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.577936 12556 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:50.565266 15056 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:50.566452 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.566680 15180 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.547750 15121 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:24:50.547362 15031 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:50.562243 15243 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.569432 15213 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:50.570915 12523 leader_election.cc:336] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.080s (SENT)
I20260709 12:24:50.576992 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.577768 12557 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:50.585605 12559 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:50.583477 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:50.587950 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:50.567463 15246 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:50.590572 12629 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:50.593210 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.607836 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.602039 15327 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:50.609380 15148 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:50.609169 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 446) took 3961 ms. Trace:
I20260709 12:24:50.610311 15118 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:50.610057 12708 rpcz_store.cc:276] 0709 12:24:46.647603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.765534 (+1117931us) service_pool.cc:224] Handling call
0709 12:24:47.765901 (+   367us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.089840 (+323939us) spinlock_profiling.cc:243] Waited 4.3 ms on lock 0x7b5400083ca0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a62dc0 00007f0e94aed1c0 00007f0e94aee231 00007f0e94aead8f 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c
0709 12:24:50.512437 (+2422597us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b58007d12d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aedb49 00007f0e94aee416 00007f0e94aead8f 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4
0709 12:24:50.596433 (+ 83996us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.596462 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.601951 (+  5489us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:50.601997 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.602084 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.609105 (+  7021us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6127,"spinlock_wait_cycles":4694286592}
W20260709 12:24:50.609644 15040 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:24:50.612108 15229 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:50.612601 15229 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.602191 15031 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:50.586086 15198 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:50.587539 15348 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:50.577260 15350 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:50.611392 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46416us
I20260709 12:24:50.617666 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.620862 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:50.614789 15031 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.585712 15274 consensus_queue.cc:1059] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:24:50.602519 15311 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.589767 15305 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:24:50.581833 15245 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.629949 15136 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:24:50.631067 15341 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.586768 15297 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.635026 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.635313 15246 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:50.597257 15146 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:24:50.642552 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 71683.2us
I20260709 12:24:50.588114 15340 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:50.648116 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 71190.9us
I20260709 12:24:50.636664 15311 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:50.641764 15243 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:50.657511 12634 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:50.659763 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.644941 15327 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.645618 15280 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.704180 15274 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:50.645257 15146 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:50.678104 12523 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.176s (SENT)
I20260709 12:24:50.709961 15146 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:50.710246 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53746.6us
W20260709 12:24:50.713717 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.714604 15245 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.706446 15305 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 12:24:50.717789 15340 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.720350 15147 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.721542 15198 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.706180 15295 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:24:50.725869 13228 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:50.661787 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:50.730967 12633 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:50.655833 15311 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.706727 12631 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:24:50.654456 15350 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:50.706485 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46811.9us
I20260709 12:24:50.658854 15243 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.749332 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.745817 15243 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:50.753489 15376 log.cc:927] Time spent T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:24:50.731964 15274 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:50.758879 15345 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.763342 12632 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:50.741178 15235 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.778314 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.779206 12708 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:50.779963 15048 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.780932 15048 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:50.783169 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.785656 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 79375us
I20260709 12:24:50.786651 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.788007 12701 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:50.790014 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.790601 12702 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.796022 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:50.784417 15345 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.803792 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.805658 15274 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.813485 12701 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:24:50.817138 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:50.820411 12523 leader_election.cc:336] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.966s (SENT)
I20260709 12:24:50.821873 12699 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:50.824209 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.822355 12699 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:50.824982 12700 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.826601 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.827786 12703 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:50.829807 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.831218 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:50.832250 12523 leader_election.cc:336] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.177s (SENT)
I20260709 12:24:50.832773 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:50.833436 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.833854 12523 leader_election.cc:336] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.283s (SENT)
I20260709 12:24:50.800047 15350 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:50.836639 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.861714 12703 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.866636 15243 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.867055 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.868729 15243 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.868985 12703 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:50.837792 12708 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:50.870020 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.870774 12708 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:50.871680 12708 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:50.871873 15296 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:50.841665 12699 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.872417 15296 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:50.872733 12699 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.873396 15296 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.842736 15235 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:50.874646 15296 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.836923 12707 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:50.938335 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:50.938952 12707 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.857892 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.941692 12553 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.859645 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:24:50.946024 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 86459.2us
I20260709 12:24:50.946498 12702 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:50.946838 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:50.921056 12700 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:24:50.948390 15025 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:50.948745 15246 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:50.948762 15025 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.949585 15246 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:50.872009 12708 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:50.844997 15146 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.950654 12708 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:50.951679 12708 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.951810 15146 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:50.953719 12701 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:50.953807 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.827008 15297 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:50.845479 15048 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:50.880853 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.879731 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.955785 12550 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:50.883250 12699 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:24:50.884792 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.886904 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.887596 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.878027 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.917122 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:50.957213 12559 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:50.957185 13228 raft_consensus.cc:2368] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:50.915406 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:50.957304 12554 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:50.922648 12634 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:50.877107 15311 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.926401 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.927482 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.930418 13199 leader_election.cc:400] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7.
I20260709 12:24:50.960390 13199 leader_election.cc:403] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:50.931041 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.931672 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:50.949666 15025 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.956717 12699 pending_rounds.cc:85] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 7
I20260709 12:24:50.923470 15378 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 12:24:50.984424 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 58111.1us
I20260709 12:24:50.985236 12598 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:50.875382 15348 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:50.961627 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:50.978906 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:50.994024 12523 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.728s (SENT)
I20260709 12:24:50.987771 12553 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:24:50.992338 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.964624 12699 pending_rounds.cc:107] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:24:50.998946 12699 raft_consensus.cc:2889] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:51.002206 14960 consensus_queue.cc:1059] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:51.002496 15147 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.003062 15147 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:51.003469 15147 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.003432 14960 raft_consensus.cc:3055] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.004340 14960 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.005302 14960 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.006605 14960 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.010677 15311 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:51.011049 15147 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:50.993247 15235 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.019290 12707 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:51.019599 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:50.963764 15297 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.024431 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:51.032222 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 48774.9us
I20260709 12:24:51.033228 12557 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.033681 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:50.982754 15313 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.037470 15121 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:51.037865 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:51.021900 15031 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.040410 15229 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:51.041096 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:51.166788 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.042042 12708 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:24:51.167240 12523 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.886s (SENT)
I20260709 12:24:51.042750 15025 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.043906 15235 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.052208 12559 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:24:51.054383 12554 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:50.984650 15378 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:51.169193 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.173991 12706 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.174669 12703 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:51.175547 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:51.058274 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 291988us
I20260709 12:24:50.999965 15208 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.086970 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:51.093034 12707 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:50.950675 15246 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.181865 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.000615 15341 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:51.160907 15056 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.164599 15198 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.038540 15291 raft_consensus.cc:2764] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:51.161374 12550 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.168242 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.176837 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:51.097512 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.177810 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 136761us
W20260709 12:24:51.183635 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 253361us
I20260709 12:24:51.177253 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:50.993093 15348 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:51.133549 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.203078 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.208012 12626 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:51.209553 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.213989 15348 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.215106 15348 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.217742 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:51.219363 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:51.165658 14960 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:24:51.220302 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:51.211269 12633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:51.234369 12633 raft_consensus.cc:606] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:51.234809 12633 raft_consensus.cc:614] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:51.189709 15297 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.235400 12554 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:51.237293 12630 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:51.236761 12554 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:51.238369 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:51.240589 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 73376us
I20260709 12:24:51.183512 15243 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:51.247726 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.221690 15147 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:51.253337 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.258361 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.259503 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.260540 12630 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:51.264115 13260 heartbeater.cc:646] Failed to heartbeat to 127.11.32.62:45335 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.32.62:45335 timed out after 15.000s (SENT)
I20260709 12:24:51.258898 15383 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.013s
I20260709 12:24:51.249752 15311 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.265799 15383 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:51.266245 15383 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:51.242341 15384 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.242430 15331 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:24:51.249843 15378 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.220446 15048 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:51.273958 15378 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.274174 15048 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:51.265852 15311 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.274606 15048 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:51.274820 15311 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.275461 15048 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.276657 15048 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.206161 15056 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.278277 15025 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:51.206429 15274 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.282421 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.283041 12630 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.284791 12550 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:51.285593 15047 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:51.286471 15047 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.286789 15047 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:51.287569 15047 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.288682 15047 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.295181 15076 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:51.296046 15146 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:51.297189 15146 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:51.297622 15146 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:51.298355 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:51.298512 15146 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.298259 12706 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
W20260709 12:24:51.299052 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 89520.6us
I20260709 12:24:51.301832 13199 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:51.303009 15047 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:51.304163 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.305265 15056 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:51.244522 15297 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.307897 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.308849 12625 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.309062 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:51.310197 12625 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:51.311270 12625 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:51.299324 15243 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:51.313927 15243 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:51.314977 15243 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.315738 12631 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.317233 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:51.317843 12557 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.322969 15031 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7.
I20260709 12:24:51.333580 13199 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:51.337803 12600 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:51.345726 12559 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:51.350574 12557 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:51.352927 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:51.284377 15331 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.299751 15146 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.355701 13199 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:51.344835 15031 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.346592 15340 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:24:51.369118 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.370596 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.380836 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:51.358999 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:51.394125 13234 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.393180 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.397799 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:51.388159 13228 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:51.367478 15291 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:51.456323 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 574) took 1535 ms. Trace:
I20260709 12:24:51.375460 15076 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:51.456745 12632 rpcz_store.cc:276] 0709 12:24:49.920445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.547446 (+627001us) service_pool.cc:224] Handling call
0709 12:24:50.584846 (+ 37400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.765485 (+180639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.456077 (+690592us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b540021f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:51.456253 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":409952000}
I20260709 12:24:51.411877 12706 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:51.362743 15331 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.374960 15383 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.388974 15297 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.396724 15340 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.421744 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.419773 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.422930 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.423779 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.468928 12707 raft_consensus.cc:2368] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:24:51.436542 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.423394 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:51.448984 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51317.8us
I20260709 12:24:51.451375 12630 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:51.398007 12704 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:51.412940 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.425077 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:51.459348 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 217826us
W20260709 12:24:51.461237 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.396167 15025 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.406731 14960 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.477149 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.466560 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.473397 12705 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:51.475907 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.410542 13230 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:51.480931 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.481169 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.481858 12707 raft_consensus.cc:2368] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
W20260709 12:24:51.482645 12523 leader_election.cc:336] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.222s (SENT)
I20260709 12:24:51.483197 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:51.459964 15198 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:51.480320 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.489616 12701 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:51.489763 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:51.489979 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.490721 12702 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:51.490758 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.491806 12708 raft_consensus.cc:2368] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:51.491644 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.492569 12699 raft_consensus.cc:2368] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5.
I20260709 12:24:51.492687 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.493587 12700 raft_consensus.cc:2368] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5.
I20260709 12:24:51.494738 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.495422 12704 raft_consensus.cc:2393] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:51.496588 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.497292 12705 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:51.411720 15169 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:24:51.499058 13227 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:24:51.476837 15025 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:51.472751 15076 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:51.472836 15291 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.496214 15048 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.488116 15235 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:24:51.485780 15147 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:24:51.496428 15345 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:51.515072 12555 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:51.507392 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.579769 12702 raft_consensus.cc:2368] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:51.541548 15327 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:51.566486 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 158076us
I20260709 12:24:51.573390 12701 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.578111 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.583177 12700 raft_consensus.cc:2368] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3.
I20260709 12:24:51.585386 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:51.585856 12552 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:24:51.586247 12552 pending_rounds.cc:85] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 6
I20260709 12:24:51.586519 12552 pending_rounds.cc:107] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:24:51.586333 12559 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:51.586845 12552 raft_consensus.cc:2889] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:51.507675 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.546840 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.554010 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:51.502489 12523 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.745s (SENT)
I20260709 12:24:51.593734 12705 raft_consensus.cc:2368] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:51.585638 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:51.591706 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 236208us
I20260709 12:24:51.596022 12633 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:51.596585 12633 raft_consensus.cc:606] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:51.596927 12633 raft_consensus.cc:614] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:51.505674 15383 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.603067 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:51.605647 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:51.519011 15377 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:51.510818 15025 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.619342 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.620119 12702 raft_consensus.cc:2368] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:24:51.590880 15327 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.612102 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.623836 15231 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.626905 15400 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.627490 15400 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.529309 15341 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.094s
I20260709 12:24:51.616139 15048 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:51.614187 15377 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.590961 15305 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:24:51.558238 15340 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.642079 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.619277 15345 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.573628 15076 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.647647 13228 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:51.645635 13233 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:51.646139 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:24:51.636055 15395 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:24:51.622123 15331 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:51.646705 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:51.656592 13227 raft_consensus.cc:2410] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:51.649730 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.650120 13232 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:51.658075 12704 raft_consensus.cc:2368] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 7.
W20260709 12:24:51.650950 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 161250us
I20260709 12:24:51.635537 15198 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:51.578635 15291 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:51.659233 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 156770us
I20260709 12:24:51.659705 12626 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:51.661397 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.661579 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.664408 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.676182 13228 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:24:51.676483 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.677173 12703 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:51.678030 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.678560 12703 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
W20260709 12:24:51.674957 15391 log.cc:927] Time spent T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:24:51.697968 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.697294 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 6, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.699716 12454 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 5, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 5 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:24:51.705807 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.706676 12702 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.657336 15345 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.708217 15377 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.709388 15377 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:51.710120 15397 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 12:24:51.711302 12456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 220) took 15686 ms (client timeout 15000 ms). Trace:
I20260709 12:24:51.713392 15345 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:51.713994 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49394.7us
W20260709 12:24:51.717519 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.717892 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.719970 12632 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:51.730212 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:51.733063 15246 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:51.733690 15246 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.734925 15404 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:51.736042 15246 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:51.722818 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:51.736483 15327 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.730337 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.659628 15048 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:51.739854 15235 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:51.739405 15048 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.741837 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.742540 12706 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
W20260709 12:24:51.758526 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.763739 13234 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
W20260709 12:24:51.770504 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 74442.9us
I20260709 12:24:51.771040 12703 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:24:51.771342 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.656912 15400 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:51.694196 15399 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:24:51.776613 12454 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 5, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 5 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.787318 12702 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:24:51.812491 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 89718.9us
I20260709 12:24:51.812639 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.813735 12702 raft_consensus.cc:2410] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:51.823539 12700 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:51.718870 15348 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:51.922745 15348 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:51.923266 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.923925 12700 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:51.923682 15348 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.776425 15296 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:51.777292 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.777884 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.925176 12706 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:51.661999 15199 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:51.925550 15031 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:51.692904 13231 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:24:51.783339 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.926069 15031 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.799528 12454 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 3 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.928071 12706 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:51.928565 15031 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:51.928241 12454 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 4, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.764102 15243 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:24:51.929199 12706 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.828507 15208 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:51.835045 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.814018 15407 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.925558 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.931073 15407 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.931728 12703 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:51.933303 12703 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:51.930718 15208 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.782897 15404 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:24:51.934249 15208 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:51.806763 15305 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
W20260709 12:24:51.857225 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.833020 15311 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.558s	user 0.010s	sys 0.001s
I20260709 12:24:51.936535 15311 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:51.711796 12456 rpcz_store.cc:269] 0709 12:24:36.024279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.024420 (+   141us) service_pool.cc:224] Handling call
0709 12:24:51.711006 (+15686586us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:47.347628 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:47.348308 (+   680us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:47.348353 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:24:47.348375 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:47.349147 (+   772us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:47.349210 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:47.349246 (+    36us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:24:47.349901 (+   655us) tablet.cc:701] Row locks acquired
0709 12:24:47.349924 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:24:47.350117 (+   193us) write_op.cc:270] Start()
0709 12:24:47.350249 (+   132us) write_op.cc:276] Timestamp: P: 1783599887350044 usec, L: 0
0709 12:24:47.350285 (+    36us) op_driver.cc:348] REPLICATION: starting
0709 12:24:47.351082 (+   797us) log.cc:844] Serialized 2039 byte log entry
0709 12:24:48.739579 (+1388497us) op_driver.cc:464] REPLICATION: finished
0709 12:24:49.743721 (+1004142us) write_op.cc:301] APPLY: starting
0709 12:24:49.743906 (+   185us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:49.744153 (+   247us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:49.744293 (+   140us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:49.762080 (+ 17787us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:49.833564 (+ 71484us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:24:49.836689 (+  3125us) write_op.cc:312] APPLY: finished
0709 12:24:49.890726 (+ 54037us) log.cc:844] Serialized 47 byte log entry
0709 12:24:50.036903 (+146177us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.064931 (+ 28028us) write_op.cc:454] Released schema lock
0709 12:24:50.114195 (+ 49264us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:50.165851 (+ 51656us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.165880 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5418230,"reported_tablets":19,"child_traces":[["op",{"apply.queue_time_us":1002626,"apply.run_cpu_time_us":14536,"apply.run_wall_time_us":422102,"num_ops":5,"prepare.queue_time_us":469764,"prepare.run_cpu_time_us":39175,"prepare.run_wall_time_us":243847,"raft.queue_time_us":185352,"raft.run_cpu_time_us":46716,"raft.run_wall_time_us":641726,"replication_time_us":1371910,"thread_start_us":602868,"threads_started":5,"wal-append.queue_time_us":630317,"wal-append.run_cpu_time_us":34958,"wal-append.run_wall_time_us":2781333}]]}
I20260709 12:24:51.862926 14960 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:51.937160 15305 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:51.938097 12631 raft_consensus.cc:606] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:51.938691 12631 raft_consensus.cc:614] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:51.938020 15305 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.939188 12628 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.940250 15311 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:51.940809 15305 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:51.892375 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:51.904657 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.769637 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:51.926079 15199 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.931015 12702 raft_consensus.cc:2368] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:24:51.814219 15341 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.965701 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.965932 15341 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:51.966569 12634 raft_consensus.cc:2410] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:51.967408 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.968021 12634 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.967892 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.968488 12630 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.968725 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.969976 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.970335 12626 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:51.971119 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.971961 12627 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:51.972692 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.973718 12629 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:51.974867 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.975941 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.933696 15407 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:51.851109 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.978658 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.979291 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:51.980142 12703 raft_consensus.cc:2410] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:51.838052 15198 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.982679 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:51.965251 15208 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.888286 15025 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:51.932317 12454 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 5, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:24:51.945444 12707 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.953644 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:51.994019 15147 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:51.996757 15345 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:51.988490 12702 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:52.006839 12707 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:52.009109 12707 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:52.018854 12630 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:52.020208 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:51.940876 15311 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.055145 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:52.064558 12634 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:52.066181 12702 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:52.083453 15199 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:52.087481 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:24:52.088379 12631 raft_consensus.cc:606] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:24:52.088799 12631 raft_consensus.cc:614] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:52.097632 15025 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:52.102521 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.053076 12454 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:51.990619 15208 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:52.112950 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:52.117600 12629 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:52.120630 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:52.120863 12707 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:52.140491 12628 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:52.129557 12454 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 4, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:52.219843 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.220276 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:52.226006 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:52.232892 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:52.262748 12454 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.265007 12454 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 5, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 5 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.270457 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:52.280167 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:52.112223 15311 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.286635 12707 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:24:52.290580 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.308162 12708 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:52.319103 12707 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:52.318499 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:52.314890 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:52.259173 15246 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.268829 15404 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:52.334226 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:52.321975 15383 consensus_meta.cc:287] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.005s
W20260709 12:24:52.344767 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 55868.6us
W20260709 12:24:52.323045 15410 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:24:52.347538 13230 raft_consensus.cc:1240] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:52.330731 15056 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.364025 13231 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:52.372049 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:52.369571 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:24:52.384356 15413 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:24:52.384670 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:52.374541 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:52.397692 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 277161us
W20260709 12:24:52.398770 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.362188 15148 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.390792 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:52.402588 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:52.339016 15246 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:52.370004 15047 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.066s	user 0.012s	sys 0.001s
W20260709 12:24:52.432224 12704 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.007s	sys 0.006s
I20260709 12:24:52.347926 15404 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.369764 15429 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.373435 15243 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.454464 12700 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
W20260709 12:24:52.443310 15296 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.006s	sys 0.008s
I20260709 12:24:52.461162 12630 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
W20260709 12:24:52.508882 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.508514 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:52.432542 15291 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.005s	sys 0.012s
W20260709 12:24:52.518582 12706 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.007s	sys 0.011s
W20260709 12:24:52.557276 12706 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.007s	sys 0.017s
I20260709 12:24:52.559381 12628 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:52.516268 15296 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.006s	sys 0.008s
W20260709 12:24:52.518385 15048 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.001s	sys 0.019s
W20260709 12:24:52.555109 15291 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.005s	sys 0.019s
I20260709 12:24:52.437829 15148 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:52.569527 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 294058us
W20260709 12:24:52.576524 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 212750us
I20260709 12:24:52.437620 15383 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:52.444900 15384 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.516599 15056 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:24:52.444437 12704 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.007s	sys 0.006s
I20260709 12:24:52.450893 15047 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:52.444986 15297 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.509322 15121 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:52.604938 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:52.574215 15398 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:24:52.442922 15424 consensus_queue.cc:1059] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.209s
W20260709 12:24:52.445381 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45437.8us
W20260709 12:24:52.594378 15048 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.009s	sys 0.019s
I20260709 12:24:52.566962 15423 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.569614 15420 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.624513 12625 consensus_meta.cc:287] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.624s	user 0.009s	sys 0.000s
I20260709 12:24:52.563266 15429 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.609268 15031 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.654722 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54220.5us
I20260709 12:24:52.657630 12625 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:52.637904 15327 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:52.662467 15148 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:52.663937 15420 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.665563 15435 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:52.647223 15291 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 12:24:52.667631 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53607.4us
W20260709 12:24:52.669543 12524 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.005s	sys 0.009s
W20260709 12:24:52.670984 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 92350.2us
I20260709 12:24:52.671582 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:52.640993 15311 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:52.682004 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.672947 15048 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:52.682951 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:52.675000 12524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.006s	sys 0.009s
I20260709 12:24:52.642673 15383 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:52.699903 15428 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:24:52.706136 15446 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.706705 15446 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:52.675050 15327 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:52.673591 15435 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:52.744589 15377 consensus_meta.cc:287] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.035s	user 0.009s	sys 0.004s
I20260709 12:24:52.689082 15447 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.071s
I20260709 12:24:52.746348 15447 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:52.746807 15447 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:52.747717 15447 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:52.745097 15327 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.749723 15435 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:52.642952 15121 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.521925 15243 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.642235 15384 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.634301 15297 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:52.673300 15031 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.687546 15146 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:52.758805 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 73114.4us
I20260709 12:24:52.799718 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:52.762576 12550 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:24:52.800367 13226 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:52.801451 12627 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:52.806818 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:52.688771 15311 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:52.809041 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:52.809676 12555 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
W20260709 12:24:52.771216 12523 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.571s (SENT)
I20260709 12:24:52.810501 12701 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:24:52.810887 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:52.812391 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:52.813032 12555 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:24:52.765838 15427 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
I20260709 12:24:52.817301 12557 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:52.764838 15447 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.773768 15404 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:52.766224 15246 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:52.767618 15429 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:52.691869 15048 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:52.763027 15423 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.822001 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:52.825057 15409 log.cc:927] Time spent T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.163s	user 0.002s	sys 0.001s
I20260709 12:24:52.820122 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:52.906674 12550 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:52.839176 13234 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:52.900123 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 128952us
W20260709 12:24:52.907817 12523 leader_election.cc:336] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.663s (SENT)
I20260709 12:24:52.908218 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:52.901276 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52486.9us
I20260709 12:24:52.909198 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:52.912966 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:52.822124 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:52.916543 12625 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:52.902345 15435 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.919061 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:52.920471 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:52.922607 12557 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:52.816126 15311 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:52.927047 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 119955us
I20260709 12:24:52.905702 15422 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:52.912221 15246 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.915114 15199 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:52.946359 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:52.918980 15436 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:52.921010 15146 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:52.955471 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.959741 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:52.966507 12557 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:52.929713 15412 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:52.954234 15199 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.924225 15407 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260709 12:24:52.767608 15383 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:52.967386 15313 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.958845 15446 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:52.914862 15423 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:52.988776 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.977697 15412 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.959012 15246 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:52.992427 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1766) took 1014 ms. Trace:
I20260709 12:24:52.983435 15146 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.982539 15199 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.002015 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.003695 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.002377 12555 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:52.992821 12705 rpcz_store.cc:276] 0709 12:24:51.977639 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.977782 (+   143us) service_pool.cc:224] Handling call
0709 12:24:51.986600 (+  8818us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:51.990017 (+  3417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.990051 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:51.990615 (+   564us) log.cc:844] Serialized 52 byte log entry
0709 12:24:52.230540 (+239925us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:52.305453 (+ 74913us) log.cc:844] Serialized 14 byte log entry
0709 12:24:52.305716 (+   263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.305834 (+   118us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.992205 (+686371us) raft_consensus.cc:1685] finished
0709 12:24:52.992223 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.992370 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":368,"prepare.queue_time_us":86827,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":58,"raft.queue_time_us":4585,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":14334,"thread_start_us":239501,"threads_started":1,"wal-append.queue_time_us":376892}
I20260709 12:24:52.984790 15438 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:24:53.011761 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 103965us
I20260709 12:24:53.018741 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 488) took 1354 ms. Trace:
I20260709 12:24:52.992605 15412 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.019191 12699 rpcz_store.cc:276] 0709 12:24:51.664739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.664843 (+   104us) service_pool.cc:224] Handling call
0709 12:24:51.691205 (+ 26362us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.691426 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.691450 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.691904 (+   454us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.814799 (+122895us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:51.837995 (+ 23196us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.838238 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.838318 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:52.661755 (+823437us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b18000540a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:52.824526 (+162771us) spinlock_profiling.cc:243] Waited 6.92 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:53.011946 (+187420us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b18000540a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:53.018537 (+  6591us) raft_consensus.cc:1685] finished
0709 12:24:53.018559 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.018679 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27080,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":5052,"spinlock_wait_cycles":66126720,"thread_start_us":122539,"threads_started":1,"wal-append.queue_time_us":153522}
I20260709 12:24:53.027334 15146 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.027931 15146 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.030728 15243 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:52.997534 15423 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.033504 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.034226 15031 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:53.027513 15452 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:24:53.038254 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.010490 15429 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:53.051265 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 91618.5us
I20260709 12:24:53.052369 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.009370 15449 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:53.053661 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:53.062891 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:53.039458 15297 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.054957 15429 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:53.021181 15438 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:53.077594 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 166253us
I20260709 12:24:53.054461 15229 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.061014 15449 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:53.073271 15429 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.071662 15348 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.069844 15313 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:53.092998 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.067538 15121 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.072050 15311 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:53.100337 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 94143.1us
I20260709 12:24:53.085129 15146 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.106709 12671 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.107196 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.108394 15449 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.111089 15466 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.112305 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:53.112583 15425 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.532s	user 0.000s	sys 0.010s
I20260709 12:24:53.113101 15466 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:53.104750 15313 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:24:53.113933 15457 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:24:53.114311 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:53.118288 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1762) took 1447 ms. Trace:
I20260709 12:24:53.118737 12704 rpcz_store.cc:276] 0709 12:24:51.670426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.790547 (+120121us) service_pool.cc:224] Handling call
0709 12:24:51.816319 (+ 25772us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.833384 (+ 17065us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.833448 (+    64us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.857926 (+ 24478us) log.cc:844] Serialized 26 byte log entry
0709 12:24:52.611245 (+753319us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:52.611303 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:52.611399 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:53.112057 (+500658us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:24:53.115052 (+  2995us) raft_consensus.cc:1685] finished
0709 12:24:53.115070 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:53.118224 (+  3154us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6956,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3189,"spinlock_wait_cycles":34045824,"thread_start_us":730078,"threads_started":1,"wal-append.queue_time_us":633494}
I20260709 12:24:53.096483 15461 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:53.123984 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.124599 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.098372 15229 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:24:53.132572 15394 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.133193 15394 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:53.134343 15445 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.469s	user 0.001s	sys 0.001s
I20260709 12:24:53.135444 15394 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:53.131958 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.138237 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:53.137162 12523 leader_election.cc:336] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.245s (SENT)
I20260709 12:24:53.138892 12626 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:53.139359 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:53.139953 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:53.140249 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.140722 12552 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:53.139961 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:53.149973 15432 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.484s	user 0.007s	sys 0.004s
I20260709 12:24:53.153689 15208 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:53.153865 15394 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.154156 15208 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.154557 15208 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:53.156615 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.114506 15313 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.121150 15031 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:53.127562 15461 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:53.123731 15384 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.161553 15146 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:53.148823 15311 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.147461 15466 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:53.165184 14960 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:53.196952 15146 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:53.210057 15341 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.211637 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:53.222291 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 108102us
I20260709 12:24:53.222339 12707 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:53.214547 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2207) took 1248 ms. Trace:
I20260709 12:24:53.216391 15412 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.220003 15305 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:53.220547 15438 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.223459 12627 rpcz_store.cc:276] 0709 12:24:51.966607 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.972465 (+  5858us) service_pool.cc:224] Handling call
0709 12:24:53.214358 (+1241893us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b5400116554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:53.214482 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1794818944}
I20260709 12:24:53.221506 15048 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.229714 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.229564 15461 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.230029 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.229713 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:24:53.231564 15454 log.cc:927] Time spent T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
I20260709 12:24:53.233506 15348 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:53.282337 15429 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.282756 15348 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.283970 15412 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.284518 15429 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:53.284817 15348 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:53.237975 13226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 693) took 1883 ms (client timeout 1563 ms). Trace:
I20260709 12:24:53.237653 15466 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.243022 15146 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.244547 13234 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:53.256474 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:53.258690 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:53.262105 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.273226 12555 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 12:24:53.277426 12554 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:53.291205 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.279788 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.280012 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.280903 15199 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:53.282166 15408 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.951s	user 0.004s	sys 0.000s
W20260709 12:24:53.236537 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.279805 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.286300 12553 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:24:53.287339 13226 rpcz_store.cc:269] 0709 12:24:51.354986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.355106 (+   120us) service_pool.cc:224] Handling call
0709 12:24:53.237788 (+1882682us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400575654. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:53.237902 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2930584832}
I20260709 12:24:53.203856 14960 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.291175 12555 pending_rounds.cc:85] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 1
I20260709 12:24:53.292004 12558 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:53.297850 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.227808 15305 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:53.308099 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:53.289629 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 149727us
I20260709 12:24:53.302232 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:53.303843 15473 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:53.308137 12555 pending_rounds.cc:107] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 12:24:53.317945 12555 raft_consensus.cc:2889] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:53.303966 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.308434 12627 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:24:53.323319 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.326224 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:53.326814 12625 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.332121 13227 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:24:53.305795 15199 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.316623 15313 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.334781 12625 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:53.338092 15404 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:53.338471 15404 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.338816 15404 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.334755 13230 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:53.346284 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.346306 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.317186 15417 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 12:24:53.333063 15394 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:53.355250 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:53.368278 12632 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:24:53.362815 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 63593.1us
I20260709 12:24:53.330749 15384 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:53.371354 15384 consensus_queue.cc:1243] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:53.371984 15384 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:53.372313 15384 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:53.350029 15305 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:53.375712 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.385291 12671 leader_election.cc:400] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:24:53.385215 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:53.388345 12671 leader_election.cc:403] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:53.390887 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:53.391616 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.353818 15383 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:53.325740 15473 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.357944 15148 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:24:53.405836 15148 consensus_queue.cc:1243] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:53.406458 15148 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:53.406890 15148 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:53.407908 15148 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.397768 15305 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.421868 15148 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.423549 15327 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:53.424324 15327 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.427807 15327 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.370455 15394 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.432276 15394 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:53.432901 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.369052 15423 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 12:24:53.436645 13233 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:53.373271 15384 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.439277 15384 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:53.442477 15313 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:53.442962 12701 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:53.442080 15404 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.444134 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:53.444681 12705 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.391337 15472 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
W20260709 12:24:53.453814 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 60066.4us
I20260709 12:24:53.454969 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:53.456058 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 72246us
I20260709 12:24:53.458922 15300 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.460409 15047 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:53.461074 15047 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:53.462463 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.462236 15047 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:53.467868 15441 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.804s	user 0.000s	sys 0.002s
W20260709 12:24:53.471760 15444 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.810s	user 0.000s	sys 0.012s
I20260709 12:24:53.473520 15348 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.474083 15348 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:53.479329 15442 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.816s	user 0.006s	sys 0.005s
W20260709 12:24:53.495239 15433 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.832s	user 0.000s	sys 0.012s
I20260709 12:24:53.496305 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:53.497681 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 106931us
I20260709 12:24:53.497854 15348 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.498442 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:53.501384 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46556.7us
W20260709 12:24:53.501530 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 199155us
I20260709 12:24:53.506560 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.507332 12700 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
W20260709 12:24:53.507542 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 365632us
I20260709 12:24:53.507823 15420 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.505865 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:53.516332 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:53.516986 12553 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:53.519205 12553 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:53.521801 15056 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:53.522344 15056 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.522758 15056 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.524327 14774 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.527815 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:53.529842 15437 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:24:53.530128 15345 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:53.541357 15235 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260709 12:24:53.542680 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.537014 15231 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:24:53.550889 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.554005 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.562595 12552 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:53.563032 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:53.567622 12553 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.564916 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.565189 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.565800 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.574194 12633 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:53.576360 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.576975 12552 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
W20260709 12:24:53.581490 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 83132.9us
I20260709 12:24:53.582275 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.583233 12553 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:24:53.588195 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:53.588938 12556 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.591588 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.531462 15199 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.545951 15469 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.586463 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.610966 12628 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:53.587590 12629 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:53.585853 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:53.596616 12634 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.586215 12625 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:53.596697 15296 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.599548 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:53.566646 15404 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.623193 12705 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:53.594358 14960 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:53.608628 15313 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:53.692310 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 152570us
I20260709 12:24:53.693110 13199 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:53.694360 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.640993 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:53.599762 15401 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:24:53.695408 12554 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:24:53.699656 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:53.702524 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.703174 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.703413 12706 raft_consensus.cc:2410] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:53.704977 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 105527us
I20260709 12:24:53.704988 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.702080 12556 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:53.593320 15412 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.101s
I20260709 12:24:53.717051 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.718585 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:53.720448 12702 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.723407 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.723929 12705 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:53.716524 15457 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:24:53.750986 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 164428us
I20260709 12:24:53.753072 12702 raft_consensus.cc:2410] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:53.713554 15450 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:53.712157 15384 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.711717 15469 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:24:53.725334 15430 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:24:53.714170 15031 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:53.758625 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:53.632793 15296 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.760695 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:53.726014 15076 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.743750 15473 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.785967 12632 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:53.724759 15446 consensus_queue.cc:1059] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:53.742020 15461 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260709 12:24:53.806959 12597 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.4:37323 timed out after 1.863s (SENT) [suppressed 12 similar messages]
I20260709 12:24:53.803002 15076 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.827330 15056 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:53.801369 15383 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:53.814203 15437 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:53.811825 15459 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 12:24:53.808398 15235 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.761567 15025 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:24:53.785256 15384 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:53.829295 15208 consensus_meta.cc:287] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.674s	user 0.012s	sys 0.001s
W20260709 12:24:53.810391 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 49781.5us
I20260709 12:24:53.839993 15469 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:53.847704 15383 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.856134 15437 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.853058 15313 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:53.893975 12633 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:24:53.891733 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:53.892511 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 177225us
W20260709 12:24:53.892138 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 325918us
I20260709 12:24:53.894963 15383 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:53.899626 15472 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:53.907305 15498 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:53.914654 15435 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:53.916033 15056 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.870599 15417 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.857311 15235 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.945142 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:53.889947 15291 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.911484 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:53.949149 12702 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:53.914261 15492 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:24:53.900090 15437 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.950246 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.958200 12703 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:53.951462 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:53.959533 12633 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:53.951747 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.952049 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:53.960505 12708 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:53.961526 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:53.962144 12708 raft_consensus.cc:2376] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7. Re-sending same reply.
I20260709 12:24:53.962904 12700 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.962929 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:53.964695 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53287.1us
I20260709 12:24:53.964821 12705 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:53.965622 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:53.959901 12706 raft_consensus.cc:2376] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6. Re-sending same reply.
W20260709 12:24:53.991053 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.914319 15296 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:53.888422 15208 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.026996 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.027712 12708 raft_consensus.cc:2376] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7. Re-sending same reply.
I20260709 12:24:54.028906 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.029613 12708 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:54.035301 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.035955 12708 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:54.041399 15384 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:54.042475 12702 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:54.043684 12708 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:24:54.039980 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:53.895179 15469 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.034718 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.048084 12705 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:24:54.051385 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:53.965632 15498 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:54.061493 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:54.063748 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:53.935132 15313 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:54.066713 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 101202us
I20260709 12:24:54.054396 15404 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.070667 15404 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.073531 14960 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:54.073822 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:54.074560 15384 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.075023 15384 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:54.075412 15384 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.077045 15459 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:54.077551 15459 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:54.077993 15459 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.088014 15076 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:54.089622 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:54.087102 15438 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.095459 15438 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.021554 15291 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:54.104852 12632 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:54.123201 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:54.126780 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 319823us
I20260709 12:24:54.126986 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:53.954327 15417 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:53.952369 15472 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.073235 15404 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:54.181746 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 53850.8us
I20260709 12:24:54.045279 15243 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:24:54.187697 12700 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:54.118225 15311 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:54.185034 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:24:54.145452 15485 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260709 12:24:54.145466 15493 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
W20260709 12:24:54.242841 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 57952.4us
I20260709 12:24:54.143118 15422 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:54.248569 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:54.190232 15446 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.144413 15495 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:54.194983 15377 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.265394 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:54.263339 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 223755us
I20260709 12:24:54.277489 15377 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:54.277880 15169 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.249076 15422 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.266160 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.261269 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:54.270283 15499 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
W20260709 12:24:54.271291 15489 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
W20260709 12:24:54.271675 15487 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
I20260709 12:24:54.263727 15400 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:54.275543 15464 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:54.293776 12700 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:54.254029 15345 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:54.278539 15305 consensus_meta.cc:287] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.860s	user 0.012s	sys 0.001s
I20260709 12:24:54.208483 15348 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:54.316069 12634 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:54.316722 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.266408 15056 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.247954 15243 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.295151 12702 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:54.325373 12626 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.009s	sys 0.010s
W20260709 12:24:54.391222 12626 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.010s	sys 0.010s
I20260709 12:24:54.392043 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 623) took 1067 ms. Trace:
I20260709 12:24:54.278465 15422 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:54.405884 15494 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:24:54.280035 15297 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:54.367466 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.369953 12632 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:54.371696 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.278991 15429 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:54.368835 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.490931 13228 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:54.392469 12626 rpcz_store.cc:276] 0709 12:24:53.324431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.324552 (+   121us) service_pool.cc:224] Handling call
0709 12:24:53.324829 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:53.325026 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:53.780077 (+455051us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.391685 (+611608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.391748 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:54.391790 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.391856 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.391983 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14655,"prepare.queue_time_us":52201,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1596,"thread_start_us":1036254,"threads_started":2}
I20260709 12:24:54.278769 15495 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:54.372587 15475 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:24:54.330384 15076 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:54.473031 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:54.486541 13233 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:54.509265 12558 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:54.293090 15446 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:54.524716 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1790) took 1036 ms. Trace:
I20260709 12:24:54.365665 15404 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.170s
I20260709 12:24:54.410950 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.381748 15056 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:54.273660 15498 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:54.333889 15464 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.772714 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2044) took 1008 ms. Trace:
W20260709 12:24:54.768254 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 148189us
I20260709 12:24:54.768517 13232 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:54.576457 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.603720 12702 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
W20260709 12:24:54.821169 12673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.007s	sys 0.037s
W20260709 12:24:54.827378 12673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.007s	sys 0.037s
I20260709 12:24:54.526260 12701 rpcz_store.cc:276] 0709 12:24:53.488613 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.491839 (+  3226us) service_pool.cc:224] Handling call
0709 12:24:53.492207 (+   368us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.492460 (+   253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.492496 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.493023 (+   527us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.782877 (+289854us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:53.782920 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.782984 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.524501 (+741517us) raft_consensus.cc:1685] finished
0709 12:24:54.524525 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.524653 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":289455,"threads_started":1,"wal-append.queue_time_us":820312}
I20260709 12:24:54.822814 12552 rpcz_store.cc:276] 0709 12:24:53.763894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.771902 (+1008008us) service_pool.cc:224] Handling call
0709 12:24:54.772218 (+   316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.772398 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.772422 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.772461 (+    39us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:54.772490 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.772560 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.772655 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.587837 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:54.825846 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 560495us
I20260709 12:24:54.830349 13232 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:24:54.726135 12558 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:54.684991 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 1845) took 1120 ms. Trace:
I20260709 12:24:54.838856 13232 pending_rounds.cc:85] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 6
I20260709 12:24:54.839308 13232 pending_rounds.cc:107] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:24:54.839625 13232 raft_consensus.cc:2889] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:54.840937 12552 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:54.841814 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2045) took 1003 ms. Trace:
I20260709 12:24:54.842211 12552 rpcz_store.cc:276] 0709 12:24:53.838460 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.831596 (+993136us) service_pool.cc:224] Handling call
0709 12:24:54.831915 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.841487 (+  9572us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.841742 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.838861 12554 rpcz_store.cc:276] 0709 12:24:53.564399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.564889 (+   490us) service_pool.cc:224] Handling call
0709 12:24:54.684752 (+1119863us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b54001d24d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:54.684887 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279368576}
I20260709 12:24:54.847877 12702 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:24:54.848263 12702 pending_rounds.cc:85] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 5
I20260709 12:24:54.848547 12702 pending_rounds.cc:107] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:24:54.848852 12702 raft_consensus.cc:2889] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:54.516829 15500 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:24:54.682365 15505 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:24:54.850880 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.891393 12554 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:54.891984 12701 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:54.892220 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:54.500082 15495 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:54.772044 15300 consensus_meta.cc:287] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.312s	user 0.014s	sys 0.000s
W20260709 12:24:54.583225 15506 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.258s	user 0.000s	sys 0.000s
W20260709 12:24:54.537954 15490 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 12:24:54.762051 15313 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:54.507387 15438 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:54.765261 15417 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:54.773269 15446 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:54.507467 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:54.893195 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.860188 15048 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:54.587632 15246 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:54.527565 15076 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:54.897660 15501 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.025s	sys 0.030s
I20260709 12:24:54.896324 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:54.438434 15348 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.516566 15305 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:54.515638 15311 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:54.904115 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 691) took 1004 ms. Trace:
I20260709 12:24:54.900743 15377 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:54.682324 15472 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:54.904403 12706 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.019s	sys 0.057s
W20260709 12:24:54.937603 12706 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.019s	sys 0.057s
I20260709 12:24:54.410895 15243 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.762742 15469 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:54.906005 12554 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:24:54.858340 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1850) took 1279 ms. Trace:
I20260709 12:24:54.576033 14960 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:54.507269 15429 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.902282 15300 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.764706 15422 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:54.561672 15208 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:54.597769 15497 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.646s
I20260709 12:24:54.922483 13199 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:54.921023 12558 rpcz_store.cc:276] 0709 12:24:53.900168 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.859265 (+959097us) service_pool.cc:224] Handling call
0709 12:24:54.903641 (+ 44376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.903810 (+   169us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.903834 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.903871 (+    37us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:54.903899 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.903948 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.904042 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:54.904896 15297 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:24:54.908002 15438 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:54.939364 12671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.001s	sys 0.019s
I20260709 12:24:54.890836 15147 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:24:54.941129 12555 rpcz_store.cc:276] 0709 12:24:53.579147 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.581870 (+  2723us) service_pool.cc:224] Handling call
0709 12:24:53.582161 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.582416 (+   255us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.582444 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.603654 (+ 21210us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.942005 (+338351us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:53.942044 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.942113 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.858043 (+915930us) raft_consensus.cc:1685] finished
0709 12:24:54.858071 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.858265 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":222425,"threads_started":1,"wal-append.queue_time_us":565520}
W20260709 12:24:54.991025 12671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.001s	sys 0.020s
I20260709 12:24:54.913796 15446 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:54.927736 15501 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.025s	sys 0.031s
W20260709 12:24:54.987406 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 65010.1us
I20260709 12:24:54.924204 15246 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.992041 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:54.989400 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1852) took 1231 ms. Trace:
I20260709 12:24:54.994206 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:54.994838 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:54.986765 13231 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:54.998502 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 776) took 1687 ms. Trace:
W20260709 12:24:54.996912 12674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.700s	user 0.020s	sys 0.045s
I20260709 12:24:54.997311 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:24:54.999910 12674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.020s	sys 0.046s
I20260709 12:24:54.994423 12559 rpcz_store.cc:276] 0709 12:24:53.757758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.758437 (+   679us) service_pool.cc:224] Handling call
0709 12:24:53.786665 (+ 28228us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.800212 (+ 13547us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.800252 (+    40us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.800813 (+   561us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.945351 (+144538us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:53.945391 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.945472 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.989185 (+1043713us) raft_consensus.cc:1685] finished
0709 12:24:54.989206 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.989337 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17668,"raft.queue_time_us":21816,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":14556,"thread_start_us":135842,"threads_started":1,"wal-append.queue_time_us":572049}
I20260709 12:24:55.000475 15469 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:24:54.996002 15472 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:55.003422 15514 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:24:55.000813 15313 raft_consensus.cc:2764] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:55.004316 15446 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.005155 15469 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:54.994040 15517 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:54.923256 15048 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.012424 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:54.946746 15305 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:54.994565 15208 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:55.019207 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1854) took 1257 ms. Trace:
I20260709 12:24:55.020895 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:55.018435 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:24:54.999115 13235 rpcz_store.cc:276] 0709 12:24:53.310666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.321690 (+ 11024us) service_pool.cc:224] Handling call
0709 12:24:53.322068 (+   378us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.325592 (+  3524us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.325626 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.331909 (+  6283us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.481112 (+149203us) spinlock_profiling.cc:243] Waited 8.04 ms on lock 0x7b18004bf760. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe522 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:53.486991 (+  5879us) spinlock_profiling.cc:243] Waited 988 us on lock 0x7b18004bf760. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b0d1 00007f0e94aa6a0f
0709 12:24:53.763319 (+276328us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:54.251503 (+488184us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.254718 (+  3215us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.254989 (+   271us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.998246 (+743257us) raft_consensus.cc:1685] finished
0709 12:24:54.998268 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:54.998428 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43980,"prepare.queue_time_us":1178523,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4126,"raft.queue_time_us":10263,"raft.run_cpu_time_us":294,"raft.run_wall_time_us":20136,"spinlock_wait_cycles":21516544,"thread_start_us":684491,"threads_started":2,"wal-append.queue_time_us":524369}
W20260709 12:24:55.011345 15437 consensus_meta.cc:287] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.987s	user 0.011s	sys 0.000s
I20260709 12:24:54.988520 15311 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.006520 15446 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.024299 12557 rpcz_store.cc:276] 0709 12:24:53.762169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.502339 (+740170us) service_pool.cc:224] Handling call
0709 12:24:54.789876 (+287537us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.790138 (+   262us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:54.860520 (+ 70382us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.018804 (+158284us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.018868 (+    64us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:55.018927 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.019010 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.019142 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":68745,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"thread_start_us":127258,"threads_started":1}
I20260709 12:24:55.008124 15300 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:55.038645 12703 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.721s	user 0.014s	sys 0.028s
W20260709 12:24:55.039690 12703 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.014s	sys 0.028s
I20260709 12:24:55.012317 15472 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.012581 15429 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.054837 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:55.024746 15503 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260709 12:24:55.009889 15231 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:55.003285 14960 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.011524 15313 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:55.081600 15056 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:55.081847 15313 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:24:55.022725 15406 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.818s	user 0.014s	sys 0.058s
I20260709 12:24:55.054788 15446 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:55.066326 12633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.017s	sys 0.031s
I20260709 12:24:55.070979 15311 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.071952 15076 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.074721 15048 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.078209 15243 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.038779 15437 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.078693 15305 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:55.083372 12633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.017s	sys 0.031s
W20260709 12:24:55.083850 15406 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.880s	user 0.014s	sys 0.058s
W20260709 12:24:55.109723 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 109664us
I20260709 12:24:55.062120 15472 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:55.117331 15523 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:55.119953 15305 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:55.122879 15148 raft_consensus.cc:3055] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:55.114393 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:55.129278 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 394152us
I20260709 12:24:55.108939 15048 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:55.130543 13199 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:55.006199 15517 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.087503 15446 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:55.150893 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 132568us
I20260709 12:24:55.118005 15528 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.129017 15148 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:55.140040 15243 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:55.128611 15305 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:55.127336 15313 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.157302 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:55.167081 12701 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:55.170280 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:55.128104 15076 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:24:55.148813 15231 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:55.144140 15048 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.174791 15533 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:55.155026 15422 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.175299 15533 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.149734 15525 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.176654 15048 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:55.177682 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 49464.4us
I20260709 12:24:55.176302 15525 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.178082 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1846) took 1613 ms. Trace:
I20260709 12:24:55.178582 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:55.165876 15459 consensus_meta.cc:287] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.083s	user 0.014s	sys 0.000s
I20260709 12:24:55.181901 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:55.166499 15384 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.091s	user 0.014s	sys 0.000s
I20260709 12:24:55.165221 15243 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.162889 15528 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:55.203110 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 148356us
W20260709 12:24:55.177961 15383 consensus_meta.cc:287] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.234s	user 0.013s	sys 0.000s
I20260709 12:24:55.185084 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:55.250487 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 65495.8us
I20260709 12:24:55.173220 15348 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:55.163369 15497 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 12:24:55.261531 15539 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.262137 15539 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.262988 15502 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.263525 15502 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.264335 15539 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:55.264878 15539 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:55.244514 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2021) took 1276 ms. Trace:
I20260709 12:24:55.177551 15533 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:55.177820 15437 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:55.247313 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:55.265544 12706 rpcz_store.cc:276] 0709 12:24:53.967866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.024912 (+ 57046us) service_pool.cc:224] Handling call
0709 12:24:54.080730 (+ 55818us) spinlock_profiling.cc:243] Waited 1.84 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:54.080988 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.199373 (+118385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.199466 (+    93us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.200520 (+  1054us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.327050 (+126530us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.938139 (+611089us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.938423 (+   284us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.938519 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.242645 (+304126us) raft_consensus.cc:1685] finished
0709 12:24:55.244311 (+  1666us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.244455 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":63272,"prepare.queue_time_us":689195,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":456,"raft.queue_time_us":68269,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":39491,"spinlock_wait_cycles":4237184,"thread_start_us":641919,"threads_started":2,"wal-append.queue_time_us":753481}
I20260709 12:24:55.267321 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:55.267686 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:55.269496 15406 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.269953 15406 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.270617 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:55.271240 15235 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.271664 12626 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:24:55.273036 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:55.273685 12625 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.179029 12551 rpcz_store.cc:276] 0709 12:24:53.564700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.564842 (+   142us) service_pool.cc:224] Handling call
0709 12:24:53.581287 (+ 16445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:53.589949 (+  8662us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.589979 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:53.608963 (+ 18984us) log.cc:844] Serialized 52 byte log entry
0709 12:24:53.943615 (+334652us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.035419 (+ 91804us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.035790 (+   371us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.035951 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.036020 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.177237 (+1141217us) raft_consensus.cc:1685] finished
0709 12:24:55.177289 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.178023 (+   734us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":52950,"prepare.queue_time_us":515500,"prepare.run_cpu_time_us":101,"prepare.run_wall_time_us":103,"raft.queue_time_us":20527,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":17522,"spinlock_wait_cycles":26045056,"thread_start_us":288600,"threads_started":2,"wal-append.queue_time_us":1022878}
I20260709 12:24:55.218639 15532 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.249128 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:55.279173 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:55.279403 15532 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.203946 15048 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:55.252825 15517 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:55.253144 15311 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:55.254663 15291 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:55.250093 15243 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:55.257395 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 54949.6us
I20260709 12:24:55.173029 15313 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.243316 15148 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.276641 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:55.301899 12705 raft_consensus.cc:2410] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:24:55.166162 15305 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:55.272349 15535 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:55.203673 15459 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.245708 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:55.218533 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:55.293531 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:55.251194 15422 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:55.271802 15235 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:55.298223 15527 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:24:55.298875 15311 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.271936 15406 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:55.299464 15525 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:55.298800 15502 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:55.261076 15383 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:55.281311 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:55.291718 15530 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:24:55.249897 15384 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.285331 15048 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.283447 15539 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:55.298734 15400 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.303424 12625 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:24:56.244659 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 786) took 1065 ms. Trace:
W20260709 12:24:56.245177 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.245433 15048 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.292165 15327 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.160041 15495 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.255s	user 0.008s	sys 0.005s
I20260709 12:24:56.246532 15495 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:55.536520 15536 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:24:56.247856 15384 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.248191 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 509) took 1418 ms. Trace:
I20260709 12:24:56.248461 15384 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.291930 15533 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:55.315167 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.271697 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 639) took 1002 ms. Trace:
W20260709 12:24:55.477520 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 191947us
W20260709 12:24:56.225659 12672 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.003s	sys 0.021s
W20260709 12:24:56.273276 12672 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.003s	sys 0.022s
I20260709 12:24:56.271870 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 640) took 1002 ms. Trace:
I20260709 12:24:56.272392 12625 rpcz_store.cc:276] 0709 12:24:55.269594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.272819 (+  3225us) service_pool.cc:224] Handling call
0709 12:24:56.271587 (+998768us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.611963 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1853) took 1850 ms. Trace:
I20260709 12:24:56.275466 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:55.926584 13235 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.011s	sys 0.028s
I20260709 12:24:56.248569 12702 rpcz_store.cc:276] 0709 12:24:54.843635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.853302 (+  9667us) service_pool.cc:224] Handling call
0709 12:24:54.853722 (+   420us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.861046 (+  7324us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.890973 (+ 29927us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.895430 (+  4457us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.120019 (+224589us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:55.120092 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.120185 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.247996 (+1127811us) raft_consensus.cc:1685] finished
0709 12:24:56.248015 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.248133 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":706,"raft.queue_time_us":36786,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":7120,"thread_start_us":173362,"threads_started":1,"wal-append.queue_time_us":366928}
I20260709 12:24:56.287006 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:56.288189 12632 rpcz_store.cc:276] 0709 12:24:55.269898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.274291 (+  4393us) service_pool.cc:224] Handling call
0709 12:24:56.271810 (+997519us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:56.287710 13235 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.982s	user 0.012s	sys 0.038s
I20260709 12:24:55.468853 15546 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.248802 15495 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:55.537792 15543 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:24:55.439903 15529 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260709 12:24:55.300258 15348 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.001s
I20260709 12:24:56.245206 13232 rpcz_store.cc:276] 0709 12:24:55.179472 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.180528 (+  1056us) service_pool.cc:224] Handling call
0709 12:24:55.180935 (+   407us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.182056 (+  1121us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.182101 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.182641 (+   540us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.287090 (+104449us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.287131 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.287194 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.244444 (+957250us) raft_consensus.cc:1685] finished
0709 12:24:56.244463 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.244593 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":20313,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":14961,"spinlock_wait_cycles":16244992,"thread_start_us":52813,"threads_started":1,"wal-append.queue_time_us":317271}
I20260709 12:24:56.287492 12704 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
W20260709 12:24:56.300992 12673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.011s	sys 0.022s
W20260709 12:24:55.439071 15515 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.409s	user 0.001s	sys 0.002s
I20260709 12:24:56.346019 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1805) took 1050 ms. Trace:
I20260709 12:24:55.400389 15472 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.286209 12550 rpcz_store.cc:276] 0709 12:24:53.761837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.761974 (+   137us) service_pool.cc:224] Handling call
0709 12:24:53.790738 (+ 28764us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.808946 (+ 18208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.808977 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.809439 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:24:53.856281 (+ 46842us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:53.892956 (+ 36675us) log.cc:844] Serialized 14 byte log entry
0709 12:24:53.893502 (+   546us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:53.893605 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:54.770757 (+877152us) spinlock_profiling.cc:243] Waited 6.19 ms on lock 0x7b18004e1f00. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe522 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:55.564802 (+794045us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b18004e1f00. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919cc2a6 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1
0709 12:24:55.566682 (+  1880us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b18004e1f00. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:24:55.611662 (+ 44980us) raft_consensus.cc:1685] finished
0709 12:24:55.611692 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.611884 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19973,"prepare.queue_time_us":33998,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":7398,"raft.queue_time_us":18688,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":25055,"spinlock_wait_cycles":61671936,"thread_start_us":15823,"threads_started":1,"wal-append.queue_time_us":90204}
I20260709 12:24:55.471625 15528 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:55.583526 15486 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 1.388s	user 0.000s	sys 0.003s
W20260709 12:24:56.370085 13229 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.082s	user 0.021s	sys 0.000s
W20260709 12:24:56.382870 13229 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.022s	sys 0.000s
W20260709 12:24:56.287472 15121 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.006s	user 0.014s	sys 0.013s
I20260709 12:24:56.282996 15400 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.291659 15148 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:55.437549 15540 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:55.526292 15446 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:56.282208 15526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.014s	sys 0.003s
I20260709 12:24:55.553280 15544 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.378448 12702 rpcz_store.cc:276] 0709 12:24:55.295470 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.300151 (+1004681us) service_pool.cc:224] Handling call
0709 12:24:56.300497 (+   346us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.300765 (+   268us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.300807 (+    42us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.300867 (+    60us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:56.300916 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.345830 (+ 44914us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.345962 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:56.379513 12673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.899s	user 0.018s	sys 0.029s
W20260709 12:24:56.379972 12704 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 2014) took 2428 ms (client timeout 2172 ms). Trace:
W20260709 12:24:56.395884 12704 rpcz_store.cc:269] 0709 12:24:53.952027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.952145 (+   118us) service_pool.cc:224] Handling call
0709 12:24:56.275299 (+2323154us) spinlock_profiling.cc:243] Waited 7.42 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:56.379877 (+104578us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17060608}
I20260709 12:24:56.282328 15533 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:56.316512 15450 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.513s	user 0.030s	sys 0.020s
I20260709 12:24:55.395931 15542 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:56.385769 15551 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
W20260709 12:24:56.381683 12700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.738s	user 0.009s	sys 0.014s
W20260709 12:24:56.405061 12700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.010s	sys 0.015s
I20260709 12:24:56.384160 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:56.295691 15422 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:55.359148 15476 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 1.054s
I20260709 12:24:55.471238 15305 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.296324 13231 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:56.249082 15384 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.344959 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 785) took 1170 ms. Trace:
I20260709 12:24:56.423247 13230 rpcz_store.cc:276] 0709 12:24:55.174523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.203679 (+ 29156us) service_pool.cc:224] Handling call
0709 12:24:56.310421 (+1106742us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:56.427121 15517 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.246503 15327 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:55.410274 15545 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 1.010s
I20260709 12:24:55.359702 15532 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.349098 15525 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:55.315536 15535 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.282635 15235 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.403077 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1807) took 1107 ms. Trace:
I20260709 12:24:56.475696 12702 rpcz_store.cc:276] 0709 12:24:55.296050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.401906 (+1105856us) service_pool.cc:224] Handling call
0709 12:24:56.402325 (+   419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.402586 (+   261us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.402629 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.402707 (+    78us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:56.402758 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.402842 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.402999 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:56.470489 15529 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:24:56.394812 15526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.017s	sys 0.006s
W20260709 12:24:56.387971 15121 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.019s	sys 0.018s
W20260709 12:24:56.398196 15450 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.599s	user 0.037s	sys 0.028s
I20260709 12:24:56.397337 15472 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.416359 15311 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.416906 15554 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.418978 15305 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.419498 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 784) took 1245 ms. Trace:
I20260709 12:24:56.420925 15406 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:56.399260 15446 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:56.484393 15559 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.422816 15384 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.397899 15533 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:56.345780 15546 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.464325 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 637) took 2200 ms. Trace:
I20260709 12:24:56.484274 15450 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:56.400314 15553 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.465538 15548 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:24:56.388294 15550 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.427763 15517 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:56.468007 15243 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.163s	user 0.013s	sys 0.001s
I20260709 12:24:56.472515 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 519) took 1195 ms. Trace:
I20260709 12:24:56.410262 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 792) took 1133 ms. Trace:
I20260709 12:24:56.474987 15331 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.407189 15544 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.458626 15422 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.484797 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 518) took 1266 ms. Trace:
I20260709 12:24:56.409476 15539 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.399619 15540 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.481009 15555 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:56.406495 15542 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.389333 15423 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.478547 15532 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.498238 12633 rpcz_store.cc:276] 0709 12:24:54.264232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.266782 (+  2550us) service_pool.cc:224] Handling call
0709 12:24:54.498190 (+231408us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.500316 (+  2126us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.500360 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.500940 (+   580us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.108846 (+607906us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:55.108902 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.108990 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.436935 (+1327945us) raft_consensus.cc:1685] finished
0709 12:24:56.436963 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.464252 (+ 27289us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13140,"raft.queue_time_us":8584,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":21459,"thread_start_us":572575,"threads_started":1,"wal-append.queue_time_us":613022}
I20260709 12:24:56.522086 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2020) took 2563 ms. Trace:
I20260709 12:24:56.549300 12703 rpcz_store.cc:276] 0709 12:24:53.958644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.024185 (+ 65541us) service_pool.cc:224] Handling call
0709 12:24:54.078919 (+ 54734us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:24:54.079202 (+   283us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.192899 (+113697us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.192956 (+    57us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.246765 (+ 53809us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.041845 (+795080us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:55.065880 (+ 24035us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.066109 (+   229us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.066216 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.494358 (+1428142us) raft_consensus.cc:1685] finished
0709 12:24:56.521798 (+ 27440us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.522002 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13601,"prepare.queue_time_us":25316,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":31410,"raft.run_cpu_time_us":169,"raft.run_wall_time_us":168,"spinlock_wait_cycles":5525248,"thread_start_us":822192,"threads_started":2,"wal-append.queue_time_us":893901}
I20260709 12:24:56.530539 13232 rpcz_store.cc:276] 0709 12:24:55.276494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.383869 (+1107375us) service_pool.cc:224] Handling call
0709 12:24:56.410164 (+ 26295us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:56.477607 15525 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.530483 12700 rpcz_store.cc:276] 0709 12:24:55.277116 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.551723 (+274607us) service_pool.cc:224] Handling call
0709 12:24:55.554726 (+  3003us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.555142 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.555181 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.555702 (+   521us) log.cc:844] Serialized 26 byte log entry
0709 12:24:56.405648 (+849946us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:56.405709 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.405811 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.472242 (+ 66431us) raft_consensus.cc:1685] finished
0709 12:24:56.472271 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.472439 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":728034,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":10869,"thread_start_us":761929,"threads_started":1,"wal-append.queue_time_us":850880}
I20260709 12:24:56.496019 15476 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.538508 12706 rpcz_store.cc:276] 0709 12:24:55.218203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.275437 (+ 57234us) service_pool.cc:224] Handling call
0709 12:24:55.275705 (+   268us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.292295 (+ 16590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.292329 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.307725 (+ 15396us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.601196 (+293471us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.601254 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.601356 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.484568 (+883212us) raft_consensus.cc:1685] finished
0709 12:24:56.484588 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.484739 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76271,"raft.queue_time_us":16417,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":14298,"thread_start_us":242969,"threads_started":1,"wal-append.queue_time_us":888464}
I20260709 12:24:56.491447 15472 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.494009 15406 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.493024 13231 rpcz_store.cc:276] 0709 12:24:55.173655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.178186 (+  4531us) service_pool.cc:224] Handling call
0709 12:24:56.419425 (+1241239us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:56.537644 15545 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.541715 15383 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.496450 15446 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.570367 15235 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.555517 15423 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.571924 15048 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.520545 15554 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.573580 15545 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.575172 15554 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.575730 15545 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.562299 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.579375 12699 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
W20260709 12:24:56.582713 12699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 2015) took 2630 ms (client timeout 1896 ms). Trace:
W20260709 12:24:56.583238 12699 rpcz_store.cc:269] 0709 12:24:53.952331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.952436 (+   105us) service_pool.cc:224] Handling call
0709 12:24:56.562072 (+2609636us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:56.582619 (+ 20547us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23402880}
I20260709 12:24:56.534255 15243 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.557161 15555 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:56.627074 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 788) took 1423 ms. Trace:
I20260709 12:24:56.498493 15559 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:56.628232 12523 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 2.172s (SENT)
I20260709 12:24:56.629498 13233 rpcz_store.cc:276] 0709 12:24:55.203246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.203372 (+   126us) service_pool.cc:224] Handling call
0709 12:24:55.233333 (+ 29961us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.234539 (+  1206us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.234580 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.235129 (+   549us) log.cc:844] Serialized 26 byte log entry
0709 12:24:56.244765 (+1009636us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:56.245084 (+   319us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.245399 (+   315us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.245488 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:56.626767 (+381279us) raft_consensus.cc:1685] finished
0709 12:24:56.626799 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.626989 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":150289,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":40,"raft.queue_time_us":213556,"raft.run_cpu_time_us":413,"raft.run_wall_time_us":10326,"thread_start_us":61307,"threads_started":1,"wal-append.queue_time_us":994712}
W20260709 12:24:56.637504 15561 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:24:56.638038 15383 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.638677 15383 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.639482 15540 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.534291 15550 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.640726 15383 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.641734 15384 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:56.641909 15557 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:24:56.582940 15562 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.642517 15550 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.531693 15553 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.645177 15553 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.645840 15305 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:56.646323 15550 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.646471 15305 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.646912 15550 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.648973 15550 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.558754 15476 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.658967 15464 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:24:56.659708 15476 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.660722 15422 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.660873 15313 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.662184 15517 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.662026 15555 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.659065 15048 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.558054 15532 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.666028 15544 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.667026 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1857) took 2538 ms. Trace:
I20260709 12:24:56.667680 15542 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.642692 15562 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.581736 15450 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.667403 12552 rpcz_store.cc:276] 0709 12:24:54.128437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.902476 (+774039us) service_pool.cc:224] Handling call
0709 12:24:54.903017 (+   541us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.038465 (+135448us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.038495 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.038533 (+    38us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:55.038560 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.666822 (+1628262us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b54001d1ad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:56.666864 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.666974 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281518976}
I20260709 12:24:56.642299 15384 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.667748 15532 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:56.674796 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 387843us
I20260709 12:24:56.649122 15305 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:56.675148 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 1.38163e+06us
I20260709 12:24:56.633810 15327 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.693300 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 789) took 1445 ms. Trace:
I20260709 12:24:56.636703 15423 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.713994 15121 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:56.715337 15121 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.690291 15542 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:56.700947 13229 rpcz_store.cc:276] 0709 12:24:55.248181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.248366 (+   185us) service_pool.cc:224] Handling call
0709 12:24:55.249955 (+  1589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.250142 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:55.288189 (+ 38047us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.692925 (+1404736us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.692979 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:56.693028 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.693096 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.693239 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":57157,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":174328,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1775,"thread_start_us":1404309,"threads_started":2,"wal-append.queue_time_us":1180086}
I20260709 12:24:56.692051 15544 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.718856 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 790) took 1468 ms. Trace:
W20260709 12:24:56.719933 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 133126us
I20260709 12:24:56.728248 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.731438 13233 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:56.702099 15305 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.694029 15517 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.728088 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.728942 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.703784 15495 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.723858 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.728160 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2024) took 2698 ms. Trace:
I20260709 12:24:56.737248 13235 rpcz_store.cc:276] 0709 12:24:55.250630 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.251339 (+   709us) service_pool.cc:224] Handling call
0709 12:24:55.251633 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.251893 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:24:56.295484 (+1043591us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.718538 (+423054us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.718591 (+    53us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:56.718637 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.718697 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.718802 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81707,"prepare.queue_time_us":159036,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":1604,"raft.queue_time_us":205112,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":54091,"thread_start_us":1363516,"threads_started":3,"wal-append.queue_time_us":194898}
I20260709 12:24:56.740466 12708 rpcz_store.cc:276] 0709 12:24:54.029357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.036584 (+  7227us) service_pool.cc:224] Handling call
0709 12:24:54.043208 (+  6624us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.044154 (+   946us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.727941 (+2683787us) spinlock_profiling.cc:243] Waited 6.29 ms on lock 0x7b54003c7dd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:56.728096 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14471936}
W20260709 12:24:56.744496 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 53474.1us
I20260709 12:24:56.745936 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.716924 15423 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:56.746982 13226 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 725) took 2368 ms (client timeout 3080 ms). Trace:
W20260709 12:24:56.751771 13226 rpcz_store.cc:269] 0709 12:24:54.371216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.371360 (+   144us) service_pool.cc:224] Handling call
0709 12:24:56.723667 (+2352307us) spinlock_profiling.cc:243] Waited 4.54 ms on lock 0x7b5800126c98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:56.739707 (+ 16040us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10437504}
I20260709 12:24:56.716923 15459 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.749943 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.750721 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.755924 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.744079 15517 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.759140 15464 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.759843 15464 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.762905 15517 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.734750 15542 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.766587 15384 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.767167 15542 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.732995 15305 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.767922 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:56.747320 15300 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.767576 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.774477 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:56.768792 15300 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.748651 15495 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.778053 15562 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.778772 15300 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.779402 15327 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.739841 15544 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.779943 15495 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.795135 15243 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.784154 15305 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.787586 15446 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.780014 15327 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.784747 15464 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.785619 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:56.795221 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:56.798206 15331 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:56.798301 15327 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:56.782697 12707 raft_consensus.cc:2410] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:56.783087 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:56.799752 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:56.786602 15544 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.764580 15532 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.802902 15532 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.783772 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.804445 13228 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:56.804628 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.806115 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:56.806440 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.743808 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.808080 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.808792 12702 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:56.809158 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:56.808797 13235 raft_consensus.cc:2410] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:56.809846 12703 raft_consensus.cc:2376] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6. Re-sending same reply.
I20260709 12:24:56.792414 15400 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.783329 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.794234 15440 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:56.794435 15121 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.783558 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.811067 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.813395 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:56.813162 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.837908 12702 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.815701 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.838626 12699 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
W20260709 12:24:56.838922 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 125571us
I20260709 12:24:56.816021 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.839741 13226 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:56.805312 12708 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:56.841565 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.842381 12708 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:56.837976 12703 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:56.853679 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.864136 15565 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.864770 15565 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.865170 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.866425 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.867132 15565 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:56.867491 12632 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:56.867578 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:56.870141 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.870995 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.871490 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:56.871912 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.870995 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:56.872349 13232 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.873765 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.874655 13231 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:56.872941 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.876987 13226 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:56.872649 12708 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:56.878443 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.880403 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.881534 12702 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:24:56.884033 13233 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:56.886215 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.811208 15406 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:56.887072 12671 leader_election.cc:336] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Timed out: RequestConsensusVote RPC to 127.11.32.2:34669 timed out after 1.846s (SENT)
I20260709 12:24:56.887327 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.890714 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:56.764545 15423 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.891361 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:56.891650 12702 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:56.893036 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.895819 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:56.899978 12597 leader_election.cc:336] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Timed out: RequestConsensusVote RPC to 127.11.32.4:37323 timed out after 1.863s (SENT)
I20260709 12:24:56.900664 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:56.902218 15406 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.896432 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.906708 15446 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:56.907269 15446 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:56.909838 15544 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:56.885689 15331 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:24:56.918910 13228 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:56.919646 15559 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.849992 15568 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:56.878249 15461 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:56.952545 12707 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 2017) took 2999 ms (client timeout 1671 ms). Trace:
W20260709 12:24:56.956702 12707 rpcz_store.cc:269] 0709 12:24:53.952877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.996601 (+ 43724us) service_pool.cc:224] Handling call
0709 12:24:56.728784 (+2732183us) spinlock_profiling.cc:243] Waited 7.6 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:24:56.952286 (+223502us) spinlock_profiling.cc:243] Waited 45.8 ms on lock 0x7b54004600d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:56.952455 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":122831616}
I20260709 12:24:56.886236 15472 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:56.965080 15568 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.015648 15533 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:56.869289 15440 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.030908 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.031808 13231 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:57.027621 12522 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:57.027983 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:57.018854 13234 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 782) took 2495 ms (client timeout 2877 ms). Trace:
I20260709 12:24:57.026960 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.034653 12634 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
W20260709 12:24:57.034970 12598 connection.cc:256] RPC call timeout handler was delayed by -1.4910833979997733s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:24:57.027570 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:57.034394 13234 rpcz_store.cc:269] 0709 12:24:54.523667 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.524253 (+   586us) service_pool.cc:224] Handling call
0709 12:24:57.018649 (+2494396us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54004d9c54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:57.018791 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4621214592}
I20260709 12:24:57.036244 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.037487 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:57.038401 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.040906 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:57.039891 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:57.042531 15459 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.042912 15459 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.043231 15459 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.043886 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.047318 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.049193 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.046460 13231 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:57.050280 12631 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:57.051468 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:57.051581 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.052129 12630 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.051690 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.051194 13232 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:57.060282 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.062593 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:57.065397 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.083756 12634 raft_consensus.cc:2410] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:57.084069 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:57.017069 15568 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.084376 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.017191 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 791) took 1759 ms. Trace:
I20260709 12:24:57.088141 13226 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:57.059278 13232 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:24:57.089694 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.018837 15400 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.089713 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.090516 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:57.090582 13232 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:57.091257 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.104743 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:57.101075 12701 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:57.101153 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:57.109691 12628 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:57.083271 12626 raft_consensus.cc:2376] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5. Re-sending same reply.
I20260709 12:24:57.046967 15305 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.023898 15535 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.112859 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:57.104560 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:57.114230 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.106805 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:56.969178 15461 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:57.120402 15461 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:57.121299 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.032241 15440 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.054800 15384 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.111582 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.116034 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.118266 15497 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.090158 15341 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.088999 15300 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:57.136238 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.127449 12631 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:24:57.138244 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.127506 15463 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:24:57.107812 15469 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:24:57.139981 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.130087 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.142732 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:57.143774 12626 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:24:57.124204 12630 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:57.092185 15148 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.088048 15331 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:57.126843 15564 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.145944 15564 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:57.145870 15331 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.146322 15423 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.144846 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.125098 15305 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:57.148319 15331 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.148713 15305 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.145982 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.104137 15566 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.148051 12628 raft_consensus.cc:2410] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:57.146395 12634 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:24:57.140007 15463 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:57.161530 15463 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:57.162743 15463 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.164597 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.165659 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1806) took 1869 ms. Trace:
I20260709 12:24:57.166507 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.146524 15564 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:57.153700 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.160554 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:57.353968 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.134538 15497 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.394908 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.168015 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 781) took 2644 ms. Trace:
I20260709 12:24:57.166179 12705 rpcz_store.cc:276] 0709 12:24:55.295772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.302553 (+1006781us) service_pool.cc:224] Handling call
0709 12:24:56.378968 (+ 76415us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:56.379173 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.379199 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:56.379244 (+    45us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:56.379284 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.379341 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.165473 (+786132us) spinlock_profiling.cc:243] Waited 76 ms on lock 0x7b54003ec6d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:57.165596 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":174880512}
I20260709 12:24:57.167178 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:57.426519 12704 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.554s	user 0.012s	sys 0.000s
I20260709 12:24:57.427014 12704 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:57.399554 13227 rpcz_store.cc:276] 0709 12:24:54.523236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.560819 (+ 37583us) service_pool.cc:224] Handling call
0709 12:24:54.561227 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.996557 (+435330us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.996603 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:54.996674 (+    71us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:54.996705 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.167764 (+2171059us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54006be9d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:57.167815 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.167952 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000583552}
I20260709 12:24:57.134434 15341 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:57.322392 15580 log.cc:927] Time spent T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:24:57.436082 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:57.233013 15579 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.257s	user 0.000s	sys 0.001s
I20260709 12:24:57.459154 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:57.454797 13227 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:24:57.461071 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.466264 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.156188 15566 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:57.473280 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:57.157122 15300 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.475382 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.478484 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:57.414215 15497 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.424103 15463 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.475055 15423 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.480770 12628 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:57.487620 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.455193 15341 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.480683 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:57.092065 13230 rpcz_store.cc:276] 0709 12:24:55.257900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.424247 (+1166347us) service_pool.cc:224] Handling call
0709 12:24:56.424659 (+   412us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:56.481912 (+ 57253us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.484950 (+  3038us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:56.555350 (+ 70400us) log.cc:844] Serialized 52 byte log entry
0709 12:24:56.868191 (+312841us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:56.868520 (+   329us) log.cc:844] Serialized 14 byte log entry
0709 12:24:56.868737 (+   217us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.868827 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.016904 (+148077us) raft_consensus.cc:1685] finished
0709 12:24:57.016927 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.017112 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46626,"prepare.queue_time_us":608,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":200315,"raft.run_cpu_time_us":272,"raft.run_wall_time_us":7560,"thread_start_us":200067,"threads_started":1,"wal-append.queue_time_us":436947}
I20260709 12:24:57.430274 15296 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.059s
I20260709 12:24:57.489969 13234 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:57.490908 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:57.482594 12600 connection.cc:256] RPC call timeout handler was delayed by -2.12862609900003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260709 12:24:57.492717 15148 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:57.562888 15148 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:57.563594 15148 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.488277 15169 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.565941 15169 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:24:57.503664 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.504812 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.569871 12705 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:57.569990 12700 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:57.571370 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.510731 15532 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.513085 15546 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.572400 12705 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:57.571422 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.573546 12700 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 2.
I20260709 12:24:57.574083 12630 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.574676 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.576078 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.513818 15300 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:57.516646 15466 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:57.582362 15466 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.521250 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.585985 12704 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:24:57.587455 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.590646 15466 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.481829 15566 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.159031 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.577155 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:57.593838 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.594959 12700 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
W20260709 12:24:57.578649 12600 connection.cc:256] RPC call timeout handler was delayed by -1.6201260990001174s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21860000000000002s for a response
I20260709 12:24:57.589010 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.600394 12600 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:24:57.578347 15586 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.166s	user 0.005s	sys 0.000s
I20260709 12:24:57.625120 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 520) took 2342 ms. Trace:
I20260709 12:24:57.625653 12701 rpcz_store.cc:276] 0709 12:24:55.282683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.569641 (+286958us) service_pool.cc:224] Handling call
0709 12:24:55.570091 (+   450us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.113717 (+1543626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.624835 (+511118us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540004fbd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:57.625056 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3507450752}
I20260709 12:24:57.626243 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:57.627956 15532 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.634152 15532 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:57.635731 15446 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.636438 15532 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.615919 15121 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:57.637778 15121 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:57.638221 15121 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.638087 15496 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 12:24:57.627154 15296 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:57.630290 15459 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.002s
W20260709 12:24:57.667822 12598 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.042s	sys 0.085s
W20260709 12:24:57.668453 12598 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.042s	sys 0.085s
W20260709 12:24:57.670431 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 548338us
I20260709 12:24:57.645035 15296 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:57.690100 12630 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
W20260709 12:24:57.705974 12454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 344) took 14944 ms (client timeout 15000 ms). Trace:
I20260709 12:24:57.663895 15459 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.691545 15296 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.692049 15446 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:57.705765 15423 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:57.708474 12454 rpcz_store.cc:269] 0709 12:24:42.790474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.844149 (+ 53675us) service_pool.cc:224] Handling call
0709 12:24:57.705788 (+14861639us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:53.060559 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:53.165959 (+105400us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:53.186153 (+ 20194us) write_op.cc:435] Acquired schema lock
0709 12:24:53.186194 (+    41us) tablet.cc:662] Decoding operations
0709 12:24:53.219529 (+ 33335us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:53.219604 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:53.219633 (+    29us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:24:53.305427 (+ 85794us) tablet.cc:701] Row locks acquired
0709 12:24:53.305483 (+    56us) write_op.cc:260] PREPARE: finished
0709 12:24:53.305681 (+   198us) write_op.cc:270] Start()
0709 12:24:53.305850 (+   169us) write_op.cc:276] Timestamp: P: 1783599893305610 usec, L: 0
0709 12:24:53.305875 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:53.306576 (+   701us) log.cc:844] Serialized 4010 byte log entry
0709 12:24:54.247174 (+940598us) op_driver.cc:464] REPLICATION: finished
0709 12:24:55.040531 (+793357us) write_op.cc:301] APPLY: starting
0709 12:24:55.054584 (+ 14053us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:55.110179 (+ 55595us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:55.125517 (+ 15338us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:55.468207 (+342690us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:55.538578 (+ 70371us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:24:55.543250 (+  4672us) write_op.cc:312] APPLY: finished
0709 12:24:55.543576 (+   326us) log.cc:844] Serialized 77 byte log entry
0709 12:24:56.488311 (+944735us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:56.488474 (+   163us) write_op.cc:454] Released schema lock
0709 12:24:56.490202 (+  1728us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:56.527260 (+ 37058us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:56.530734 (+  3474us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":689205,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":772733,"apply.run_cpu_time_us":32469,"apply.run_wall_time_us":1470602,"num_ops":10,"prepare.queue_time_us":290223,"prepare.run_cpu_time_us":49931,"prepare.run_wall_time_us":342951,"raft.queue_time_us":375969,"raft.run_cpu_time_us":57956,"raft.run_wall_time_us":880050,"replication_time_us":838643,"thread_start_us":2148097,"threads_started":5,"wal-append.queue_time_us":1155218,"wal-append.run_cpu_time_us":28259,"wal-append.run_wall_time_us":2411973}]]}
I20260709 12:24:57.730461 15525 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:24:57.744055 12629 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.006s	sys 0.015s
W20260709 12:24:57.767335 12625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.643s	user 0.005s	sys 0.015s
I20260709 12:24:57.749151 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:57.762189 15423 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:57.770428 12629 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.006s	sys 0.016s
W20260709 12:24:57.758879 15305 consensus_meta.cc:287] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.610s	user 0.012s	sys 0.000s
W20260709 12:24:57.770643 12625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.005s	sys 0.015s
W20260709 12:24:57.775761 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 149596us
I20260709 12:24:57.777369 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:57.742940 15169 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.780683 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:57.787058 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.757859 15532 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:57.761868 15459 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.798842 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.769939 15056 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:57.801250 13227 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:57.797088 15461 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.808513 15461 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:57.808974 15461 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.810609 15148 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.808176 15056 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:57.790561 15498 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.006s	sys 0.015s
I20260709 12:24:57.812453 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.815267 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.813443 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.749346 15446 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:57.814245 15459 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.871690 15459 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:57.873298 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 716) took 1009 ms. Trace:
I20260709 12:24:57.873781 15459 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.803840 15532 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:57.815054 15498 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.006s	sys 0.015s
I20260709 12:24:57.843446 15056 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.843475 15461 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.852428 15296 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.874891 13232 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:57.779387 15305 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.873180 15446 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.880125 15459 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.873726 13233 rpcz_store.cc:276] 0709 12:24:56.863997 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.867300 (+  3303us) service_pool.cc:224] Handling call
0709 12:24:57.873071 (+1005771us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54001b3854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:57.873233 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28025216}
I20260709 12:24:57.857049 15566 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.883121 15497 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:57.885762 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 385208us
I20260709 12:24:57.836702 15341 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:57.901710 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 299461us
I20260709 12:24:57.902941 15341 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:57.902493 12632 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:57.879726 15423 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:57.900267 15497 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:57.884682 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 411467us
I20260709 12:24:57.904476 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:57.905228 15423 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:57.906625 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:57.907655 15423 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.909706 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:57.910790 15423 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.912569 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:57.915378 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 794) took 1036 ms. Trace:
I20260709 12:24:57.915743 13229 rpcz_store.cc:276] 0709 12:24:56.878964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.061247 (+182283us) service_pool.cc:224] Handling call
0709 12:24:57.111635 (+ 50388us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.512121 (+400486us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.512168 (+    47us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.512230 (+    62us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:57.512287 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.915173 (+402886us) spinlock_profiling.cc:243] Waited 400 ms on lock 0x7b54005fdf54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:57.915211 (+    38us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.915328 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":920401280}
I20260709 12:24:57.916184 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:57.950541 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50766.4us
I20260709 12:24:57.891378 15459 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:24:57.952378 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.955530 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.898092 15446 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.958384 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:57.958972 13233 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.960175 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:57.960320 12708 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:57.964263 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:24:57.966991 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 274241us
W20260709 12:24:57.969604 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.972770 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:57.973578 12708 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:57.949195 15423 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:57.986343 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:57.979038 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:24:57.953603 15564 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
I20260709 12:24:57.994474 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.999230 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:57.960646 15459 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:58.005545 13228 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.001s	sys 0.041s
I20260709 12:24:58.007215 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:58.022408 13228 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.001s	sys 0.042s
I20260709 12:24:58.025239 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:58.025998 13226 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:58.026840 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:58.027419 13227 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:57.963217 15446 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:58.030911 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.033946 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.035277 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:58.035864 12708 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:24:58.034513 12628 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:58.037220 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.038059 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.038782 12627 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:58.035310 13233 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:58.043529 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.049404 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.050263 12553 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:58.053759 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:58.054489 12553 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.074398 12555 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.078213 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.005383 15595 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:58.075505 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.079509 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.081166 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.092711 12553 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:58.032177 15446 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.093947 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.096724 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:58.081385 12555 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:24:58.078887 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:58.101302 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:58.102108 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 321522us
I20260709 12:24:58.036770 15423 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.101578 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:58.103367 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:58.122658 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:58.123904 12598 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:58.126695 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.105042 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:58.106591 12559 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:58.102486 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.143988 12552 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:24:58.107590 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.117846 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:58.172695 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47316.1us
I20260709 12:24:58.179380 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.180267 12558 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
W20260709 12:24:58.191614 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 74889.3us
I20260709 12:24:58.003206 15564 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.204176 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.198433 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:58.205451 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:58.206583 12554 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
W20260709 12:24:58.221956 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 117009us
I20260709 12:24:58.205984 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.224545 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:58.226428 12525 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.006s	sys 0.033s
I20260709 12:24:58.230111 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:58.231966 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:58.228979 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 707) took 1391 ms. Trace:
I20260709 12:24:58.374893 13235 rpcz_store.cc:276] 0709 12:24:56.837372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.837554 (+   182us) service_pool.cc:224] Handling call
0709 12:24:56.873203 (+ 35649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.033061 (+159858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.033092 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:57.033137 (+    45us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:57.033169 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.228764 (+1195595us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b5400698cd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:58.228808 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.228924 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":367174528}
I20260709 12:24:58.241237 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:58.376778 12627 raft_consensus.cc:2376] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6. Re-sending same reply.
I20260709 12:24:58.175366 14774 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.277844 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.309857 12556 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:58.310691 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2217) took 1274 ms. Trace:
I20260709 12:24:58.378259 12558 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.310037 15466 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:24:58.246785 15121 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.606s	user 0.011s	sys 0.001s
I20260709 12:24:58.205379 15599 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.235496 15423 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:58.236531 15498 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:58.226892 15589 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:58.104305 15595 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:58.347219 15593 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.315s	user 0.000s	sys 0.000s
I20260709 12:24:58.348526 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 796) took 1382 ms. Trace:
I20260709 12:24:58.342048 15604 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.399915 13232 rpcz_store.cc:276] 0709 12:24:56.966144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.129524 (+163380us) service_pool.cc:224] Handling call
0709 12:24:57.874651 (+745127us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.885210 (+ 10559us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.348222 (+463012us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b54001b3850. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:58.348439 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712901376}
I20260709 12:24:58.349640 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1876) took 1206 ms. Trace:
I20260709 12:24:58.352744 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:58.356659 15600 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260709 12:24:58.407907 12555 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:58.408279 12627 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:58.398244 13227 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:24:58.269709 15296 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.361020 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:58.327612 15461 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.363441 15305 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.390763 15599 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.384172 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.378319 12634 rpcz_store.cc:276] 0709 12:24:57.036487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.084626 (+ 48139us) service_pool.cc:224] Handling call
0709 12:24:57.146153 (+ 61527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.161105 (+ 14952us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.293458 (+1132353us) spinlock_profiling.cc:243] Waited 61.2 ms on lock 0x7b54002107d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:58.310614 (+ 17156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":140729728}
I20260709 12:24:58.385895 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:58.366829 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:24:58.391855 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 199250us
I20260709 12:24:58.357721 15532 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:58.372087 15384 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.025s	sys 0.024s
I20260709 12:24:58.394373 15608 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.402380 12630 rpcz_store.cc:276] 0709 12:24:57.142895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.480445 (+337550us) service_pool.cc:224] Handling call
0709 12:24:58.349317 (+868872us) spinlock_profiling.cc:243] Waited 41.6 ms on lock 0x7b54003435d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:24:58.349580 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":95647616}
I20260709 12:24:58.411185 13228 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 804) took 1323 ms. Trace:
W20260709 12:24:58.458642 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.384006 14774 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:24:58.430096 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.393692 15466 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:58.379132 12525 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.677s	user 0.007s	sys 0.033s
I20260709 12:24:58.432675 12550 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:58.440889 12626 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:58.465085 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.466094 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.397850 15566 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.432436 15463 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:58.397126 15589 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:58.452162 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:58.372448 15406 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.007s	sys 0.016s
I20260709 12:24:58.460131 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.470916 12630 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:58.451445 12708 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:58.461143 12555 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.473400 15601 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:58.393432 15121 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:58.462399 12559 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.459663 13228 rpcz_store.cc:276] 0709 12:24:57.087430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.154938 (+ 67508us) service_pool.cc:224] Handling call
0709 12:24:57.155227 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:57.155484 (+   257us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:58.032595 (+877111us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.410866 (+378271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.410919 (+    53us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:58.410962 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.411035 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.411133 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1138974,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":105,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":7072,"thread_start_us":951902,"threads_started":2}
I20260709 12:24:58.396598 15498 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:58.462711 14774 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.450752 15497 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.407090 15604 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:58.468446 15532 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:24:58.476518 15588 log.cc:927] Time spent T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:24:58.476675 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.476774 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.474419 15589 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.478036 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:58.452888 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 86152.6us
W20260709 12:24:58.480674 12629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.019s	sys 0.016s
I20260709 12:24:58.417524 15605 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.399272 15423 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:58.534406 12629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.759s	user 0.020s	sys 0.016s
W20260709 12:24:58.458758 15384 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.767s	user 0.026s	sys 0.024s
I20260709 12:24:58.462070 15599 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:58.535038 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 219770us
W20260709 12:24:58.474363 15406 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.008s	sys 0.016s
I20260709 12:24:58.539914 15340 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:24:58.565207 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:58.499507 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.493645 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.552572 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.557775 12628 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:24:58.559581 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.562979 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:58.564284 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:58.481469 15296 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.583500 12706 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.490388 15601 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:58.585117 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:24:58.551586 15341 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.022s	sys 0.049s
I20260709 12:24:58.491058 15498 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:58.594429 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 127984us
I20260709 12:24:58.567471 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.605588 12699 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:24:58.612062 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:24:58.612810 12556 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:58.612874 12559 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.615850 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.617195 12630 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:58.491988 15463 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:58.605195 15341 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.023s	sys 0.049s
I20260709 12:24:58.630470 15619 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:58.624389 12706 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:24:58.625391 12626 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:58.631289 15619 consensus_queue.cc:1243] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:24:58.533035 15497 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.493906 15604 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.635931 12627 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:58.628342 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.638746 12553 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.640542 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.641448 12553 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.586095 15296 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:24:58.621572 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 391539us
I20260709 12:24:58.636883 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.643250 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:24:58.644167 12550 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.669004 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.671430 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.674562 12551 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:58.670977 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.676007 12555 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:24:58.676249 12522 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:58.682852 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 654) took 1763 ms. Trace:
I20260709 12:24:58.627228 15564 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.668483 15605 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.683327 12625 rpcz_store.cc:276] 0709 12:24:56.919618 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.919758 (+   140us) service_pool.cc:224] Handling call
0709 12:24:56.920119 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.920495 (+   376us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.920525 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.047609 (+127084us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.775077 (+727468us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:58.286313 (+511236us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.311717 (+ 25404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.311818 (+   101us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.682633 (+370815us) raft_consensus.cc:1685] finished
0709 12:24:58.682655 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.682790 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62738,"prepare.queue_time_us":619378,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":35709,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":206,"thread_start_us":1144149,"threads_started":2,"wal-append.queue_time_us":1144097}
I20260709 12:24:58.635377 15497 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.647370 15296 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.688831 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.690516 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.690778 12551 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:58.689136 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.692485 12555 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:58.690634 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:58.704929 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.688233 15555 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:58.706053 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.689648 15605 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.707602 12555 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:24:58.695237 15532 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.724896 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.729997 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.730799 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:58.734292 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:58.739957 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.707262 15555 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:58.738049 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:58.765697 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 533658us
I20260709 12:24:58.768956 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.750073 12522 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:58.723727 15466 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:58.780323 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:24:58.722924 15605 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.791752 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:58.785640 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 187073us
I20260709 12:24:58.773200 15566 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.704540 15626 consensus_queue.cc:1059] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:24:58.748123 15625 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.796056 15597 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:58.797187 12551 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:58.767767 15341 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:58.798352 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:58.766690 15623 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:58.779224 15340 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.813261 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:24:58.813805 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 99684.8us
W20260709 12:24:58.817926 13201 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.710s (SENT) [suppressed 38 similar messages]
I20260709 12:24:58.796078 15595 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:24:58.820115 13199 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:24:58.806565 15613 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:24:58.827996 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:58.828753 15305 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:24:58.698521 15601 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.791988 15564 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:58.807215 15121 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:58.794446 15624 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.852551 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.816494 15625 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.816671 15423 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:58.844630 15595 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:58.862350 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:24:58.863983 15622 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:24:58.866503 15305 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:58.868130 15169 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:58.858932 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:58.815653 15341 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.885056 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1808) took 1857 ms. Trace:
I20260709 12:24:58.887353 12702 rpcz_store.cc:276] 0709 12:24:57.027302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.477827 (+1450525us) service_pool.cc:224] Handling call
0709 12:24:58.478106 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.478324 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:24:58.713217 (+234893us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.884674 (+171457us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.884744 (+    70us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:58.884788 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.884859 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.884999 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":155514,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":247,"thread_start_us":405055,"threads_started":2}
I20260709 12:24:58.798462 15555 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.856315 15463 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.860641 15564 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.861696 15596 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.846753 15627 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 12:24:58.894358 13199 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:24:58.882776 15446 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.001s
I20260709 12:24:58.886410 15169 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:24:58.895987 15231 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.897969 15305 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:58.901757 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2219) took 1864 ms. Trace:
I20260709 12:24:58.904560 12550 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:58.878389 15595 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:58.917081 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:24:58.905232 15564 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.885739 15624 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:24:58.940649 12557 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.013s	sys 0.057s
I20260709 12:24:58.934401 12629 rpcz_store.cc:276] 0709 12:24:57.036972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.117016 (+ 80044us) service_pool.cc:224] Handling call
0709 12:24:57.117473 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.773423 (+655950us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.773467 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.775231 (+  1764us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.555705 (+780474us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:58.555745 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.555808 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.901494 (+345686us) raft_consensus.cc:1685] finished
0709 12:24:58.901516 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.901677 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9146,"raft.queue_time_us":21909,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":1426404,"threads_started":2,"wal-append.queue_time_us":837927}
W20260709 12:24:58.949824 12557 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.013s	sys 0.057s
I20260709 12:24:58.912367 15627 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.930754 15555 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.941697 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.905745 15596 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:58.932178 15331 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:58.915302 14774 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:58.954073 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.931932 15446 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:58.953299 15331 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.961356 15305 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:58.950327 15626 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:58.952713 15627 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:58.965934 15331 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:58.955051 15169 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.969581 15595 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.955080 15596 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.978921 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:58.988334 12550 raft_consensus.cc:2410] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:24:58.966830 15446 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:58.986092 15296 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:58.993592 15639 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:24:58.993631 15331 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.994560 15595 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.957754 15533 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:58.996493 15331 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.012669 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:58.998099 15498 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:58.955155 15589 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.130360 15461 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:59.202399 15466 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.012s
W20260709 12:24:59.214444 15604 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.545s	user 0.006s	sys 0.004s
I20260709 12:24:59.214800 15461 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.214973 15604 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:59.216742 12626 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:59.205348 12556 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:24:59.123144 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.158654 15528 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:24:59.123708 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.115718 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.218958 12703 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:24:59.210855 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:59.161773 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.221773 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.222317 12701 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:24:59.222769 12705 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:59.210371 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.149714 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:59.223688 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.224265 12634 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:24:59.167519 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.112016 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.225647 12552 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:59.118872 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.226248 12550 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:24:59.131940 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.235731 12706 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.226496 12704 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:24:59.239574 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.248502 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:59.252753 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1886) took 1257 ms. Trace:
W20260709 12:24:59.260968 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 308368us
I20260709 12:24:59.217123 15461 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:24:59.153330 15459 consensus_meta.cc:287] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.121s	user 0.009s	sys 0.003s
W20260709 12:24:59.145716 15635 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:24:59.314944 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.241067 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.270591 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:59.315963 12701 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.316772 15565 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:59.311297 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.317981 12702 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:59.162495 15642 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:24:59.315380 12633 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:59.147437 15627 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.316354 15461 consensus_queue.cc:1059] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:59.277789 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:58.982088 15599 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:24:59.320011 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49549.6us
I20260709 12:24:59.278448 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.326087 12706 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:24:59.149873 15644 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:59.264827 12632 rpcz_store.cc:276] 0709 12:24:57.995670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.357906 (+362236us) service_pool.cc:224] Handling call
0709 12:24:58.392661 (+ 34755us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.392992 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:58.735098 (+342106us) log.cc:844] Serialized 14 byte log entry
0709 12:24:58.854896 (+119798us) log.cc:844] Serialized 14 byte log entry
0709 12:24:59.252323 (+397427us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:59.252393 (+    70us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:59.252452 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.252538 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.252681 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":144321,"prepare.queue_time_us":85360,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":96,"raft.queue_time_us":66524,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":2066,"spinlock_wait_cycles":12534912,"thread_start_us":756980,"threads_started":3,"wal-append.queue_time_us":221115}
I20260709 12:24:59.328011 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:24:59.317720 15565 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:24:59.333083 12704 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:24:59.333204 12552 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.333863 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.335253 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.335807 12704 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.335525 12550 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
W20260709 12:24:59.337522 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.338415 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.338557 12702 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:24:59.331848 15565 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:59.344785 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 135793us
I20260709 12:24:59.349927 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:59.346055 12699 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
W20260709 12:24:59.346499 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.346823 12631 raft_consensus.cc:2368] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:24:59.347014 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.347174 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:59.317440 15619 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:59.360620 12704 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:24:59.334414 15625 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:59.367256 15406 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.367861 15406 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.369686 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:59.369578 15619 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.371861 15619 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:59.374560 15649 log.cc:927] Time spent T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:59.353447 15627 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:59.376883 15406 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:59.378306 12701 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:59.247088 15596 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.383991 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 1876) took 1144 ms. Trace:
I20260709 12:24:59.384732 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.386427 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:59.313988 15605 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:59.320086 15459 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.387245 12557 rpcz_store.cc:276] 0709 12:24:58.240350 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.240518 (+   168us) service_pool.cc:224] Handling call
0709 12:24:58.326099 (+ 85581us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.954855 (+628756us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.955790 (+   935us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.964681 (+  8891us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.247404 (+282723us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:59.324378 (+ 76974us) log.cc:844] Serialized 14 byte log entry
0709 12:24:59.324584 (+   206us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.324653 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:59.383795 (+ 59142us) raft_consensus.cc:1685] finished
0709 12:24:59.383817 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:59.383930 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":76794,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":1704,"raft.queue_time_us":105010,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":27021,"thread_start_us":770510,"threads_started":2,"wal-append.queue_time_us":400646}
I20260709 12:24:59.392364 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.392717 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.404060 13227 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:59.404140 13235 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:59.394753 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.405365 13228 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.408988 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:59.412621 13227 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:24:59.414726 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 664) took 1298 ms. Trace:
I20260709 12:24:59.415302 12633 rpcz_store.cc:276] 0709 12:24:58.116002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.418034 (+302032us) service_pool.cc:224] Handling call
0709 12:24:58.423068 (+  5034us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.318831 (+895763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.414409 (+ 95578us) spinlock_profiling.cc:243] Waited 892 ms on lock 0x7b54002139d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:24:59.414633 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2051686144}
I20260709 12:24:59.344765 15243 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:24:59.431806 12634 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:24:59.433581 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:59.433948 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:59.434823 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:59.435374 12632 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:59.434849 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:59.437952 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:59.157627 15624 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.441591 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:24:59.441946 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.389552 15384 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:59.447072 12558 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.447330 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.453202 12557 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:24:59.448050 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.454337 12550 raft_consensus.cc:2368] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:24:59.428848 15466 raft_consensus.cc:3055] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:59.333909 15644 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:59.389684 15625 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:59.471004 13228 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:24:59.452812 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.521278 15596 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.441550 15148 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:59.523681 13234 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:59.529775 15604 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.446121 15296 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:24:59.543715 15564 consensus_meta.cc:287] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.590s	user 0.006s	sys 0.003s
I20260709 12:24:59.544020 15605 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.544387 15564 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.465751 15466 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:24:59.437592 15533 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:59.440249 15243 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.548138 15533 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:24:59.549350 15533 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:24:59.550469 15243 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.551239 13230 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.465667 15654 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:59.566125 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:24:59.566799 12699 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:59.570246 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.571058 12550 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:24:59.546811 15466 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:24:59.640784 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 236809us
W20260709 12:24:59.642338 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 113685us
W20260709 12:24:59.643329 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 83225us
I20260709 12:24:59.643553 13199 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:59.642381 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:24:59.649720 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:24:59.441478 15446 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.131s
I20260709 12:24:59.652613 12553 raft_consensus.cc:2368] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8.
W20260709 12:24:59.653439 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 303559us
I20260709 12:24:59.654450 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.655562 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:59.656944 13234 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:24:59.452069 15594 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.183s
I20260709 12:24:59.660241 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:59.667716 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.669464 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:59.554210 15498 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:59.676294 12699 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:24:59.679739 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:24:59.679996 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 178616us
I20260709 12:24:59.634985 15400 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.680002 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.546833 15459 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:59.660567 15466 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:59.658196 15605 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:59.696308 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:24:59.697880 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:24:59.700179 15400 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.677316 15560 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:24:59.678647 15604 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.031s
I20260709 12:24:59.685889 15243 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:59.677147 15199 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 12:24:59.686343 15654 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:59.713891 14774 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.694465 15589 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:59.653960 15626 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 12:24:59.694795 15495 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:24:59.697326 13199 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:24:59.698941 15446 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.744140 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:00.058502 15400 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.058240 15446 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:24:59.747763 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:24:59.748880 13235 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.689113 15655 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:59.804816 15658 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:59.785260 15466 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:24:59.748931 15656 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.237s	user 0.000s	sys 0.002s
W20260709 12:24:59.758747 15595 consensus_meta.cc:287] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.764s	user 0.007s	sys 0.004s
W20260709 12:25:00.084843 15565 consensus_meta.cc:287] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.717s	user 0.010s	sys 0.000s
I20260709 12:24:59.957921 15651 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.059314 15654 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.092896 15654 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.145625 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.148324 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.149762 12550 raft_consensus.cc:2410] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:00.150074 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.150842 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.151486 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.151818 12550 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 2.
I20260709 12:25:00.152544 12552 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:00.154134 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.155190 12556 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:00.156313 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.157778 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:00.160543 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.161499 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.161942 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:00.162958 12633 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:00.163406 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.164628 12557 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:00.153079 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.165696 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.085338 15446 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.179064 15243 raft_consensus.cc:697] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:24:59.762908 12706 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:00.181762 15604 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.086483 15466 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:00.181911 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 484486us
I20260709 12:25:00.183022 15047 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:00.183147 15604 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.184154 15047 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:00.157238 12556 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:24:59.810734 15564 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:24:59.786744 15599 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.728999 15605 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:00.081976 15627 consensus_meta.cc:287] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.706s	user 0.012s	sys 0.000s
I20260709 12:24:59.811918 15644 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:24:59.740648 13230 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
W20260709 12:25:00.186940 15555 consensus_meta.cc:287] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.232s	user 0.008s	sys 0.005s
I20260709 12:25:00.081283 15199 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:00.226788 15199 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:00.227756 15605 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.4, Last appended by leader: 4, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.228842 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 699) took 1597 ms. Trace:
I20260709 12:25:00.093743 15651 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.229430 12558 rpcz_store.cc:276] 0709 12:24:58.631266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.642080 (+ 10814us) service_pool.cc:224] Handling call
0709 12:24:58.642593 (+   513us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.452526 (+809933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.228214 (+775688us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b54001a8954. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:00.228641 (+   427us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1849675520}
I20260709 12:25:00.230654 13232 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:00.231315 13232 pending_rounds.cc:85] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 6
I20260709 12:25:00.231190 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.231678 13232 pending_rounds.cc:107] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:00.232146 13232 raft_consensus.cc:2889] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:00.232182 12558 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:00.188138 12550 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:00.188156 15327 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:25:00.175021 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:24:59.729475 15625 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:00.194411 13198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.732s	user 0.007s	sys 0.010s
W20260709 12:25:00.237761 13198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.007s	sys 0.010s
W20260709 12:24:59.796617 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.702760 15296 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:00.201000 15420 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:00.201857 14774 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:00.202070 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 712) took 1407 ms. Trace:
I20260709 12:25:00.183111 15466 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.197007 15047 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.208729 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.210796 12557 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:00.216380 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 711) took 1442 ms. Trace:
I20260709 12:25:00.186951 15243 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:00.218109 12597 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.009s
W20260709 12:25:00.218763 12674 connection.cc:256] RPC call timeout handler was delayed by -1.2107020769999508s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
I20260709 12:25:00.218971 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:24:59.735458 15560 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:00.221846 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 525426us
I20260709 12:25:00.230729 12559 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260709 12:25:00.193614 13233 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.016s	sys 0.017s
W20260709 12:25:00.238309 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 776607us
W20260709 12:25:00.246625 13233 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.016s	sys 0.017s
I20260709 12:25:00.243515 12551 rpcz_store.cc:276] 0709 12:24:58.774288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.774430 (+   142us) service_pool.cc:224] Handling call
0709 12:24:58.790684 (+ 16254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.807383 (+ 16699us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.210314 (+1402931us) spinlock_profiling.cc:243] Waited 6.33 ms on lock 0x7b54001a9354. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:00.216155 (+  5841us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14568192}
I20260709 12:25:00.219835 12522 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:00.255302 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.256625 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:00.257548 12551 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:00.257879 14774 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:00.258718 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.260462 12551 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:00.229208 15199 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.261507 15420 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.262538 12552 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:00.262025 15296 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.260536 14774 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.264256 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2054) took 1141 ms. Trace:
I20260709 12:25:00.264648 12707 rpcz_store.cc:276] 0709 12:24:59.122438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.122587 (+   149us) service_pool.cc:224] Handling call
0709 12:24:59.123032 (+   445us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:24:59.130773 (+  7741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.130816 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:24:59.215086 (+ 84270us) log.cc:844] Serialized 52 byte log entry
0709 12:24:59.271425 (+ 56339us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:59.271478 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.271583 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.263734 (+992151us) raft_consensus.cc:1685] finished
0709 12:25:00.263766 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.264007 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7240,"raft.queue_time_us":21549,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":99,"thread_start_us":55927,"threads_started":1,"wal-append.queue_time_us":175820}
I20260709 12:25:00.266158 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 700) took 1634 ms. Trace:
I20260709 12:25:00.266628 12559 rpcz_store.cc:276] 0709 12:24:58.631635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.637953 (+  6318us) service_pool.cc:224] Handling call
0709 12:25:00.229767 (+1591814us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b5800010298. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:25:00.230235 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.265865 (+ 35630us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.266106 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3704064}
I20260709 12:25:00.264288 15420 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:00.268170 12628 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1896) took 2232 ms (client timeout 2247 ms). Trace:
I20260709 12:25:00.268731 15560 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:00.268600 12628 rpcz_store.cc:269] 0709 12:24:58.035951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.205703 (+169752us) service_pool.cc:224] Handling call
0709 12:25:00.239650 (+2033947us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540025e9d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:00.267990 (+ 28340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767463680}
W20260709 12:25:00.245970 12597 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.006s	sys 0.010s
I20260709 12:25:00.273396 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.241632 12555 rpcz_store.cc:276] 0709 12:24:58.794458 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.794870 (+   412us) service_pool.cc:224] Handling call
0709 12:24:58.997582 (+202712us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.997748 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.997772 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:58.997811 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:58.997840 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.997892 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.201549 (+1203657us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b5400373550. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:00.201830 (+   281us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":441015168}
I20260709 12:25:00.242214 15651 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.274910 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 669) took 1602 ms. Trace:
I20260709 12:25:00.279059 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.278254 12626 rpcz_store.cc:276] 0709 12:24:58.636124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.636275 (+   151us) service_pool.cc:224] Handling call
0709 12:24:58.636533 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.217134 (+580601us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.238093 (+1020959us) spinlock_profiling.cc:243] Waited 580 ms on lock 0x7b5400210cd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:00.238436 (+   343us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1333904128}
I20260709 12:25:00.286217 12627 raft_consensus.cc:2410] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:00.287504 15031 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:00.288203 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2252) took 1274 ms. Trace:
I20260709 12:25:00.288789 12627 rpcz_store.cc:276] 0709 12:24:59.012715 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.218214 (+1205499us) service_pool.cc:224] Handling call
0709 12:25:00.286807 (+ 68593us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.289841 15594 consensus_queue.cc:1059] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:00.290681 15644 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:00.291388 15644 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:00.291529 15594 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:00.292153 15594 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:25:00.293905 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 94290.7us
I20260709 12:25:00.293912 15595 raft_consensus.cc:3055] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:00.294792 15595 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:00.293252 15644 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:00.301241 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 102770us
I20260709 12:25:00.302066 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.302407 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.303499 15672 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:00.305079 15672 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:00.309228 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.279735 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 628347us
I20260709 12:25:00.207681 15565 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.312103 13228 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:00.317126 15655 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:00.317775 15655 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:00.321123 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.313563 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:00.326583 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:00.327699 12674 connection.cc:256] RPC call timeout handler was delayed by -1.08650207699975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 12:25:00.322203 12551 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:00.336283 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:00.336498 12706 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:00.337569 15461 raft_consensus.cc:2764] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:00.339314 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.340835 15461 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:00.353140 15565 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.352896 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.319514 15655 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.296757 15595 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.312831 15604 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.313022 15560 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:00.382434 15655 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.382838 12558 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:00.384472 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.367403 15296 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.387715 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.388142 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.389513 15169 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.384181 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:00.390800 12630 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:00.390861 15594 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.391234 15595 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:00.393271 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:00.393731 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.395047 12706 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:00.395709 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:00.397143 15660 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.330s	user 0.000s	sys 0.001s
I20260709 12:25:00.400127 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:00.402545 15667 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:25:00.404022 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 147793us
I20260709 12:25:00.409624 15565 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.409907 12550 raft_consensus.cc:2393] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:00.416755 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.418011 15604 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.418892 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 96387.2us
I20260709 12:25:00.421835 15654 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:00.457185 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 64000.1us
I20260709 12:25:00.459124 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.431777 12704 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:00.432134 15672 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:00.439747 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.495705 15047 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:00.496846 15047 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:00.497185 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 57643.6us
I20260709 12:25:00.497440 15047 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.441977 15528 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:00.450356 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:00.450878 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 84689.5us
I20260709 12:25:00.451555 15565 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.452133 15341 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.455446 15604 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.459347 15654 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:00.397586 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:00.460342 15300 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:00.461117 15628 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:00.461843 15651 consensus_queue.cc:1059] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:00.463001 15626 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:00.464625 15384 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:00.468040 15466 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:00.474529 15657 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.738s	user 0.012s	sys 0.011s
I20260709 12:25:00.476796 12707 raft_consensus.cc:2410] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:25:00.492081 15450 consensus_queue.cc:1059] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:00.493814 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.509s (SENT)
I20260709 12:25:00.515713 15528 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:00.542008 15608 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:00.543079 15569 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.543927 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2061) took 1340 ms. Trace:
I20260709 12:25:00.543696 15569 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.544373 12554 rpcz_store.cc:276] 0709 12:24:59.203026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.221301 (+ 18275us) service_pool.cc:224] Handling call
0709 12:24:59.221631 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.230828 (+  9197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:59.230863 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:59.231331 (+   468us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.440976 (+209645us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:59.444090 (+  3114us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.444181 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.473665 (+1029484us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:00.543432 (+ 69767us) raft_consensus.cc:1685] finished
0709 12:25:00.543456 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.543710 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16201,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":35568,"spinlock_wait_cycles":27832576,"thread_start_us":209365,"threads_started":1,"wal-append.queue_time_us":451571}
I20260709 12:25:00.546838 15296 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:00.547480 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 97392.7us
I20260709 12:25:00.547837 15296 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.549734 13234 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:00.550000 15651 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:00.550472 15651 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:00.550642 15199 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.550926 15296 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.551712 15651 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.553694 15633 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.554234 15633 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.556901 15633 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:00.552189 15450 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:00.557685 15450 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:00.558460 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.558938 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:00.560456 15495 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.561650 15672 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.562969 15604 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.563284 15672 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:00.564697 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 754) took 1148 ms. Trace:
W20260709 12:25:00.565646 15331 consensus_queue.cc:1175] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a2a8d71f644447218c1afc3e5f7716cd" responder_term: 3 status { last_received { term: 3 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 3 index: 6 } }
I20260709 12:25:00.516453 15300 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:00.539077 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.554626 15406 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:00.564940 15461 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:00.522444 15644 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:00.553215 15651 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:00.575788 12702 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:00.529618 15384 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:00.567444 15565 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.583127 15466 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.575137 15169 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:25:00.583768 15528 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:00.565376 13230 rpcz_store.cc:276] 0709 12:24:59.392514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.404281 (+ 11767us) service_pool.cc:224] Handling call
0709 12:25:00.520095 (+1115814us) spinlock_profiling.cc:243] Waited 32.3 ms on lock 0x7b540048a8d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:00.538580 (+ 18485us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":74213760}
I20260709 12:25:00.575331 15449 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:25:00.570915 15300 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.582165 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.579201 15628 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.593801 15628 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:00.599581 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.585208 15528 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.592609 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:00.574213 15461 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:00.638490 15461 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.638701 15672 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:00.639938 15461 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.605160 15628 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.605679 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:00.609303 15563 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:00.642038 15563 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:00.613576 15406 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:00.616842 12629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
W20260709 12:25:00.624271 12553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38728 (request call id 2050) took 1793 ms (client timeout 2204 ms). Trace:
I20260709 12:25:00.630643 15305 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:00.646087 12553 rpcz_store.cc:269] 0709 12:24:58.830769 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.830901 (+   132us) service_pool.cc:224] Handling call
0709 12:25:00.623770 (+1792869us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54001bbf54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:00.624018 (+   248us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1789282560}
W20260709 12:25:00.634006 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 140289us
I20260709 12:25:00.637382 15496 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:00.591958 15644 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:00.648075 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 74601.9us
I20260709 12:25:00.603797 15466 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:00.620609 15450 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.647848 15305 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:00.703553 15305 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:00.704660 15305 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.652976 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.650682 12629 raft_consensus.cc:606] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:00.710309 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.710383 13234 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:00.657383 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.659061 15594 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:00.712357 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.715771 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.659591 15449 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.716936 15449 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.717746 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:00.719313 15449 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.719458 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:00.720391 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:00.689189 12524 connection.cc:256] RPC call timeout handler was delayed by -2.5372439259999737s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 12:25:00.720906 15047 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.722380 12626 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [3.4-5.5]
I20260709 12:25:00.662124 15384 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:00.664086 15678 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:00.666215 15569 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.666657 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:00.667912 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 114428us
I20260709 12:25:00.670228 15654 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:00.672858 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.674461 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:00.675482 12674 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.557s (SENT)
I20260709 12:25:00.677553 15669 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:00.678187 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.678521 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.678807 15644 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.651973 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:00.690274 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:00.699707 13201 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.691s (SENT)
I20260709 12:25:00.730455 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.643322 15563 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.710577 12629 raft_consensus.cc:614] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:00.656333 15406 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.724809 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:00.733932 12627 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:00.734763 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:00.735916 13228 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:00.743945 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:00.747244 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:00.737738 15047 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:00.734763 15608 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:00.746704 15569 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:00.757726 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:00.759449 12702 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:25:00.762267 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 95889.4us
W20260709 12:25:00.763630 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 88217.4us
W20260709 12:25:00.764338 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.605s (SENT)
I20260709 12:25:00.764806 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.765929 12627 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:25:00.766429 15384 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.742836 15604 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:00.767184 15604 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.770066 12557 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.771025 15654 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.774696 15624 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:00.775302 15624 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:00.776312 15624 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.777472 15604 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.777720 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.778340 12558 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:00.779088 15608 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.780258 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:00.782079 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 82549.9us
I20260709 12:25:00.782569 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:00.782724 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:00.782882 13201 leader_election.cc:336] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.710s (SENT)
I20260709 12:25:00.783227 12633 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.783346 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:00.784901 13201 leader_election.cc:336] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.721s (SENT)
I20260709 12:25:00.788403 13229 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
W20260709 12:25:00.790455 12671 connection.cc:256] RPC call timeout handler was delayed by -1.3693044960000407s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260709 12:25:00.790843 12671 connection.cc:256] RPC call timeout handler was delayed by -1.247804496000299s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260709 12:25:00.792443 12551 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:00.793728 15628 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:00.794065 12453 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 4 to 5, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 5 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:00.800212 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.801021 12555 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:00.765522 15669 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:00.785284 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:00.807912 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51185.7us
W20260709 12:25:00.812485 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 49470.5us
I20260709 12:25:00.810801 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:00.813854 12702 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.827047 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:00.761548 15651 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:00.830878 12453 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:00.836660 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:00.844691 12707 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:00.781258 15608 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.850458 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:00.842583 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.856241 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:00.856954 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:00.860963 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.861809 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 260703us
I20260709 12:25:00.870119 13233 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:00.836014 15604 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:00.882236 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 117942us
I20260709 12:25:00.882423 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:00.863231 15450 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.883559 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.885353 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:00.885983 12704 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:25:00.884215 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:00.873673 15555 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:00.888545 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.873157 15563 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:00.891916 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.877862 15604 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:00.895982 12674 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.693s (SENT)
I20260709 12:25:00.894076 12453 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:00.905777 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.883183 15651 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:00.913489 12558 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:00.893821 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:00.876781 15608 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:00.926625 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:00.917135 12708 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.922225 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.912225 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:00.929034 15598 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:00.929160 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:00.929639 15598 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.930090 15598 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:00.930480 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:00.933651 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 148782us
W20260709 12:25:00.933663 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.937567 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.940189 15474 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:00.941601 13234 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:25:00.945986 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:00.946735 12700 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
I20260709 12:25:00.948448 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.948381 15598 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.951485 15608 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.953866 15496 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:00.958839 15598 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.895865 15331 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:00.891832 15169 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:00.961715 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.962406 12551 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:00.970585 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:00.907512 15604 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:00.975514 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45912.8us
I20260709 12:25:00.973742 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.974458 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.972853 12633 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
W20260709 12:25:00.980299 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.914894 15651 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.981549 12627 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:00.981971 15651 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.982091 12627 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:00.982451 15169 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.982906 12627 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:00.983839 12627 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.984549 15169 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.985805 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:00.987075 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:00.981544 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 87781.7us
I20260709 12:25:00.988447 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.988751 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:00.989909 15608 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:00.990064 15654 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:00.990813 15654 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:00.991196 15654 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:00.991626 15654 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:00.992764 15672 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:00.993677 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:00.994696 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.996511 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.998167 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:00.991572 12627 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 10. (index mismatch)
I20260709 12:25:00.973371 15331 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.001816 15331 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.002121 15605 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.002671 12550 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:25:01.002947 12626 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.981482 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:01.004163 12699 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:01.002152 12628 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.979377 12707 raft_consensus.cc:2376] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8. Re-sending same reply.
I20260709 12:25:01.007540 12702 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:01.009665 12708 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:00.911720 15528 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:01.004271 12453 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 4 to 6, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.019008 15669 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.021504 15560 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:25:01.025574 15528 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:01.030783 15608 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:01.031333 15608 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:01.031838 15608 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.031651 15528 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.033027 15528 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.033468 15300 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.034934 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.035701 15300 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.036418 13232 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:01.036427 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:01.037374 12633 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:01.037716 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.038533 12550 raft_consensus.cc:2410] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:25:01.039985 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51415.7us
I20260709 12:25:01.040092 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:01.040889 12557 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:01.040827 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:01.041957 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:01.042852 12558 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:01.044242 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.044399 15331 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.042006 12671 leader_election.cc:400] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:25:01.025552 15628 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:01.045692 12671 leader_election.cc:403] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:01.046739 15466 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7.
I20260709 12:25:01.047372 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:01.052243 15560 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:01.052690 15560 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:01.052903 15331 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.054719 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:01.051096 12453 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 5 to 6, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:01.053496 15560 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.058830 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:01.061604 12627 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.065953 12628 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:01.064410 15466 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:01.067545 15560 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.067756 15466 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:01.068270 15466 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.064911 15669 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:01.074061 15669 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.074435 15669 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.076014 15466 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.064816 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.080314 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:01.073450 15464 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:01.065376 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.083606 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:01.084338 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.085829 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.086557 12555 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:01.087420 15169 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:01.087987 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.085911 12558 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:01.089013 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:01.094295 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.119619 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.159128 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:01.158404 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 74864.7us
I20260709 12:25:01.163667 12702 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:01.165371 12556 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
W20260709 12:25:01.168696 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.171561 12627 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:01.180190 12453 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 3 to 4, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:01.173039 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:01.085685 15466 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.184046 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.184592 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:01.191633 12706 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.193106 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.189726 12550 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:25:01.192261 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 64147.9us
I20260709 12:25:01.187206 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:01.057192 15604 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.197640 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.198843 12554 raft_consensus.cc:2393] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:01.176514 15384 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:01.200902 12630 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:01.168459 15605 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.203181 13228 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.203457 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.203764 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.119451 15464 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.204069 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.204069 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.204694 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.214864 12557 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:01.212455 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 126701us
I20260709 12:25:01.213577 13232 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:01.194154 15567 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:01.220167 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.189529 15169 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:01.216905 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.223592 13234 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:01.223773 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.207468 15331 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:01.229501 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 259375us
I20260709 12:25:01.232081 12553 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:01.211786 15384 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:01.236934 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.189767 15654 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.214599 15466 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:01.239521 15331 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:01.240054 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.261801 13231 raft_consensus.cc:2410] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:01.240856 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.241706 12551 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
W20260709 12:25:01.243053 12674 leader_election.cc:336] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.173s (SENT)
W20260709 12:25:01.246220 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.246112 15169 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.250314 15423 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:01.262879 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:01.268175 15696 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 12:25:01.273937 15331 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.280817 12700 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:01.289639 15466 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:01.254860 15384 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:01.291414 15695 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:25:01.264740 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:01.373137 13228 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:01.266752 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:01.300784 13201 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.911s (SENT)
I20260709 12:25:01.378548 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.303995 12706 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:01.313577 12453 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 1 to 6, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.323740 15604 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.326325 15654 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.326401 15608 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.289386 15651 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.389190 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.328333 15669 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:01.333942 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 90921.5us
I20260709 12:25:01.334751 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:01.335316 15528 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.232858 15567 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:01.253937 15605 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
W20260709 12:25:01.346203 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.359054 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.360780 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.366978 12707 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.369971 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.370838 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:01.340641 15474 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:25:01.387332 15628 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:01.397680 12453 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:01.393021 15644 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.408402 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.410298 12705 raft_consensus.cc:2393] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:25:01.411885 12674 leader_election.cc:336] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.204s (SENT)
W20260709 12:25:01.412040 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 224934us
I20260709 12:25:01.414585 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.415434 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.415850 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:01.416864 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 188137us
I20260709 12:25:01.407804 15423 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.422055 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.420444 12453 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:01.422856 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.424216 12557 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:01.429133 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:01.430205 12627 raft_consensus.cc:2368] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:01.429447 12553 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.410444 15628 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:01.407835 15300 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260709 12:25:01.433187 12600 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:01.437912 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.438305 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:01.441493 15664 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:01.435612 15528 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.444023 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:01.453672 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.455262 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:01.455382 15628 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.457351 15669 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.465142 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:01.466128 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.463909 13228 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:01.467806 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.481683 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.482545 15669 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.481916 15341 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:01.483266 15624 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.483673 15341 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:01.482880 15495 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:01.484527 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.484645 15341 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:01.481737 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48639.3us
I20260709 12:25:01.485915 13227 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.486824 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:01.488159 15624 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:01.490607 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 189868us
W20260709 12:25:01.491328 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 82569.7us
W20260709 12:25:01.492367 12674 leader_election.cc:336] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.234s (SENT)
I20260709 12:25:01.492759 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.493656 15654 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.493994 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.494935 15624 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:01.498359 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.481722 15705 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:01.497365 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.504637 13227 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:01.412402 15466 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.510219 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.437371 15644 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:25:01.437139 15598 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:25:01.525228 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.482493 15464 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.531004 13235 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:01.527889 15565 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.532871 15598 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:01.533334 15598 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:01.533756 15598 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:01.535104 15199 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:01.536078 13231 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:01.536428 13231 pending_rounds.cc:85] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 6
I20260709 12:25:01.536836 13231 pending_rounds.cc:107] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:01.537155 13231 raft_consensus.cc:2889] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.539448 12551 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.542078 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:01.543538 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46271.7us
I20260709 12:25:01.479678 15423 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
W20260709 12:25:01.551819 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.806s (SENT)
I20260709 12:25:01.551668 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.531814 15608 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.552868 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:01.535912 15605 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.559396 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.535521 15199 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:01.545830 15669 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:01.501535 15567 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:01.558604 15563 consensus_meta.cc:287] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 12:25:01.576468 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:01.577118 12707 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.576812 15608 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:01.577543 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:01.577903 15608 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:01.578372 15608 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:01.579272 15608 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.580363 15608 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.581105 15625 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.030s
I20260709 12:25:01.545773 15461 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.546051 15644 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.500458 15705 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.588965 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.564270 15624 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.594254 12671 leader_election.cc:400] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:01.597998 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.603087 12707 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:25:01.604094 12671 leader_election.cc:403] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:01.566733 15464 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.604967 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:01.608505 12554 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:01.604990 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 118294us
I20260709 12:25:01.606068 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.611709 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.571893 15669 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:01.586371 15654 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:01.613919 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 69199us
W20260709 12:25:01.616183 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49613us
W20260709 12:25:01.614658 12674 connection.cc:256] RPC call timeout handler was delayed by -1.06788700900006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33170000000000005s for a response
W20260709 12:25:01.621757 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.596787 15496 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:01.620821 15461 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.608330 15644 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.617167 15450 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:25:01.634598 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45765.9us
I20260709 12:25:01.648814 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.608943 15466 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:01.623822 15654 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:01.630828 15712 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:01.637174 13231 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:01.677657 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:01.667704 15466 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.685086 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.619477 15709 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:25:01.674208 15461 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.666996 15450 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:25:01.704099 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.678999 15496 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:01.677624 15605 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:25:01.706629 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 76114us
I20260709 12:25:01.677244 15654 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.630865 15199 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.677191 15305 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:01.646530 15713 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 12:25:01.734750 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.742545 15706 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:25:01.746155 15450 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.749627 15474 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:01.750093 15474 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:01.751147 15651 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:01.753232 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 72539.8us
I20260709 12:25:01.753854 15199 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.755726 15305 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.756804 13201 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.758042 15305 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:01.759805 15644 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.712306 15605 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:01.704991 15533 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.725946 15496 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.709553 15625 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:01.706205 15466 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:01.760915 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 139062us
I20260709 12:25:01.717644 15709 consensus_queue.cc:1243] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:01.768965 15555 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
W20260709 12:25:01.808758 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 59510.9us
W20260709 12:25:01.764585 15694 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 12:25:01.817397 15707 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.289s	user 0.004s	sys 0.000s
I20260709 12:25:01.818264 15528 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:01.818883 15528 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.769147 15594 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260709 12:25:01.815833 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 193403us
I20260709 12:25:01.713057 15461 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.771831 15651 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:01.838471 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 160855us
I20260709 12:25:01.837924 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.820189 15594 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:01.844509 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:01.847838 15528 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:01.828238 15705 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.769405 15605 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:01.856771 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 100051us
I20260709 12:25:01.858613 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.864274 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.866006 15169 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:01.867630 15461 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.732867 15669 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.834436 15625 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:01.873443 13233 raft_consensus.cc:2368] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:01.843696 15594 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:01.884852 12671 leader_election.cc:400] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:01.892128 12671 leader_election.cc:403] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:01.897511 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53126.3us
I20260709 12:25:01.898288 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.902961 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.881547 15296 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:01.904466 15296 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:01.905649 15461 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:01.905426 15296 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:01.906520 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.906266 15461 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.907840 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.907697 15654 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.908597 15461 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.909317 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.910094 12556 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:01.910516 15717 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 9
W20260709 12:25:01.910866 15384 consensus_meta.cc:287] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.525s	user 0.009s	sys 0.001s
I20260709 12:25:01.905726 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:01.911270 15384 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.911648 15595 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:01.906165 15625 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.912380 15595 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:01.912776 15595 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:01.913156 15595 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.871685 15709 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:01.919618 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 55439.1us
I20260709 12:25:01.924896 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.952883 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:25:01.947558 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49335.7us
I20260709 12:25:01.954277 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.917580 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.932287 15717 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:01.962543 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.963055 15732 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.963223 13234 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:01.963711 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:01.964094 12627 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:01.963616 15732 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:01.964809 15169 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:01.965233 15169 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:01.958329 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:01.965955 15721 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:01.966403 15721 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:01.966809 15721 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.967698 15732 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.965992 13227 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:25:01.970480 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.971453 12627 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:01.927062 15466 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.996157 12600 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:01.997151 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:01.998499 12600 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:01.998989 15555 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.999572 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:02.000232 12702 raft_consensus.cc:2376] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7. Re-sending same reply.
I20260709 12:25:01.965670 15169 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.913295 15384 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:01.985036 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:01.989717 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:01.992969 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.993891 12707 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:01.993927 12708 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.955883 15305 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.001732 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:02.026638 12627 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:01.960419 15669 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.001353 15607 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:02.006368 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:02.028029 13227 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
W20260709 12:25:02.029834 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.030793 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:02.032428 12706 raft_consensus.cc:2410] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:02.003626 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:02.034794 12633 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:02.030561 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:02.036643 12701 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.036849 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:02.039973 12703 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:02.041656 12699 raft_consensus.cc:2376] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7. Re-sending same reply.
I20260709 12:25:02.046182 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:02.049489 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:02.036993 15714 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:25:02.047680 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:02.032155 15727 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:02.051309 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:02.051375 12704 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
W20260709 12:25:02.050832 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.053593 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:02.091502 12707 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.056886 13230 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:02.058251 15730 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:02.062258 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:02.062963 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:02.005538 15594 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.063325 15605 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.064678 15705 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:02.065620 12700 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:25:02.032382 15598 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.052575 12708 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:02.066956 15735 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.146s	user 0.003s	sys 0.000s
I20260709 12:25:02.074450 15731 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:25:02.076805 12523 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:02.077598 15384 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:02.042086 15722 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.078362 13234 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:02.134461 15533 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.113281 15705 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.136567 15705 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.079623 15607 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:02.031702 15654 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:02.084442 15711 log.cc:927] Time spent T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.508s	user 0.002s	sys 0.000s
I20260709 12:25:02.086800 12630 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:02.045544 15565 consensus_meta.cc:287] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.002s
I20260709 12:25:02.095604 12699 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:02.090210 12704 pending_rounds.cc:85] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 3
I20260709 12:25:02.041880 15732 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:02.113515 12700 pending_rounds.cc:85] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 4
I20260709 12:25:02.152045 12700 pending_rounds.cc:107] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:25:02.152442 12700 raft_consensus.cc:2889] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:02.124487 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 68965.2us
I20260709 12:25:02.124840 12628 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:02.132016 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 55324.4us
I20260709 12:25:02.098224 15717 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:02.094314 15199 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.142302 12626 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:02.135473 15384 consensus_queue.cc:1243] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:02.148052 13230 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:25:02.148468 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.149012 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:02.150370 12704 pending_rounds.cc:107] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:25:02.160372 12704 raft_consensus.cc:2889] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.141824 12630 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:02.136595 15495 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55074 (request call id 83) took 4234 ms. Trace:
W20260709 12:25:02.151307 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 412322us
I20260709 12:25:02.114988 15461 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:25:02.154727 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:02.167665 12708 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:02.154141 15565 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:02.156194 15717 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:02.175275 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.162038 15732 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:02.176146 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.179215 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.179714 12557 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:02.180317 12556 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:02.137998 15595 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.181787 12551 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:02.187712 12523 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.188871 12707 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:02.188921 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:02.194331 13232 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.195674 12558 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:02.161715 15199 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.197549 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:02.198019 15605 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:02.199579 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:02.199944 12634 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:02.201303 15732 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.204758 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:02.181885 15717 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:02.207595 13228 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.208333 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:02.209167 12629 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:02.213850 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:02.222153 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.205199 15624 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:02.185518 15607 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.199611 15199 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:02.203395 15625 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:02.251745 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:02.253592 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 100343us
I20260709 12:25:02.215437 15746 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.217561 15605 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.217491 15709 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:02.260295 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:02.267534 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.273845 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.277251 15729 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:02.277999 15729 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:02.278942 15729 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:02.284034 15739 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260709 12:25:02.289484 15598 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.291218 15595 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:02.293210 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:02.294638 15736 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.274027 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.249862 15624 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:02.303706 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.222632 15533 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
W20260709 12:25:02.302687 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 387282us
I20260709 12:25:02.161815 15495 rpcz_store.cc:276] 0709 12:24:57.899332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.899548 (+   216us) service_pool.cc:224] Handling call
0709 12:24:57.905966 (+  6418us) log.cc:844] Serialized 487 byte log entry
0709 12:25:02.125277 (+4219311us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9601,"raft.run_cpu_time_us":957,"raft.run_wall_time_us":90366,"spinlock_wait_cycles":1433472,"thread_start_us":450836,"threads_started":1,"wal-append.queue_time_us":654447,"wal-append.run_cpu_time_us":2489,"wal-append.run_wall_time_us":1221863}
I20260709 12:25:02.260365 15384 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:25:02.295194 15736 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.319841 15736 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.320990 12630 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.322043 12630 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.327373 15474 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.328768 15474 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.331544 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 831) took 1127 ms. Trace:
I20260709 12:25:02.331966 13226 rpcz_store.cc:276] 0709 12:25:01.203799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.204260 (+   461us) service_pool.cc:224] Handling call
0709 12:25:02.331361 (+1127101us) spinlock_profiling.cc:243] Waited 918 ms on lock 0x7b54001b3854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:02.331488 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2111029504}
I20260709 12:25:02.262960 15746 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.334950 15169 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.335824 15746 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.335971 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:02.263944 15709 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:02.339638 13201 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.340597 12557 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:02.346472 13227 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
W20260709 12:25:02.347971 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 122842us
I20260709 12:25:02.349161 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:02.350131 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:02.304806 15624 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.355019 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:02.348121 15742 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:25:02.341301 15709 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.347985 15565 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:02.362238 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 53912us
I20260709 12:25:02.356139 15736 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:25:02.366843 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 102624us
I20260709 12:25:02.360095 15654 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:02.368754 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:02.384074 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:02.359189 12554 raft_consensus.cc:2955] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:02.385865 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:02.392918 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.396523 15496 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:02.387027 15654 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.400928 15654 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.400782 15731 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:02.402428 15496 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:02.403220 15496 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:02.404968 15496 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.411706 12708 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:02.413249 15594 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.411720 15709 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.417590 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.418288 12630 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:02.418642 12630 pending_rounds.cc:85] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 6
I20260709 12:25:02.419193 15709 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.419445 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.418871 12630 pending_rounds.cc:107] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:02.420590 12630 raft_consensus.cc:2889] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.425056 15672 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:02.426204 15528 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.427052 15565 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.419281 15466 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.429558 15664 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:02.430043 15664 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:02.430430 15664 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:02.432822 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.437822 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:02.438238 15595 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:02.385651 15300 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:25:02.440037 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 91004.2us
I20260709 12:25:02.388343 15563 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.440785 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:02.433329 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.442632 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 72411.2us
I20260709 12:25:02.446766 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.387445 15736 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:02.429605 15466 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:02.446830 15605 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:02.421061 15710 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.470923 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.476862 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.452342 15384 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:02.480406 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.485663 12557 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.455999 12625 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:02.464869 15717 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.478698 15729 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:02.417176 15721 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.473197 15533 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:02.495323 12552 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:02.493954 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.497553 12550 raft_consensus.cc:2410] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:25:02.455140 15466 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.478996 15710 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.507596 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:02.508074 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 112209us
I20260709 12:25:02.508603 12707 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.488633 15305 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:25:02.489812 15384 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:02.530301 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.528242 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:02.471925 15705 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.534827 13229 raft_consensus.cc:606] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:02.453579 15625 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.052s
I20260709 12:25:02.507480 15712 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:02.509783 15710 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.506536 15740 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.568601 12699 pending_rounds.cc:85] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 6
I20260709 12:25:02.571885 12699 pending_rounds.cc:107] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:02.572268 12699 raft_consensus.cc:2889] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.537101 15384 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.582966 12632 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:02.584758 15717 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.587401 15712 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:02.588052 15712 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:02.589067 15712 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:02.590634 15750 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:25:02.591825 15765 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:02.593586 12550 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:02.593961 12550 pending_rounds.cc:85] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
I20260709 12:25:02.594182 12550 pending_rounds.cc:107] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:02.594412 12550 raft_consensus.cc:2889] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.527778 15748 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 12:25:02.582827 15734 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:02.609166 12707 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:25:02.605567 15729 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:02.596613 15565 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:02.631728 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 212339us
I20260709 12:25:02.530937 15533 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.634543 12550 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.611397 15721 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:02.648074 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 159397us
I20260709 12:25:02.650848 12707 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:02.649487 12557 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:25:02.652669 15752 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 12:25:02.655686 15595 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:02.574509 15736 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.675773 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:02.676528 13235 raft_consensus.cc:606] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:02.676987 13235 raft_consensus.cc:614] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:02.679092 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 44046us
I20260709 12:25:02.682068 13227 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:02.686815 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:02.686817 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.653648 15331 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:02.579588 15740 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.615676 15734 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.701823 15770 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:02.702510 15770 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.704757 15770 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.705983 15705 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.725921 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:02.726676 13235 raft_consensus.cc:606] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:02.726933 13227 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:02.727074 13235 raft_consensus.cc:614] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:02.692672 15331 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:02.730270 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:02.730594 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 50610.2us
I20260709 12:25:02.722699 15732 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.735798 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:02.723737 15528 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.738222 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:02.738905 13232 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:02.744052 13230 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:02.740530 15528 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:02.745980 15528 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.747745 15654 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.750984 15654 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.748014 15770 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.753746 15331 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.755332 15331 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.755823 15734 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.732648 15717 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.756632 15717 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.758651 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.759070 15717 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:02.754115 15769 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:02.709939 15729 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.772922 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.757184 15771 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:25:02.775220 15766 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.775785 15766 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.763886 15644 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:02.778976 15466 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.780474 15713 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:02.780895 15713 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:02.781543 15466 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.781682 15713 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.782752 15713 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.794059 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.795683 12702 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:02.796311 13226 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 3.
I20260709 12:25:02.741571 15732 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.801681 12708 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:02.810310 12704 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:25:02.812976 12706 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:02.793816 15734 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.795286 15300 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.820796 15644 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:02.807751 15461 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:02.823678 15560 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
W20260709 12:25:02.819415 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46538.7us
I20260709 12:25:02.765898 15664 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.812702 15768 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:02.851043 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.861981 12674 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:02.865187 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.856913 15736 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.851960 15710 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.871207 12702 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:02.871313 15710 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.872287 12625 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:02.841892 15300 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.850749 15528 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.865867 12557 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:02.856833 15768 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:02.873742 15461 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:02.881458 15732 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.883785 15300 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:02.885895 15169 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:02.888197 13232 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:02.888602 12701 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:02.888912 15595 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:25:02.877772 15740 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.853988 15624 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.862674 15766 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.892992 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.896279 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.898689 15768 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:02.900377 12552 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:02.903766 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.929277 12555 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.909638 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:02.917577 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.924881 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62975.5us
I20260709 12:25:02.921154 12556 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:02.926553 12557 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.930111 12701 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:25:02.934057 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.935092 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:02.940586 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:02.949671 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.937749 15781 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:25:02.953495 12557 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:02.953935 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:02.954831 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:02.956009 12559 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:02.956700 12701 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:02.957089 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:02.956459 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:02.958571 12626 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 3: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:02.949002 15740 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:02.960749 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:02.951429 15728 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.954952 15732 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:02.969681 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.013759 12701 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:03.013659 15732 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.014753 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.015018 15466 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:03.015460 12701 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:03.015497 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:02.962849 15775 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
I20260709 12:25:02.971697 15496 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.986583 15624 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:02.990083 15727 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:02.991134 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.026070 15727 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:02.991853 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.992101 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:03.026983 12559 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.992875 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.992503 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.027853 12554 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:03.028247 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:03.028599 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.994779 15528 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:02.993146 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.996057 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d9812250f15d4075a3c8831ca5f3ed41 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:03.000463 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:03.027150 12551 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:03.029947 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.001469 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:02.993882 12629 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:03.000365 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:03.031136 13230 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.031518 13235 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:03.002777 13226 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:03.001758 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:03.003436 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:02.993346 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:03.003908 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.033205 12704 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:03.015838 15732 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:02.969918 15664 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:03.016937 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:02.970772 15384 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:02.965262 15740 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.020253 15736 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:03.016420 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:03.024273 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.044077 12701 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:03.026419 12557 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:03.027227 15727 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.028299 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:02.993712 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.029567 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:03.029665 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.045552 13227 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:03.048149 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:03.005221 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.034723 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:03.034987 12556 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:25:03.053974 12556 pending_rounds.cc:85] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 4
I20260709 12:25:03.054220 12556 pending_rounds.cc:107] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:25:03.054450 12556 raft_consensus.cc:2889] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:03.054809 12555 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:03.002832 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.041653 12598 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.055541 12699 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.045699 12554 raft_consensus.cc:2368] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
W20260709 12:25:03.004979 15783 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:03.019428 15461 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:03.077560 15736 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:03.077908 15461 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:03.078697 15736 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.078998 15461 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.016031 15466 consensus_queue.cc:1059] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:03.080490 15461 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.042230 15705 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.077608 12552 raft_consensus.cc:2368] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:25:03.081565 15466 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:03.044855 15770 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.082188 15466 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:03.069052 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.066681 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:03.069073 15780 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:25:03.069933 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.069128 15732 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:03.075170 15384 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:03.076373 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.095148 12699 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:03.095638 12705 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:03.085930 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.043408 15528 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:03.098718 12558 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:03.049773 15740 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.094930 15732 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.067727 15734 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.103046 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.104974 12550 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:03.105633 12559 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
W20260709 12:25:03.108386 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 66859us
I20260709 12:25:03.107507 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.110564 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.111321 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.111812 12700 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.112565 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.114758 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.016347 15728 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.099562 15710 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.100250 15727 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.106119 15732 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:03.117200 12558 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:03.081885 15705 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.128998 15705 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:03.129674 15466 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.131098 15466 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.134393 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.135581 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.136264 12706 raft_consensus.cc:2368] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:03.137039 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.140017 12706 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:03.125325 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:03.116856 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.106701 15528 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:03.157843 15762 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.575s	user 0.003s	sys 0.003s
I20260709 12:25:03.158092 13227 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:03.158360 15528 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.095575 15169 consensus_queue.cc:1059] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:25:03.126040 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.161139 15169 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:03.161789 12707 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.161237 15730 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:03.163043 15730 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:03.163882 15730 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.165010 15730 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.169888 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.169260 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:03.170769 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.171078 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.171593 12706 raft_consensus.cc:2410] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:03.172262 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.171171 13227 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:03.124009 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.146422 12701 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:03.137702 15423 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:03.192955 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:03.193702 12701 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:03.177361 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:03.177884 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:03.182390 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 58441.9us
I20260709 12:25:03.195469 12704 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:03.195497 12598 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.197038 12707 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:03.197935 12700 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:03.198431 12707 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:25:03.200848 12707 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.205996 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:03.208621 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.214967 12550 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:03.216552 12707 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.223029 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.223419 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:03.226459 12708 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:03.226768 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:03.226912 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:03.227770 15731 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.228264 12554 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:03.189826 15710 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.229614 15624 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:03.229808 15712 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:03.231103 15712 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:03.232079 15624 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:03.233556 12699 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.229827 15710 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:03.233062 15644 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:03.234297 15710 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:03.234755 12699 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:03.234823 15644 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:03.235116 15748 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:03.229303 15731 consensus_queue.cc:1059] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:25:03.235168 15710 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.236533 15731 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:03.236894 15731 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:03.237733 15731 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.239009 15731 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.239969 15607 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.240502 15713 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:03.229275 12523 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:03.241667 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.241895 15713 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.242295 15713 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:03.242499 15331 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:03.243031 15296 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:03.243611 15296 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:03.244478 15296 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.245554 15449 raft_consensus.cc:993] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:25:03.246023 15449 raft_consensus.cc:1081] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:25:03.247201 12701 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:03.247385 13201 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:03.248338 12707 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:03.250008 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:03.245153 15331 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.241699 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:03.254065 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:03.256410 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:03.257972 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.258199 12554 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:03.260149 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:03.260677 12559 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:03.267617 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:03.265180 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.268651 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.266001 12701 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:03.266309 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:03.271656 12632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:25:03.278169 12632 raft_consensus.cc:606] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:03.278221 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:03.278622 12632 raft_consensus.cc:614] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:03.285817 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.214334 15598 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:03.297237 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:03.160462 15728 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:03.214097 15722 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:03.248157 15644 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:03.295387 12701 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:03.259615 15341 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:03.296517 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:03.303498 12699 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:03.318327 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:03.304824 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:03.305466 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46429.2us
I20260709 12:25:03.331584 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:03.279147 13234 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:03.268260 15734 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.259646 15565 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:03.236917 15710 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.290882 15717 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.329963 12674 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:03.346379 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:03.295209 12555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:36566
I20260709 12:25:03.338282 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:03.347806 12555 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:03.348326 12555 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.290709 15770 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:03.288697 15331 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:03.302126 15771 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.309921 15449 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:03.243173 15713 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.312940 15722 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.338734 15565 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.358942 12704 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:03.334914 15528 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.319444 15767 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.358219 15791 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:25:03.309897 15464 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:25:03.344867 15598 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:03.349439 15717 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.398837 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:03.397583 15722 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.350958 15770 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:03.355768 15607 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:03.370105 15771 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.629670 15607 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:03.630254 15771 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:03.497967 15717 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.630636 15607 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.399356 15644 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.442970 15736 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:03.643352 15736 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.643548 15644 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:03.643890 15736 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.657785 15533 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:03.659413 15803 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:03.659965 15803 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.662609 15803 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:25:03.514719 12555 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:03.569533 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 223239us
W20260709 12:25:03.534708 15496 consensus_meta.cc:287] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.003s
W20260709 12:25:03.539062 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 253341us
W20260709 12:25:03.666386 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.666584 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.527768 15713 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:03.594972 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 263445us
I20260709 12:25:03.589685 15625 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:03.599388 15795 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.261s	user 0.001s	sys 0.000s
W20260709 12:25:03.600425 15794 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260709 12:25:03.600992 15788 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260709 12:25:03.601761 15789 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.341s	user 0.000s	sys 0.001s
I20260709 12:25:03.605876 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:03.606227 15619 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:03.626595 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.395502 15449 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:03.400552 15565 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.517957 12634 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:03.441645 13230 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:03.341679 15734 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.545275 15595 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.690065 15705 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:03.641324 15651 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.641175 15717 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.612032 15732 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.669219 13233 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:03.669710 15594 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:03.670179 13226 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:03.671193 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:03.408313 15767 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.676317 12629 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
W20260709 12:25:03.458913 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.676564 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 130498us
W20260709 12:25:03.694180 15727 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.570s	user 0.005s	sys 0.005s
W20260709 12:25:03.695488 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 365598us
I20260709 12:25:03.689518 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:03.698431 12555 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:03.700542 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:03.705993 15598 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:25:03.696961 15625 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.793489 12706 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 9. Ops: []
I20260709 12:25:03.740468 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:03.779963 12552 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:03.825724 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 136349us
I20260709 12:25:03.825876 13231 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.655825 15770 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.702023 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:03.590674 15464 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.083s
I20260709 12:25:03.700476 15766 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:03.724505 15730 consensus_meta.cc:287] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.559s	user 0.007s	sys 0.006s
I20260709 12:25:03.713729 15669 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:03.714264 15533 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.717501 12598 leader_election.cc:400] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
W20260709 12:25:03.728266 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.609336 15740 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.733534 13232 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:03.565003 15331 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.545492 15624 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.700793 15771 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:03.799312 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:03.821157 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.709745 15619 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.722589 15496 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:03.790267 15797 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:25:03.830925 15466 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.001s
I20260709 12:25:03.779387 15729 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.734899 15296 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.831743 15806 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:03.885288 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.832671 15651 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.887332 12707 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:03.792366 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:03.887858 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 59133.9us
I20260709 12:25:03.884771 12704 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:25:03.893714 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 60457.1us
I20260709 12:25:03.874634 13226 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:03.896512 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 191033us
I20260709 12:25:03.897818 12703 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:03.848384 15598 consensus_queue.cc:1243] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 23740bafdb794232879a0bb6884f7a68 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:03.845741 15736 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.903227 13229 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:03.830906 15748 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
W20260709 12:25:03.912708 15710 consensus_meta.cc:287] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.000s
I20260709 12:25:03.915551 15619 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:03.918046 15790 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.649s	user 0.004s	sys 0.000s
W20260709 12:25:03.919265 15796 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.407s	user 0.000s	sys 0.001s
I20260709 12:25:03.749547 15595 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.922125 15565 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.924801 15740 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:03.930848 15793 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 12:25:03.931679 15803 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:03.840655 15766 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.833662 15802 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
W20260709 12:25:04.006146 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.939778 15805 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260709 12:25:03.903257 15771 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.900906 15624 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.948470 15729 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:03.872534 15449 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:03.824905 15594 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:03.949793 12625 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:03.844516 15669 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:04.015121 15669 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.016129 15669 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:04.016260 15780 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.292s	user 0.000s	sys 0.002s
I20260709 12:25:04.018792 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2102) took 1144 ms. Trace:
I20260709 12:25:04.018698 15594 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.019953 15594 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.021677 12700 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.019182 12702 rpcz_store.cc:276] 0709 12:25:02.874187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.874333 (+   146us) service_pool.cc:224] Handling call
0709 12:25:02.879639 (+  5306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:02.880046 (+   407us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:02.880076 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:02.910309 (+ 30233us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.280041 (+369732us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:03.280080 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.280143 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:03.930083 (+649940us) spinlock_profiling.cc:243] Waited 5.27 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:04.018497 (+ 88414us) raft_consensus.cc:1685] finished
0709 12:25:04.018515 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.018732 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":101,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":12125440,"thread_start_us":369388,"threads_started":1,"wal-append.queue_time_us":447458}
I20260709 12:25:03.961373 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:03.957579 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:03.957933 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:03.948793 15423 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.550s	user 0.005s	sys 0.005s
I20260709 12:25:03.895823 15464 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 12:25:03.965366 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:03.998615 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.998076 15598 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:03.952131 15296 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.008415 13228 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:04.012334 15654 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:04.012642 15731 consensus_meta.cc:287] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.773s	user 0.012s	sys 0.001s
I20260709 12:25:04.014006 15807 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:04.023764 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 66076us
I20260709 12:25:03.957015 15806 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:04.027271 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 62011us
I20260709 12:25:03.943251 13231 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:04.004715 15803 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:04.037920 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:03.893879 15533 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.048543 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2103) took 1060 ms. Trace:
I20260709 12:25:04.027982 15710 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.033561 15644 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:03.983335 15722 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:04.057135 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 101351us
I20260709 12:25:04.022980 15466 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:04.059310 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 131890us
I20260709 12:25:04.049098 12705 rpcz_store.cc:276] 0709 12:25:02.988363 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.256705 (+268342us) service_pool.cc:224] Handling call
0709 12:25:03.264468 (+  7763us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.398688 (+134220us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:25:03.398717 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.402308 (+  3591us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.689265 (+286957us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:03.689306 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:03.689376 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.048304 (+358928us) raft_consensus.cc:1685] finished
0709 12:25:04.048331 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.048485 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5217,"raft.queue_time_us":13629,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":13305,"thread_start_us":278180,"threads_started":2,"wal-append.queue_time_us":489884}
I20260709 12:25:04.066124 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.074622 12674 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.080201 12626 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:04.080492 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 125580us
I20260709 12:25:04.058630 15731 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.061465 15644 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.038949 15812 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:25:04.040222 15598 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:04.088120 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 153512us
I20260709 12:25:04.101147 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:04.101933 13231 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.068966 15717 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.055116 15664 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:04.073634 15732 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.076095 15734 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.109231 15736 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.109581 15565 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:04.130227 15736 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:04.130951 15736 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.111392 15722 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.112090 15651 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.112679 15766 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.113584 15533 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.114758 15729 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.116518 15598 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.117096 15595 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.039661 15807 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:04.084615 15816 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260709 12:25:04.107690 15624 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.099606 15644 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.135692 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.135221 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:04.161033 12554 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:04.162017 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 75699.9us
I20260709 12:25:04.162810 12674 leader_election.cc:400] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:25:04.163065 12674 leader_election.cc:403] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:04.163933 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.164947 12674 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:04.160254 12552 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:04.139011 13231 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
W20260709 12:25:04.144429 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.149823 15809 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.186s	user 0.001s	sys 0.000s
I20260709 12:25:04.152312 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.127553 15767 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.087566 15710 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
I20260709 12:25:04.073616 15466 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.104446 15496 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:25:04.172791 12553 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:04.174818 12554 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
W20260709 12:25:04.177881 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 211367us
I20260709 12:25:04.135486 15731 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:25:04.140812 15734 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:25:04.180941 12705 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:04.150460 15495 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:04.207630 12701 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:04.154772 15728 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:04.154951 15732 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:04.207954 12702 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:04.214049 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.226215 15771 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.227372 15466 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.227933 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.219656 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.218549 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.228899 12703 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:04.229911 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:04.231302 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.232493 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.233218 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:04.238596 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:04.238847 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:04.239311 12629 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.240744 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.241494 12708 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:04.133503 15803 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.179755 15801 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 4. Current term is 5.
I20260709 12:25:04.186691 15828 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.244424 13231 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:04.187727 15814 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.219835 15717 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.132930 15806 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.247165 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.246634 12630 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:04.255509 12625 raft_consensus.cc:2410] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:04.257050 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:04.257361 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:04.257910 13227 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:04.258278 13226 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.223021 15731 consensus_queue.cc:1243] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 12:25:04.246572 15818 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:25:04.267524 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:04.269280 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 143376us
W20260709 12:25:04.272025 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 150646us
I20260709 12:25:04.277834 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.301607 12630 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:04.307118 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2106) took 1038 ms. Trace:
I20260709 12:25:04.308862 12699 rpcz_store.cc:276] 0709 12:25:03.268555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.326479 (+ 57924us) service_pool.cc:224] Handling call
0709 12:25:03.346658 (+ 20179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.346978 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:03.347005 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:03.347401 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 12:25:03.674261 (+326860us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:03.700676 (+ 26415us) log.cc:844] Serialized 14 byte log entry
0709 12:25:04.156176 (+455500us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.156268 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.306921 (+150653us) raft_consensus.cc:1685] finished
0709 12:25:04.306939 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.307064 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":266059,"prepare.queue_time_us":26239,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":53,"raft.queue_time_us":375431,"raft.run_cpu_time_us":270,"raft.run_wall_time_us":68608,"thread_start_us":365336,"threads_started":2,"wal-append.queue_time_us":474250}
I20260709 12:25:04.327436 12633 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:04.328670 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:04.329833 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.350796 13226 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:04.265671 15296 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.330308 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:04.333101 12628 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:04.273327 15728 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.405071 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:04.435730 13226 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:25:04.420328 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.273581 15731 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:04.454697 13198 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:04.248968 15825 consensus_queue.cc:1059] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.118s
W20260709 12:25:04.458003 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 148938us
W20260709 12:25:04.462463 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 195014us
I20260709 12:25:04.464079 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.483771 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:04.460875 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.273065 15803 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.277490 15824 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:04.458806 15713 consensus_meta.cc:287] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.770s	user 0.012s	sys 0.000s
I20260709 12:25:04.499676 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:04.506045 13201 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.463474 15300 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.458968 15731 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:04.458441 15624 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:04.492337 15449 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.457966 15728 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:04.510761 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46744.5us
W20260709 12:25:04.510905 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50106.6us
I20260709 12:25:04.523808 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.543956 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.498134 15495 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:04.596354 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:04.605468 12701 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.543525 15624 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.493672 15801 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:04.597784 12674 leader_election.cc:400] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
W20260709 12:25:04.598649 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.613806 12629 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:04.599560 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.615015 12703 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
W20260709 12:25:04.600546 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 93430.1us
I20260709 12:25:04.504056 15827 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.602880 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.498194 15331 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:25:04.517800 15651 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:04.546581 15461 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:04.618024 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 71970.6us
I20260709 12:25:04.618944 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.596941 15734 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:04.604780 15466 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:04.622443 12705 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:04.624868 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:04.627451 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2109) took 1358 ms. Trace:
I20260709 12:25:04.631397 12706 rpcz_store.cc:276] 0709 12:25:03.269309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.912849 (+643540us) service_pool.cc:224] Handling call
0709 12:25:03.913202 (+   353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:04.138008 (+224806us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:04.138052 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:04.149181 (+ 11129us) log.cc:844] Serialized 26 byte log entry
0709 12:25:04.250587 (+101406us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:04.250636 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.251998 (+  1362us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:04.627238 (+375240us) raft_consensus.cc:1685] finished
0709 12:25:04.627260 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:04.627393 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":82886,"raft.queue_time_us":122537,"raft.run_cpu_time_us":242,"raft.run_wall_time_us":12855,"thread_start_us":242375,"threads_started":2,"wal-append.queue_time_us":242674}
I20260709 12:25:04.642750 15624 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.644115 15823 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.644672 15823 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.645615 15834 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:04.646196 15834 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:04.647104 15834 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:04.648545 15669 consensus_meta.cc:287] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.632s	user 0.007s	sys 0.000s
I20260709 12:25:04.649503 15832 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:04.649947 15832 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:04.650336 15832 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.650466 15728 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.623888 15651 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.654146 15651 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.658797 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.522814 15300 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.547449 15449 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.662599 12701 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:04.636894 15713 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:04.685768 15713 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:04.686757 15713 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:04.679955 15829 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 12:25:04.616668 15495 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.690761 15449 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.691473 15838 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.691992 15838 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.677664 15466 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:04.693946 15466 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:04.694145 15838 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.694844 15466 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.634280 15731 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.696602 15731 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.695943 15300 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.690873 15495 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:04.695320 15644 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.003s
W20260709 12:25:04.705336 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.730545 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 115865us
W20260709 12:25:04.726543 15826 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.416s	user 0.001s	sys 0.000s
I20260709 12:25:04.736373 12555 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:04.742624 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 111688us
I20260709 12:25:04.738853 12598 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:04.725215 15461 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:04.734526 15819 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.447s	user 0.001s	sys 0.000s
I20260709 12:25:04.729928 15801 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:04.747010 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:04.743847 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:04.730050 15771 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:04.746052 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 217082us
I20260709 12:25:04.764950 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.767577 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:04.769719 12553 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:04.730325 15644 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.751096 15837 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:04.783226 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.788134 15853 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:04.788674 15474 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:04.789201 15474 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.788789 15853 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.789597 15474 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.791808 15853 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.798815 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.799305 15849 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:04.804672 15849 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:04.804719 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.805729 15849 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.806357 12706 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:04.808207 12706 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.778637 15823 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.750631 15461 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.811658 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:04.812294 12703 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:04.744390 15496 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:04.776989 15767 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:04.778028 15812 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.813862 12706 raft_consensus.cc:3055] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:04.814357 12706 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:04.813953 15767 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.802198 15825 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.815119 12706 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.815357 15825 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.816169 15767 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.816951 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 588) took 1682 ms. Trace:
W20260709 12:25:04.820688 15736 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.689s	user 0.004s	sys 0.004s
I20260709 12:25:04.820804 15767 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:04.821365 15767 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.822474 15644 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.822798 15461 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:04.763846 15801 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.800632 15651 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.823680 15767 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.824630 15801 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:04.769138 15771 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.828609 12699 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:04.817374 12707 rpcz_store.cc:276] 0709 12:25:03.134661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.275519 (+140858us) service_pool.cc:224] Handling call
0709 12:25:03.275804 (+   285us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.951717 (+675913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.816702 (+864985us) spinlock_profiling.cc:243] Waited 575 ms on lock 0x7b5400440054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:04.816885 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322265344}
I20260709 12:25:04.839473 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:04.841727 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.842499 12558 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.834753 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.846122 12552 raft_consensus.cc:1813] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Handling vote request from an unknown peer c6795b140b3247279a2231c6b9360d24
I20260709 12:25:04.846634 12552 raft_consensus.cc:2410] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:25:04.836580 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.848102 12554 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:04.849294 12559 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:04.836934 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.851465 12550 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
W20260709 12:25:04.836853 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.854159 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:04.854856 12557 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:04.855243 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.853847 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:04.826766 15770 consensus_meta.cc:287] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.994s	user 0.011s	sys 0.000s
I20260709 12:25:04.863526 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:04.863559 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.866597 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.866815 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.870138 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.872365 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.825140 15807 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.821146 15736 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.873668 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.840143 15801 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.869236 15461 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.869477 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.873654 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.828284 15837 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.825163 15651 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.879802 12523 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:04.892009 12702 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:04.874279 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:04.853818 15823 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:04.879498 15533 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:25:04.811905 15832 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.866314 15644 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.873850 15767 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.873353 15853 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.878345 15825 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:04.890944 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 147250us
I20260709 12:25:04.895009 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:04.896875 15858 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:04.909754 15858 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:04.879648 15734 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:04.867869 15705 consensus_queue.cc:1059] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:25:04.898587 15461 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.908241 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:04.924612 12699 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.876462 15712 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:04.911414 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:04.875944 15770 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.885649 15801 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.908138 15823 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:04.898447 15423 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:04.883121 15624 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:04.939057 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.897998 15807 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:04.923353 12703 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:04.917793 15734 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:04.922945 15837 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:04.883247 15300 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:04.924919 15825 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.944861 15807 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.956369 15807 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.957450 15771 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.952105 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.908682 15767 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:04.961678 12626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 728) took 1665 ms (client timeout 2060 ms). Trace:
W20260709 12:25:04.962060 12626 rpcz_store.cc:269] 0709 12:25:03.296070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.296314 (+   244us) service_pool.cc:224] Handling call
0709 12:25:04.961486 (+1665172us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b5400116054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:04.961611 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1677951744}
I20260709 12:25:04.962536 15767 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.908488 15644 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.962845 12705 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:04.963797 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.964505 15644 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:04.964978 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.910923 15853 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.939610 15705 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:04.937613 15728 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.958325 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.968765 12703 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:25:04.908293 15466 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.945977 15624 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.939280 15423 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.959255 15861 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.974864 15861 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.975800 15770 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:04.976439 15823 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.977048 15861 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:04.980583 15820 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.851s	user 0.000s	sys 0.018s
I20260709 12:25:04.981063 15801 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:04.952256 15734 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.972362 15423 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:04.935195 15461 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:04.969930 15624 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.974082 15832 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:04.974248 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 784) took 1311 ms. Trace:
I20260709 12:25:04.970453 15705 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:04.955693 12707 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:04.978331 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.993796 13232 rpcz_store.cc:276] 0709 12:25:03.662662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.663935 (+  1273us) service_pool.cc:224] Handling call
0709 12:25:03.733249 (+ 69314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.883251 (+150002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.974055 (+1090804us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b54007256d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:04.974170 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143064832}
I20260709 12:25:04.969890 15466 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:04.960628 12699 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:04.952608 15837 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:04.986917 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:04.976483 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 847) took 1978 ms. Trace:
I20260709 12:25:04.988160 13199 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.006752 12705 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:05.007959 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.008090 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:05.008874 12705 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.009891 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.010740 12699 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:05.005452 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.013144 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.020999 15771 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:05.021522 15771 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:05.022109 15644 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:05.022557 15644 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.022364 15771 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.022914 15644 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.025863 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.026799 15767 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:05.027168 15767 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.027523 15767 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.030471 15644 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.032722 15644 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.006671 13229 rpcz_store.cc:276] 0709 12:25:02.998229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.998385 (+   156us) service_pool.cc:224] Handling call
0709 12:25:02.998781 (+   396us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.961306 (+962525us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.976252 (+1014946us) spinlock_profiling.cc:243] Waited 904 ms on lock 0x7b54006f63d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:04.976424 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2079502720}
I20260709 12:25:05.036413 15853 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.036554 15832 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:05.038784 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.040599 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:05.041174 12703 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.042608 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.037009 15832 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.045421 15832 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.046761 15466 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:05.043756 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:04.970651 15474 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.054409 12705 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:05.054826 13198 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:05.056493 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.058080 15864 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.058629 15864 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.062378 13230 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:05.062777 13230 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:05.066591 12703 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:05.067643 12699 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [7.5-8.6]
W20260709 12:25:05.047608 15836 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.530s	user 0.002s	sys 0.001s
I20260709 12:25:05.070467 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.072623 12705 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:05.076545 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:05.076648 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 187762us
I20260709 12:25:05.066131 15849 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.077421 15849 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.078063 15560 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:05.078462 15560 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:05.079254 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:05.079617 15849 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.080200 15849 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:05.080651 15849 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.081845 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:05.043360 15806 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.064980 15832 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.087215 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.090359 13232 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:05.068802 15300 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:05.091571 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:05.070104 15864 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.096030 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:05.107398 12634 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
W20260709 12:25:05.108633 15862 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260709 12:25:05.112605 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.116084 12626 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:05.085752 15651 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:05.089834 15717 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:05.088251 15705 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.117949 15651 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:05.117991 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:05.088450 15837 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.119233 15837 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.119174 15296 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:05.120486 15461 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.120775 15768 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.121301 15768 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.122051 15474 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.122434 15767 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.123298 15768 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.124411 15767 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.106020 15644 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:05.125157 15644 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:05.128260 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.106329 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:05.119017 15651 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.126188 15832 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.133917 12702 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:05.079293 15560 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:05.138020 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46381.2us
W20260709 12:25:05.141903 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50408.8us
I20260709 12:25:05.096145 12703 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:05.144035 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.113029 15624 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.150928 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.157465 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1853) took 2186 ms. Trace:
I20260709 12:25:05.131853 15300 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:05.166014 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:05.208077 12702 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.157888 12700 rpcz_store.cc:276] 0709 12:25:02.971045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.198629 (+227584us) service_pool.cc:224] Handling call
0709 12:25:04.021510 (+822881us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:04.022112 (+   602us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.157175 (+1135063us) spinlock_profiling.cc:243] Waited 823 ms on lock 0x7b540041ffd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:05.157350 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1891817728}
W20260709 12:25:05.199318 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.140550 15705 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.094236 15806 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.220378 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:05.152598 15802 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.230471 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:05.126057 15644 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.227435 12705 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:05.231825 12700 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.169514 15771 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:05.159240 15853 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:05.250136 15853 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.250541 15853 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:05.167191 15560 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:05.126732 15804 consensus_queue.cc:1175] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" responder_term: 7 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.8-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:05.155200 15801 raft_consensus.cc:2764] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:25:05.246737 15771 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.275218 15771 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.282481 15624 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:05.283728 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.151190 15861 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:25:05.284416 15861 consensus_queue.cc:1243] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:05.272802 15772 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.232072 15868 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.227407 15740 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:05.208550 15664 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:05.309516 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.234014 15802 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:05.328159 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.317373 12702 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:05.353217 13226 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:05.352963 13232 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:05.328405 12700 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
W20260709 12:25:05.355482 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.352428 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.355769 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:05.356362 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.341710 12705 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:05.229470 15300 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.360121 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:05.361503 12700 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:05.365816 12522 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:05.352699 15740 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.370319 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2107) took 2101 ms. Trace:
I20260709 12:25:05.372588 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.354740 15802 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.373831 12704 rpcz_store.cc:276] 0709 12:25:03.268828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.402910 (+134082us) service_pool.cc:224] Handling call
0709 12:25:03.407886 (+  4976us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:03.954268 (+546382us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.370139 (+1415871us) spinlock_profiling.cc:243] Waited 444 ms on lock 0x7b54002a2954. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:05.370277 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1020474112}
I20260709 12:25:05.377513 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.380340 12705 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:05.357126 15624 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.384586 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.359850 15768 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:05.352936 15664 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.289355 15807 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.385191 15849 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.388022 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.373504 15766 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:05.393385 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.394243 13226 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:05.397794 12699 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:05.400993 13232 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:05.405706 15853 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.414754 12627 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:05.415537 15423 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.285140 15772 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.419974 15300 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:05.422152 15740 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.385941 15730 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.426307 15734 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.428540 15806 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.287009 15868 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.431068 15598 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:05.431495 15598 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:05.434870 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:05.434693 15873 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:05.388895 15624 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.455953 15734 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:05.398211 15560 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.434834 15766 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:05.457823 15838 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:05.434619 15807 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.456158 15625 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.457726 15331 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:05.471222 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.435098 15730 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:05.506042 12522 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.2:34669 timed out after 1.544s (SENT) [suppressed 46 similar messages]
I20260709 12:25:05.424687 15875 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:05.468164 15423 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.472847 15768 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.466084 15598 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.531929 15871 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:05.560969 15875 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.551272 15331 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.589890 15766 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.538759 15838 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.531232 15560 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.596235 15331 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.596558 15664 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:05.598299 15624 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.599440 15875 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.600845 15598 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.629338 12705 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:05.630329 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.632773 15799 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:05.661859 15799 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:05.662961 15799 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.664144 15799 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:05.667368 15772 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.669808 13230 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.671386 13230 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.676221 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.557199 15296 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.653954 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.660686 15875 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:05.690570 13230 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:05.654034 15528 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:05.692166 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.694891 13199 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:05.695398 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.696424 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.699728 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.701018 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.567555 15768 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:05.692847 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 186854us
I20260709 12:25:05.699728 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:05.691744 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 791) took 1992 ms (client timeout 1756 ms). Trace:
I20260709 12:25:05.637640 15838 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.594126 15871 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:05.800439 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.831789 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.774825 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:05.756973 12699 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:05.738967 12707 raft_consensus.cc:2393] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:05.773152 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.686281 15664 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.819695 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:06.013554 12704 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.029s	sys 0.061s
I20260709 12:25:05.691561 15875 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.043977 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.996783 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:05.992180 13230 rpcz_store.cc:269] 0709 12:25:03.699868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.792067 (+ 92199us) service_pool.cc:224] Handling call
0709 12:25:05.062252 (+1270185us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400132a20. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a62dc0 00007f0e94aeee18 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:05.669402 (+607150us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400132a20. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a6906f 00007f0e94ae1f60 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2
0709 12:25:05.691678 (+ 22276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1318590592}
W20260709 12:25:06.016239 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.734221 15823 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:06.045796 12704 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.031s	sys 0.068s
I20260709 12:25:05.691869 15331 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:06.045288 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.055685 15882 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260709 12:25:05.692473 15868 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.079073 12522 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:06.082420 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:05.688588 15837 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:06.058514 12707 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:05.809504 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:06.035825 15713 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.343s	user 0.013s	sys 0.020s
I20260709 12:25:05.734014 15300 consensus_queue.cc:1059] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.344s
I20260709 12:25:06.066979 12699 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:25:06.091650 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:05.702045 15528 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:05.734404 15812 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:05.874162 15466 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:05.810578 15560 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:05.819351 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.055233 15875 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:06.010471 15799 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:06.056244 15533 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.121038 15730 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.161664 15812 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:06.166689 15598 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:06.167390 15598 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.167586 15812 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.168623 15528 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.079188 15331 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:05.696331 15296 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.089828 13231 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:25:05.697660 15845 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.063796 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.098142 12699 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:06.098748 12707 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [7.5-8.6]
W20260709 12:25:06.091486 15713 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.399s	user 0.013s	sys 0.021s
W20260709 12:25:06.104856 12600 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.006s	sys 0.011s
W20260709 12:25:06.187193 12600 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.007s	sys 0.011s
I20260709 12:25:06.106791 13228 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:06.088706 15423 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:06.059046 15664 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.118803 13235 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:06.113839 15868 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:06.182619 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.091240 15837 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.170392 15560 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.169430 15528 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:06.205905 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:06.191047 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:06.189502 12629 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:06.190366 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:06.182495 15880 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:06.175012 15730 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:06.183588 15598 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.205102 12631 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:25:06.217309 12631 pending_rounds.cc:85] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 5
I20260709 12:25:06.217636 12631 pending_rounds.cc:107] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:06.217892 12631 raft_consensus.cc:2889] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:06.186921 15823 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:06.178880 15888 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:06.170156 15799 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:06.198252 15802 consensus_meta.cc:287] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.002s
I20260709 12:25:06.195119 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:06.232816 12625 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:06.215513 12627 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:06.122421 15466 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.207754 12634 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:06.224159 12633 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:25:06.221091 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 158506us
I20260709 12:25:06.179526 15533 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.218616 13234 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:06.221721 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:06.219868 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.188410 15845 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.217980 15894 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:06.225164 15888 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:06.206758 15868 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.210378 15560 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.220700 15730 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:06.277370 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 56624.8us
W20260709 12:25:06.388478 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 143392us
W20260709 12:25:06.379990 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 263011us
W20260709 12:25:06.426905 15891 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:25:06.305055 15887 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:25:06.277333 15880 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:06.461045 15768 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.487583 15837 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.438310 15644 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:06.488790 15466 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:06.479955 15464 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:25:06.466061 15823 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.486799 15799 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:04.106396 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:06.278513 15871 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.274061 15895 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:06.274386 15889 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.211s
I20260709 12:25:06.485250 15664 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.504487 15801 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:06.485543 15896 log.cc:927] Time spent T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.159s	user 0.000s	sys 0.000s
W20260709 12:25:06.500118 15771 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 1.224s	user 0.012s	sys 0.002s
I20260709 12:25:06.505064 15801 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.505623 15771 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.489308 15466 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.506822 15466 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.507740 15771 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.486788 15845 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.498106 15296 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.508857 15466 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.485617 15331 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.512322 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 607) took 1524 ms. Trace:
I20260709 12:25:06.310537 15838 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.247241 15802 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.499763 15768 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:06.530202 15331 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:06.536641 15768 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.537451 15607 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:06.537945 15607 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:06.537420 15331 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.538766 15607 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.488202 15644 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.496841 12632 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:06.449196 15875 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.542241 15644 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.543105 15875 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.544301 15331 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.545573 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 606) took 1562 ms. Trace:
I20260709 12:25:06.379400 15899 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:06.509557 12455 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 5, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 5 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:06.519913 15895 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.513214 15731 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.531560 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:06.532761 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:06.533247 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:06.573625 12625 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:06.538888 15768 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.504297 15766 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:06.575855 15528 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.427037 15423 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:06.513195 12704 rpcz_store.cc:276] 0709 12:25:04.988369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.379089 (+390720us) service_pool.cc:224] Handling call
0709 12:25:05.379505 (+   416us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:05.379775 (+   270us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:06.069086 (+689311us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.511995 (+442909us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.512044 (+    49us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:06.512099 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.512163 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.512269 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7816,"prepare.queue_time_us":151221,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":306672,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":1077483,"threads_started":3,"wal-append.queue_time_us":155035}
I20260709 12:25:06.572211 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:06.508885 15801 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.545956 12700 rpcz_store.cc:276] 0709 12:25:04.982960 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.373376 (+390416us) service_pool.cc:224] Handling call
0709 12:25:05.377260 (+  3884us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.377736 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:05.387660 (+  9924us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.687207 (+299547us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.796820 (+109613us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.797038 (+   218us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:05.797396 (+   358us) log.cc:844] Serialized 14 byte log entry
0709 12:25:05.887914 (+ 90518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.888078 (+   164us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.545363 (+657285us) raft_consensus.cc:1685] finished
0709 12:25:06.545383 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.545512 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":90036,"prepare.queue_time_us":61348,"prepare.run_cpu_time_us":112,"prepare.run_wall_time_us":114,"raft.queue_time_us":90326,"raft.run_cpu_time_us":260,"raft.run_wall_time_us":12706,"thread_start_us":252518,"threads_started":1,"wal-append.queue_time_us":423775}
I20260709 12:25:06.586827 12707 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:06.587447 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:06.578358 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 112746us
I20260709 12:25:06.577169 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:06.587867 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:06.588433 12699 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:06.588634 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:06.588472 12707 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:06.589282 12700 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:06.589442 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:06.590013 12699 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.575703 15814 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.596029 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:06.594030 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:06.597577 15814 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.576376 15899 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.599864 15814 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.614194 15804 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.614738 15804 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.616497 15899 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.616797 15801 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:06.581987 15898 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
I20260709 12:25:06.477850 15894 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.606321 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:06.621253 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:06.621960 12704 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:06.618232 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:06.532559 15858 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:25:06.579613 15766 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.623164 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:06.625062 15838 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:06.625520 15838 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:06.626273 15838 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.627415 15838 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.634655 15802 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.600677 12700 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:06.645845 12671 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:06.648132 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:06.650713 12699 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:06.651351 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.651677 12707 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260709 12:25:06.652112 12699 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:06.652459 12699 pending_rounds.cc:85] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 6
I20260709 12:25:06.652684 12699 pending_rounds.cc:107] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:06.652909 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.656638 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.657243 13229 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:06.659190 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.659260 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:06.618880 15768 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:06.581990 15528 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.647368 15833 raft_consensus.cc:2764] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:06.660478 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.682480 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.683131 13235 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:06.652920 12699 raft_consensus.cc:2889] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:06.684852 15907 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:06.685505 15903 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.686074 15903 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.661716 15906 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.688855 15906 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:06.689231 15906 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.580129 15731 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.691213 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:06.697961 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.605921 15533 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.653817 15296 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:06.625178 15766 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.653374 15814 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.710665 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:06.714394 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.716913 13231 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:06.595853 15423 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.662367 15899 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:06.725615 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:06.636479 15894 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.718948 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:06.648289 15801 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:25:06.728739 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:06.731071 12597 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:06.728870 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 82265.9us
I20260709 12:25:06.707139 15768 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:06.666955 15466 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:25:06.533203 15888 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.741693 13231 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:06.725032 15899 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.726819 15902 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.729802 15727 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:06.704618 15802 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:06.727509 15730 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.737908 15560 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.736224 15894 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:06.750409 15910 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:06.728978 15833 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.773850 15833 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.764925 15423 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:06.720299 15914 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260709 12:25:06.746938 15644 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:25:06.772105 15894 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.778327 15644 consensus_queue.cc:1243] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 6.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:06.778578 15894 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:06.767148 15731 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:06.769620 15884 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.647s	user 0.002s	sys 0.001s
I20260709 12:25:06.748222 15899 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:06.785884 15831 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 2.243s	user 0.000s	sys 0.029s
I20260709 12:25:06.786280 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2140) took 1656 ms. Trace:
I20260709 12:25:06.786685 12703 rpcz_store.cc:276] 0709 12:25:05.129939 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.052146 (+922207us) service_pool.cc:224] Handling call
0709 12:25:06.058101 (+  5955us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.174833 (+116732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.174875 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.176446 (+  1571us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.554411 (+377965us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.554479 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.554571 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.786059 (+231488us) raft_consensus.cc:1685] finished
0709 12:25:06.786079 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.786211 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110720,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":82,"thread_start_us":449254,"threads_started":2,"wal-append.queue_time_us":394916}
I20260709 12:25:06.776032 15833 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.794260 12523 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:06.799815 15296 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:06.800500 15296 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:06.771512 15768 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.801585 15296 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:06.761093 15902 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.808264 15902 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.747160 15868 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.785547 15919 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:06.809561 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:06.812242 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 793) took 1113 ms. Trace:
I20260709 12:25:06.816630 15804 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.819186 15894 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.821282 15894 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.812759 13232 rpcz_store.cc:276] 0709 12:25:05.699108 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.699521 (+   413us) service_pool.cc:224] Handling call
0709 12:25:06.811997 (+1112476us) spinlock_profiling.cc:243] Waited 640 ms on lock 0x7b5400142b54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:06.812166 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1472270720}
I20260709 12:25:06.841988 15906 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:06.843144 15916 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.158s	user 0.002s	sys 0.000s
I20260709 12:25:06.844321 15906 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.844602 12630 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:06.847478 15888 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.850028 15899 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:06.857697 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 63543.4us
W20260709 12:25:06.876929 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 130296us
I20260709 12:25:06.871299 15899 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.893641 15906 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.906324 15906 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:06.908432 15906 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:06.913726 15853 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.942961 15528 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:06.951025 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:06.951972 12627 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:06.953192 12632 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:25:06.981693 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:06.984710 12631 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:06.983506 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:06.999487 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.000000 12627 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:07.000346 12632 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:07.001793 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.002020 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.088030 15740 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.137086 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:07.138245 12629 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:25:07.088801 15740 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:07.153425 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.154865 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2134) took 2235 ms. Trace:
I20260709 12:25:07.155434 12702 rpcz_store.cc:276] 0709 12:25:04.919085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.373517 (+454432us) service_pool.cc:224] Handling call
0709 12:25:05.373904 (+   387us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.374295 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.374320 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.380618 (+  6298us) log.cc:844] Serialized 26 byte log entry
0709 12:25:05.756934 (+376316us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:05.756976 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:05.757060 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.941599 (+1184539us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b24002167b8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e918849c4 00007f0e91882acb 00007f0e91a3ddc9 00007f0e91a3da55 00007f0e91a3cfb0 00007f0e946b3488 00007f0e946b3be8 00007f0e9468b398 00007f0e9468676a 00007f0e94685bb6
0709 12:25:06.942644 (+  1045us) raft_consensus.cc:1685] finished
0709 12:25:06.942666 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.154796 (+212130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6192,"spinlock_wait_cycles":5675392,"thread_start_us":300139,"threads_started":1,"wal-append.queue_time_us":683136}
I20260709 12:25:07.157348 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.158072 12632 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:07.160275 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.160884 12625 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:07.163733 12552 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:07.164713 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.167372 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.168094 12559 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.169940 12557 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:07.170943 12554 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:07.165993 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.172616 12558 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.173094 12551 raft_consensus.cc:2410] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:07.167536 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.173728 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.174754 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.175454 12557 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:07.175729 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.176214 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.176472 12550 raft_consensus.cc:2410] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:07.176781 12557 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:25:07.177641 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.178359 12553 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.179363 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.179621 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.180433 12555 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.171769 15644 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:07.182035 15644 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.174870 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.153497 15919 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.189489 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.187532 12701 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:07.188297 12558 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:07.191368 12702 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:07.174808 15771 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.197625 12707 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:07.201536 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.202425 12558 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.200994 15823 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.008s
I20260709 12:25:07.212939 15740 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:07.214116 15771 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.216253 15771 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.189512 15919 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.220330 12554 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:07.220378 15740 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:07.221542 15919 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.223400 15296 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.224054 15296 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.221297 15740 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:07.225901 15740 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:07.226632 15296 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.226765 15740 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.228176 15740 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.228930 15644 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.236057 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:07.236660 12625 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.238025 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.255229 12632 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:07.256242 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.193536 15895 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.280311 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.281549 12558 raft_consensus.cc:2410] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:07.285074 12625 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:07.288175 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.289198 12558 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.277913 15705 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.301822 12558 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:25:07.306533 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.200212 15834 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.099s
W20260709 12:25:07.320441 12453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 320) took 23017 ms (client timeout 15000 ms). Trace:
I20260709 12:25:07.323490 12455 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.325299 12455 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 8, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 8 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:07.328286 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2137) took 2331 ms. Trace:
I20260709 12:25:07.328770 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.328656 12705 rpcz_store.cc:276] 0709 12:25:04.996473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.381267 (+384794us) service_pool.cc:224] Handling call
0709 12:25:05.629097 (+247830us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.658107 (+ 29010us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.328097 (+1669990us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54002a2e50. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:07.328230 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563337600}
W20260709 12:25:07.328766 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.294266 15767 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.036s
I20260709 12:25:07.291245 15768 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:25:07.335456 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.294448 15296 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:07.326756 12455 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:07.297698 15644 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:25:07.340885 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:07.342294 12705 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.342154 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.341259 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.330893 15895 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.346144 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.346748 12699 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:07.338080 12455 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 1 to 4, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.350167 12699 pending_rounds.cc:85] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 4
I20260709 12:25:07.350468 12699 pending_rounds.cc:107] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 12:25:07.350693 12699 raft_consensus.cc:2889] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:07.312932 15919 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:07.352530 12702 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:07.353315 12705 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:07.355185 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.355844 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.356472 12701 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:07.339219 15770 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.310765 15705 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.356966 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.360914 12707 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:07.354419 12455 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 8, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:07.320885 12453 rpcz_store.cc:269] 0709 12:24:44.303304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.379712 (+ 76408us) service_pool.cc:224] Handling call
0709 12:24:46.492669 (+2112957us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a55090 00007f0e94af3f3a 00007f0e9a8a9e9c 00007f0e9a9a804e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc 00007f0e98e68392 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:07.320339 (+20827670us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:02.169779 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:02.285101 (+115322us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:02.285172 (+    71us) write_op.cc:435] Acquired schema lock
0709 12:25:02.285228 (+    56us) tablet.cc:662] Decoding operations
0709 12:25:02.286625 (+  1397us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:02.286752 (+   127us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:02.286795 (+    43us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:25:02.287881 (+  1086us) tablet.cc:701] Row locks acquired
0709 12:25:02.287944 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:25:02.288170 (+   226us) write_op.cc:270] Start()
0709 12:25:02.288405 (+   235us) write_op.cc:276] Timestamp: P: 1783599902288102 usec, L: 0
0709 12:25:02.288432 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:25:02.289401 (+   969us) log.cc:844] Serialized 3568 byte log entry
0709 12:25:02.820719 (+531318us) op_driver.cc:464] REPLICATION: finished
0709 12:25:02.899834 (+ 79115us) write_op.cc:301] APPLY: starting
0709 12:25:02.899939 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:02.900151 (+   212us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:02.900282 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:02.903958 (+  3676us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:02.904274 (+   316us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:25:02.904331 (+    57us) write_op.cc:312] APPLY: finished
0709 12:25:02.904662 (+   331us) log.cc:844] Serialized 71 byte log entry
0709 12:25:02.904842 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:02.904960 (+   118us) write_op.cc:454] Released schema lock
0709 12:25:02.905016 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:02.905553 (+   537us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:02.905585 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5152,"reported_tablets":30,"spinlock_wait_cycles":61815040,"child_traces":[["op",{"apply.queue_time_us":78795,"apply.run_cpu_time_us":3478,"apply.run_wall_time_us":5649,"num_ops":9,"prepare.queue_time_us":374035,"prepare.run_cpu_time_us":39386,"prepare.run_wall_time_us":382905,"raft.queue_time_us":212986,"raft.run_cpu_time_us":24579,"raft.run_wall_time_us":36951,"replication_time_us":532100,"spinlock_wait_cycles":41344,"thread_start_us":640293,"threads_started":4,"wal-append.queue_time_us":232693,"wal-append.run_cpu_time_us":32242,"wal-append.run_wall_time_us":1330059}]]}
I20260709 12:25:07.340385 15423 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:25:07.362471 12556 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:25:07.357774 15928 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260709 12:25:07.366304 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.366920 12554 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:07.365665 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.369982 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.370571 12556 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.349604 15895 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.368788 12455 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 3 to 4, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.363667 15931 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:07.379448 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.383330 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.382678 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.382978 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.386426 12558 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.367698 15740 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.385293 12554 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:25:07.387528 12554 pending_rounds.cc:85] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 8
I20260709 12:25:07.361469 15770 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.387768 12554 pending_rounds.cc:107] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:07.388028 12554 raft_consensus.cc:2889] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:07.383591 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.388717 12552 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
W20260709 12:25:07.389994 15926 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:25:07.396041 12556 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:07.396273 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.394730 15919 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.399123 15919 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.399730 15669 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:07.400424 12558 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:07.380786 12455 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.401892 12707 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:07.403698 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.403565 15669 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:07.408986 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.409787 12701 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:25:07.409880 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 600394us
I20260709 12:25:07.411207 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.405860 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.406404 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1940) took 1217 ms. Trace:
I20260709 12:25:07.405926 12455 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.380906 15931 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:07.412312 12634 rpcz_store.cc:276] 0709 12:25:06.189160 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.190457 (+  1297us) service_pool.cc:224] Handling call
0709 12:25:06.207401 (+ 16944us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.207621 (+   220us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:06.646816 (+439195us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.731789 (+ 84973us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.829391 (+ 97602us) spinlock_profiling.cc:243] Waited 7.38 ms on lock 0x7b18004c71a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:07.405927 (+576536us) spinlock_profiling.cc:243] Waited 3.57 ms on lock 0x7b18004c71a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e91a00a40 00007f0e919fb4e4 00007f0e919fb455 00007f0e94ae3060 00007f0e94af5716 00007f0e94b06287 00007f0e94b06208
0709 12:25:07.406067 (+   140us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.406116 (+    49us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:07.406158 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.406247 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.406353 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":670783,"prepare.queue_time_us":9204,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"raft.queue_time_us":675461,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":3390,"spinlock_wait_cycles":25185792,"thread_start_us":78291,"threads_started":1,"wal-append.queue_time_us":122564}
I20260709 12:25:07.413323 12455 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.423594 12455 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.412324 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.426124 12455 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 3 to 5, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.431342 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.432204 12556 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:07.406324 15799 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.435151 12701 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:07.432693 12455 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:07.397272 15740 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:07.441300 12600 connection.cc:256] RPC call timeout handler was delayed by -1.9821862759999931s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15660000000000002s for a response
W20260709 12:25:07.441740 12600 connection.cc:256] RPC call timeout handler was delayed by -1.9488862759999392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1603s for a response
W20260709 12:25:07.442052 12600 connection.cc:256] RPC call timeout handler was delayed by -1.6869862759999705s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260709 12:25:07.439926 12455 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 5, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.428295 15804 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:07.443861 15931 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:07.444433 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 60620.7us
I20260709 12:25:07.445057 15931 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:07.443387 12455 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.448028 12455 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 6, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 6 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:07.449862 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.451234 15906 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:07.443569 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.453564 15871 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.451746 15906 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.454053 15871 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.456655 15871 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:07.458643 15895 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:07.459969 15919 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.430909 15861 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:07.462584 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50329.5us
I20260709 12:25:07.463268 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.468349 15838 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:07.468680 15929 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:25:07.468948 15838 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:07.469310 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.469521 15838 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.469955 15713 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:07.470790 15713 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:07.471221 15713 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:07.472223 15713 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:07.474565 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.475091 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:07.476264 15713 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.465835 15669 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.478473 15669 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.479523 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:07.480064 15740 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:07.466406 15895 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:07.480979 15895 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.478474 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.482463 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2139) took 2352 ms. Trace:
I20260709 12:25:07.483991 15705 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.482966 12708 rpcz_store.cc:276] 0709 12:25:05.129633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.832761 (+703128us) service_pool.cc:224] Handling call
0709 12:25:05.833067 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.169730 (+336663us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:06.182220 (+ 12490us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.845224 (+663004us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18001eb080. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:25:06.898695 (+ 53471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.898753 (+    58us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:06.900016 (+  1263us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.482169 (+582153us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54000fbed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:07.482235 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.482391 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":12219,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":97,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":10261,"spinlock_wait_cycles":672801920,"thread_start_us":53270,"threads_started":1,"wal-append.queue_time_us":1101297}
I20260709 12:25:07.462112 15804 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:07.485216 15804 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.485854 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.486464 12631 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:25:07.465054 15861 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.489758 15861 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.489873 15893 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:07.490278 15893 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:07.491055 15893 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.492214 15893 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.466799 15902 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:07.493744 15902 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:07.494107 15902 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.501911 12703 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
W20260709 12:25:07.503733 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.504742 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:07.505147 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.505591 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:07.506436 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:07.507279 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:07.464784 12455 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:07.510834 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:07.511412 13231 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:07.511659 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.513363 12708 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:07.513885 15770 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:07.514381 15868 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:07.517073 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.510039 13198 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:07.518198 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.519207 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.519860 15710 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:07.520995 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.521883 12625 raft_consensus.cc:2410] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:07.521942 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.522668 15722 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.523197 15722 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.523280 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.524188 12631 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:07.525928 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.526449 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:07.526561 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.526777 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.526486 12556 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.527645 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:07.528807 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.529726 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.530315 12552 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:07.530552 15705 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.527745 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.531699 12554 raft_consensus.cc:1813] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Handling vote request from an unknown peer c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.532212 12554 raft_consensus.cc:2410] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:25:07.532395 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:07.518353 12455 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 3, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:07.533856 13226 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:07.534978 12556 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:07.535166 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.535878 12708 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:07.538805 12701 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:07.542601 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:07.543205 13226 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.540416 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.549505 15705 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:07.549746 15740 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:07.550475 15897 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:07.551026 15897 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:07.551481 15897 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.555321 15804 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.557950 15804 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.532478 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:07.561159 12600 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.561717 15871 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.564109 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:07.575151 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:07.564764 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54776.7us
I20260709 12:25:07.564584 13231 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:07.566846 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:07.578722 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.571954 13226 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:07.581207 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:07.482987 15895 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.582561 12674 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:07.584823 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:07.586195 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.588201 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:07.576112 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.590006 12700 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:07.585758 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:07.596159 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:07.596858 12699 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:07.592733 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.599773 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.602355 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:07.525348 15722 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:07.612718 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.614292 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.614815 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.574764 15728 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.598564 15619 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:07.599435 15825 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:07.623217 12625 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:07.624264 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.624572 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 871) took 1741 ms. Trace:
I20260709 12:25:07.618266 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:07.574769 15705 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.621848 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.604812 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:07.642349 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.625296 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.624979 13230 rpcz_store.cc:276] 0709 12:25:05.883282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.092971 (+209689us) service_pool.cc:224] Handling call
0709 12:25:06.093273 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.186927 (+ 93654us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:06.469914 (+282987us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.897583 (+427669us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.897751 (+   168us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:06.897800 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:06.897849 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.498900 (+601051us) spinlock_profiling.cc:243] Waited 8.88 ms on lock 0x7b18001be980. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:07.624353 (+125453us) spinlock_profiling.cc:243] Waited 93.4 ms on lock 0x7b54001987d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:07.624401 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.624515 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3062,"prepare.queue_time_us":323099,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":7624,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":1879,"spinlock_wait_cycles":235251584,"thread_start_us":706659,"threads_started":2,"wal-append.queue_time_us":430093}
I20260709 12:25:07.650262 12631 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.631983 12555 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:07.692811 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 71034.3us
I20260709 12:25:07.702615 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.589056 15770 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.597776 15863 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.613198 15895 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:07.701501 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 96761.4us
I20260709 12:25:07.694800 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.706779 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.710192 12559 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 12:25:07.599231 15823 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:07.714458 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.718818 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.720513 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.595415 15651 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:07.729027 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 121758us
I20260709 12:25:07.823715 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.730257 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.824716 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:07.825219 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.715865 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:07.826519 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.826820 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.827441 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.827838 12555 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:07.620672 15496 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:07.629220 15894 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:07.731092 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 143579us
I20260709 12:25:07.613286 15528 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.734457 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.836509 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.836709 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.837400 12557 raft_consensus.cc:2410] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:07.837730 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.838147 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.838266 12558 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.825459 15823 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.838747 12557 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:07.838943 15823 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:07.839576 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.840267 12557 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 4: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.840925 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.698789 15825 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:07.607332 15423 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:07.729899 15828 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:07.859323 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.606698 15888 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:07.776418 12556 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:07.620479 15871 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.867066 15871 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.867489 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.859663 15423 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.628541 15874 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:07.698926 12554 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:07.841686 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.841686 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.842249 12553 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:07.698243 15619 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:07.841377 12557 raft_consensus.cc:2376] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9. Re-sending same reply.
I20260709 12:25:07.898568 12625 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:07.907981 12625 pending_rounds.cc:85] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 7
I20260709 12:25:07.739951 15895 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.731736 15907 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:07.605331 15598 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.133s
I20260709 12:25:07.856161 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.918326 12552 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:07.711660 15705 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.859071 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.861572 15828 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:07.842093 15894 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.922894 15894 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:07.842013 15496 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.864203 15331 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:07.864841 15722 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:07.879460 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.881513 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:07.882452 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.869383 15871 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.883837 12553 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:07.886066 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.896427 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1939) took 1707 ms. Trace:
I20260709 12:25:07.897809 12629 raft_consensus.cc:2410] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 8 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:07.844828 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:07.908378 12625 pending_rounds.cc:107] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:07.847337 12558 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:07.882771 12550 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
W20260709 12:25:07.902837 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.856761 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 140995us
I20260709 12:25:07.878223 15423 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.877499 15804 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:07.938619 15496 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.939383 15828 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.880662 15874 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:07.968149 15874 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.913903 15594 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:25:07.709875 15890 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:07.887427 15861 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.975855 15861 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:07.979830 15734 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:07.980465 15734 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.982600 15705 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:07.916109 15895 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:07.898936 15825 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:07.944188 12554 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:07.944583 12628 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:25:07.945545 12626 rpcz_store.cc:276] 0709 12:25:06.188878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.198537 (+  9659us) service_pool.cc:224] Handling call
0709 12:25:06.198851 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:06.279219 (+ 80368us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:06.461023 (+181804us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.792074 (+331051us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b18001bdc60. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:25:07.429833 (+637759us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.429885 (+    52us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:07.429958 (+    73us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.895608 (+465650us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b18001bdc60. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919cc2a6 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419
0709 12:25:07.896134 (+   526us) spinlock_profiling.cc:243] Waited 80.1 ms on lock 0x7b54002107d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:07.896174 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.896347 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":577073,"prepare.queue_time_us":186234,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":142,"raft.queue_time_us":553392,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":4325,"spinlock_wait_cycles":192669312,"thread_start_us":84194,"threads_started":1,"wal-append.queue_time_us":541490}
I20260709 12:25:07.945932 12625 raft_consensus.cc:2889] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:07.947355 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:25:07.952685 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 174389us
I20260709 12:25:07.943027 12559 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:07.946009 12555 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:07.941679 15722 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:07.962280 15619 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.921522 15906 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:07.984148 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.928809 15897 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:07.994001 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46711.2us
I20260709 12:25:08.011359 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:07.983093 15734 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.004938 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:07.996142 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:07.988297 12631 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:08.013597 15906 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:08.014019 15906 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.014379 15906 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:08.014547 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.017064 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.013161 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:08.018198 15528 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:08.018443 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.019420 12631 raft_consensus.cc:2368] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:08.020314 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.021188 12631 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:07.979887 15770 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:07.995445 15902 consensus_meta.cc:287] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.000s
I20260709 12:25:07.993125 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:08.009156 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.030614 12627 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:25:08.009178 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.031621 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:07.921928 15907 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:07.999975 15722 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:08.046185 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.004637 15496 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:08.028314 15838 consensus_meta.cc:287] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.556s	user 0.009s	sys 0.000s
I20260709 12:25:08.041962 15902 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:08.065270 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 72234.5us
I20260709 12:25:08.066260 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:08.066448 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 242796us
I20260709 12:25:08.067414 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:08.067821 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.068890 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.050794 15907 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.051159 15897 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.058848 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:08.071395 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.071875 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.072966 12630 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:08.075438 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.076206 12630 raft_consensus.cc:2376] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8. Re-sending same reply.
I20260709 12:25:08.063437 12554 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:08.079198 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.079432 13201 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.048513 12627 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:08.080984 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.081712 12631 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:08.083320 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.086987 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.088045 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.088835 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.090327 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.081193 15837 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.093808 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.028556 15861 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:25:08.138811 12554 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:08.138993 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.033360 15770 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.140285 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.081804 15868 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:08.062558 15496 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:08.140481 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 61105.4us
I20260709 12:25:08.069716 15941 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:08.141795 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.129506 15710 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:08.065457 15838 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:08.152146 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.153955 12627 raft_consensus.cc:2376] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7. Re-sending same reply.
I20260709 12:25:08.152570 15942 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.082453 15892 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:08.168758 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.070549 15713 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.087914 15705 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:08.141126 12700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.017s	sys 0.004s
I20260709 12:25:08.144346 15940 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.159420 15728 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.154949 15496 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.159579 15868 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:08.197878 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.198920 13234 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:08.177309 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 157342us
I20260709 12:25:08.093607 15598 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.180457 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.208771 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.178674 15528 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:08.185698 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.221848 15902 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:08.221828 12706 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.221828 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:08.225952 15868 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.230106 12706 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:08.230768 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1889) took 3421 ms. Trace:
I20260709 12:25:08.231055 12706 rpcz_store.cc:276] 0709 12:25:04.809240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:04.809440 (+   200us) service_pool.cc:224] Handling call
0709 12:25:04.813721 (+  4281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.221419 (+3407698us) spinlock_profiling.cc:243] Waited 2.02 s on lock 0x7b5800771bd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aedb49 00007f0e94aee416 00007f0e94aead8f 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4
0709 12:25:08.230502 (+  9083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.230684 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4654644608}
I20260709 12:25:08.231528 15423 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.234174 15770 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.235025 15770 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:08.235574 15770 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.237475 15825 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.241675 15823 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.244051 15823 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:08.244721 15824 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:25:08.245523 15807 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.245791 12557 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:08.245999 15807 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.151499 15894 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.247759 12628 raft_consensus.cc:2368] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:25:08.249780 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.250509 12553 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.251442 15722 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.248831 15894 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:08.150247 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.150771 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:08.260637 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 109928us
W20260709 12:25:08.261538 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.262282 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.263720 12630 raft_consensus.cc:2410] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:08.264760 15768 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.265013 15423 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.265627 15651 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.265923 15770 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.266083 15651 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.268155 15528 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.269239 15722 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.270407 12553 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:08.272181 12522 leader_election.cc:400] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:08.272612 12522 leader_election.cc:403] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:08.275420 15423 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.277930 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:08.282070 12600 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:08.286805 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.287474 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.287874 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.255731 15895 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.071125 15890 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.190703 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:08.191514 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:08.193325 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.304768 13227 raft_consensus.cc:2368] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:08.195480 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:08.183135 12700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.017s	sys 0.004s
I20260709 12:25:08.184248 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.306344 13233 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:08.211468 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.307572 12559 raft_consensus.cc:2376] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6. Re-sending same reply.
I20260709 12:25:08.212175 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:08.212632 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.214022 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:08.214839 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.172027 15906 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.258174 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.259110 12626 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:08.148607 13201 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.092453 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.310896 12556 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:08.285363 15423 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:08.300889 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.301879 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.312294 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.312672 12630 raft_consensus.cc:2393] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:08.294706 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.315989 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:08.317888 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.320149 12627 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:08.322089 12600 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:08.314771 12522 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:08.323688 15907 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:08.324312 15907 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:08.325332 15907 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.329559 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.285562 15722 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.330811 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.332973 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.333034 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:08.330827 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:08.189714 15705 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.337165 12631 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:08.286003 15713 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:08.339346 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.339100 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.341408 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:08.348999 12703 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:08.342497 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 250147us
I20260709 12:25:08.345510 12556 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:08.346856 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.327278 15712 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.317561 15768 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:08.353905 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 205397us
I20260709 12:25:08.360777 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.335563 15871 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:08.358471 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.317699 15770 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:08.333664 15722 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.362196 13227 raft_consensus.cc:2410] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:08.332207 15624 raft_consensus.cc:2764] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:08.347292 15619 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.365692 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.367195 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.289984 15837 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:25:08.368085 13226 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:08.369385 12625 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:25:08.347186 15423 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:08.371711 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:08.356040 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:08.350790 15890 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:08.365388 15712 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:08.355683 15300 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.360945 15919 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:08.409395 15952 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:08.353226 15951 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.381507 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.386687 13230 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:08.410256 15951 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.388564 12706 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.411684 15838 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:08.412555 15951 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.403849 15956 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:25:08.413646 13231 raft_consensus.cc:2368] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:25:08.365223 15713 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.419615 12706 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:08.375370 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.420749 15594 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:08.420872 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 45577.3us
I20260709 12:25:08.421166 15594 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:08.421576 15594 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.422624 15951 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:08.425685 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.426398 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:08.427193 12558 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:08.427256 13227 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:08.427357 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.362116 15823 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:08.428678 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:08.408471 15949 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:08.399644 15871 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:08.429278 15823 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:08.430550 15871 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.426463 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:08.433593 15619 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:08.433998 15619 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.434336 15619 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.434499 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.436928 15821 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:08.437333 15821 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:08.437742 15821 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.386193 15331 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:08.438468 15331 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.375411 15722 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.446638 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.446466 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.453007 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.458423 12522 leader_election.cc:400] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:08.459543 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.451865 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.467900 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.468048 12626 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:08.459120 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:08.471395 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:08.471635 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 131515us
I20260709 12:25:08.406605 15712 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.475776 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.473249 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:08.473515 12703 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:08.447157 15595 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.477881 12625 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:08.478457 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:08.479242 13230 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:25:08.377573 15770 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.479418 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.448066 15607 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.483311 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.484144 15732 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.484309 12597 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:25:08.473994 15950 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:25:08.487535 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:08.465804 15768 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:08.515307 12632 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:08.519814 12630 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:08.531461 12630 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:08.537865 15946 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:08.540208 15946 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:08.541843 15834 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:08.542366 15834 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:08.543497 15834 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.544605 15807 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.527585 15823 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:08.526487 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:08.473886 15624 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:08.549080 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.483052 15598 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.472467 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.578207 12626 raft_consensus.cc:2376] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8. Re-sending same reply.
I20260709 12:25:08.558918 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.576433 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:08.581776 12701 raft_consensus.cc:2368] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:25:08.480510 15931 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.585722 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2157) took 1231 ms. Trace:
I20260709 12:25:08.586304 12702 rpcz_store.cc:276] 0709 12:25:07.353994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.354225 (+   231us) service_pool.cc:224] Handling call
0709 12:25:07.354624 (+   399us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.407665 (+ 53041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.407706 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.408138 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.729302 (+321164us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:07.731210 (+  1908us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.547462 (+816252us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b54000d07d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:08.547516 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.547561 (+    45us) raft_consensus.cc:1685] finished
0709 12:25:08.547579 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.585657 (+ 38078us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1343,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":77,"spinlock_wait_cycles":121110272,"thread_start_us":290504,"threads_started":1,"wal-append.queue_time_us":488489}
I20260709 12:25:08.590831 15740 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.591452 15740 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:08.591908 15740 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.484977 15890 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.549060 15864 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:08.616909 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.557736 15624 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:08.581533 15903 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.589751 15300 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:08.484799 15595 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.631031 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:08.636677 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:08.618243 15864 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:08.643219 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45441.3us
I20260709 12:25:08.633754 15624 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:08.632843 15528 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.598829 15768 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:25:08.636016 15931 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.655175 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.656255 12633 raft_consensus.cc:2376] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8. Re-sending same reply.
W20260709 12:25:08.658063 12633 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1956) took 1676 ms (client timeout 1920 ms). Trace:
I20260709 12:25:08.647894 15864 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:08.658535 12633 rpcz_store.cc:269] 0709 12:25:06.981941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.646410 (+1664469us) service_pool.cc:224] Handling call
0709 12:25:08.657988 (+ 11578us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:08.635939 15919 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:25:08.668555 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2164) took 1066 ms. Trace:
I20260709 12:25:08.669035 12704 rpcz_store.cc:276] 0709 12:25:07.601994 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.710150 (+108156us) service_pool.cc:224] Handling call
0709 12:25:07.823696 (+113546us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.836882 (+ 13186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.836913 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.836956 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:07.836988 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.668330 (+831342us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400129654. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:08.668374 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.668493 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29833088}
I20260709 12:25:08.671494 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.638038 15496 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.709969 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:08.656904 15705 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.756899 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.757074 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.755659 12627 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:25:08.760624 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1918) took 1223 ms. Trace:
I20260709 12:25:08.771751 12708 rpcz_store.cc:276] 0709 12:25:07.536756 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.536889 (+   133us) service_pool.cc:224] Handling call
0709 12:25:07.623952 (+ 87063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.624312 (+   360us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:07.730940 (+106628us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.197668 (+466728us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.216022 (+ 18354us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.216194 (+   172us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:08.216464 (+   270us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.340831 (+124367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.341928 (+  1097us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.431020 (+ 89092us) raft_consensus.cc:1685] finished
0709 12:25:08.431038 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.760370 (+329332us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b54003eadd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:08.760546 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":236410,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":70625,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":265,"spinlock_wait_cycles":199553280,"thread_start_us":575133,"threads_started":3,"wal-append.queue_time_us":433682}
I20260709 12:25:08.775018 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.669080 15331 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:08.778385 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.756901 15931 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:08.784785 15931 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:08.785449 15669 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.785826 15931 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.789778 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.656693 15528 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.798661 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:08.799324 12633 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.799576 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.783625 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.802008 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.802790 12631 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:08.804134 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.804934 12631 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:08.808192 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.810680 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:08.820468 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 352578us
I20260709 12:25:08.822118 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.822947 12631 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:08.829499 12522 leader_election.cc:400] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
I20260709 12:25:08.830837 12522 leader_election.cc:403] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:08.830916 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 194337us
W20260709 12:25:08.831158 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.833387 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 195512us
I20260709 12:25:08.801651 15978 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:08.829895 15960 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:25:08.819331 15770 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.849710 15991 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:08.852475 15595 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:08.855659 15969 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:25:08.860102 12633 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:08.862624 12633 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: [7.4-7.4]
I20260709 12:25:08.863516 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1976) took 1031 ms. Trace:
I20260709 12:25:08.872617 12628 rpcz_store.cc:276] 0709 12:25:07.832336 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.005857 (+173521us) service_pool.cc:224] Handling call
0709 12:25:08.863335 (+857478us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540012f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:08.863458 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":497910400}
I20260709 12:25:08.874789 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:08.832656 15594 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:08.861857 15940 consensus_meta.cc:287] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.646s	user 0.003s	sys 0.008s
I20260709 12:25:08.882308 15423 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7.
W20260709 12:25:08.885885 15970 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.091s	user 0.000s	sys 0.001s
I20260709 12:25:08.877767 15770 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:08.892297 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.892800 15770 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:08.894423 15976 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:25:08.894948 15770 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.841462 15919 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:25:08.897662 15669 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.899339 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:08.901901 15594 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.902590 13228 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:08.903370 15940 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.903569 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.904055 13233 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:08.907466 15496 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:08.873741 15975 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
W20260709 12:25:08.909816 15967 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:25:08.911430 12634 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:08.911399 15722 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.912178 15710 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.912688 15710 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:08.914146 15528 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:08.914592 15651 consensus_meta.cc:287] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.001s
W20260709 12:25:08.918151 15948 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.563s	user 0.003s	sys 0.000s
I20260709 12:25:08.918432 15821 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.919816 13235 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:08.920352 15962 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.532s	user 0.000s	sys 0.001s
I20260709 12:25:08.921682 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 627) took 1326 ms. Trace:
I20260709 12:25:08.922087 12700 rpcz_store.cc:276] 0709 12:25:07.595760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.602598 (+  6838us) service_pool.cc:224] Handling call
0709 12:25:07.605618 (+  3020us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.605958 (+   340us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.605986 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.606407 (+   421us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.306218 (+699811us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:08.306274 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.306364 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.917580 (+611216us) spinlock_profiling.cc:243] Waited 9.39 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:08.921367 (+  3787us) raft_consensus.cc:1685] finished
0709 12:25:08.921391 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.921620 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21220,"raft.queue_time_us":105,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":16247,"spinlock_wait_cycles":21590272,"thread_start_us":678492,"threads_started":1,"wal-append.queue_time_us":637654}
I20260709 12:25:08.923333 12628 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:08.926856 15906 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:08.842229 15978 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.905246 12626 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 5. (term mismatch)
I20260709 12:25:08.940138 12626 pending_rounds.cc:85] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 4
I20260709 12:25:08.940399 12626 pending_rounds.cc:107] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 5.5
I20260709 12:25:08.940655 12626 raft_consensus.cc:2889] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:08.934603 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.946983 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.935945 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:08.950054 13235 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.938254 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:08.955427 12626 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:08.961239 12671 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.963438 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:08.966759 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:08.967319 15770 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.953958 15528 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:08.990908 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:09.001914 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:09.002422 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:09.025779 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 59089.2us
I20260709 12:25:09.026754 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:08.985446 15619 consensus_meta.cc:287] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.000s
I20260709 12:25:08.965160 15907 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:08.963795 15906 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.032048 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1998) took 1067 ms. Trace:
I20260709 12:25:08.949429 15651 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:08.986914 15722 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:08.984059 15705 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:08.983978 15961 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:08.978751 15821 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:08.983340 15978 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.039542 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2001) took 1072 ms. Trace:
I20260709 12:25:08.956115 15496 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:25:08.975682 15624 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.021268 15734 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.049566 12627 rpcz_store.cc:276] 0709 12:25:07.967740 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.830631 (+862891us) service_pool.cc:224] Handling call
0709 12:25:08.830977 (+   346us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.831372 (+   395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.831403 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.831830 (+   427us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.877327 (+ 45497us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:08.877379 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.877487 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.039341 (+161854us) raft_consensus.cc:1685] finished
0709 12:25:09.039363 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.039486 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":84,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":4691,"thread_start_us":15634,"threads_started":1,"wal-append.queue_time_us":136834}
I20260709 12:25:09.054116 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:09.054754 12627 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:09.055683 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:09.043020 12632 rpcz_store.cc:276] 0709 12:25:07.965026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.551679 (+586653us) service_pool.cc:224] Handling call
0709 12:25:08.559372 (+  7693us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.616398 (+ 57026us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.616444 (+    46us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.625505 (+  9061us) log.cc:844] Serialized 26 byte log entry
0709 12:25:08.866192 (+240687us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:08.866842 (+   650us) log.cc:844] Serialized 14 byte log entry
0709 12:25:08.867400 (+   558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.867492 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.031836 (+164344us) raft_consensus.cc:1685] finished
0709 12:25:09.031854 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.031986 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":56513,"prepare.queue_time_us":166,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":62832,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":108,"spinlock_wait_cycles":10712832,"thread_start_us":214802,"threads_started":1,"wal-append.queue_time_us":334848}
I20260709 12:25:09.051864 13232 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:25:09.052703 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 221044us
I20260709 12:25:09.061257 13235 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:09.037977 15770 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:09.063572 12627 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:09.064250 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.068041 12632 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.065198 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:09.050879 15961 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:09.075954 13235 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:09.033772 15619 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.036491 15740 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.079150 15864 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.091758 15864 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:09.092537 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:09.095232 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2000) took 1128 ms. Trace:
I20260709 12:25:09.098992 15651 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.079885 15961 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.079113 15496 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:09.106243 15496 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:09.107503 15496 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.095804 12631 rpcz_store.cc:276] 0709 12:25:07.966850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.823764 (+856914us) service_pool.cc:224] Handling call
0709 12:25:08.824136 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.824535 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.824577 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:08.825150 (+   573us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.008142 (+182992us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:09.008209 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.008316 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:09.094928 (+ 86612us) raft_consensus.cc:1685] finished
0709 12:25:09.094956 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.095137 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":182454,"threads_started":1,"wal-append.queue_time_us":250507}
I20260709 12:25:09.110582 12627 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
W20260709 12:25:09.111806 15712 consensus_meta.cc:287] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.627s	user 0.012s	sys 0.000s
I20260709 12:25:09.112550 15712 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.119632 12632 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:09.052402 15705 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.120952 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:09.123325 13229 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:09.123675 13235 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:09.140312 13235 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:09.145226 12597 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:09.122097 15624 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:09.087641 15898 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260709 12:25:09.147806 15864 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:09.159215 15864 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:09.168489 15864 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.166471 15740 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.169819 15705 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.174654 15619 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.176460 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:09.177099 12699 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:09.173761 15895 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.187033 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:09.195919 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.197158 15907 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:09.197683 15907 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.198031 15907 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:09.200502 12629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 1964) took 1964 ms (client timeout 1502 ms). Trace:
W20260709 12:25:09.200927 12629 rpcz_store.cc:269] 0709 12:25:07.236317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.479218 (+242901us) service_pool.cc:224] Handling call
0709 12:25:09.200256 (+1721038us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b5400212fd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:09.200431 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":959209344}
I20260709 12:25:09.201396 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 769) took 1230 ms. Trace:
I20260709 12:25:09.202193 12630 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260709 12:25:09.202591 12630 pending_rounds.cc:85] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 5
I20260709 12:25:09.202828 12630 pending_rounds.cc:107] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 7.6
I20260709 12:25:09.203058 12630 raft_consensus.cc:2889] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:09.201838 12628 rpcz_store.cc:276] 0709 12:25:07.971311 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.873364 (+902053us) service_pool.cc:224] Handling call
0709 12:25:08.878324 (+  4960us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:08.923827 (+ 45503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.201150 (+277323us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b540025d0d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:09.201340 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":102825856}
I20260709 12:25:09.205330 12699 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:09.206733 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:09.207638 15942 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:09.208267 15942 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:09.209312 15942 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.213898 15712 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.204084 15770 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:09.231313 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46740.3us
I20260709 12:25:09.238971 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.240348 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:09.230616 15834 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:09.243371 15966 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.760s	user 0.003s	sys 0.000s
I20260709 12:25:09.248842 12631 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:09.245918 15734 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.252698 15734 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:09.278787 15734 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.281137 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 812) took 1088 ms. Trace:
I20260709 12:25:09.281622 13232 rpcz_store.cc:276] 0709 12:25:08.192394 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.193011 (+   617us) service_pool.cc:224] Handling call
0709 12:25:09.280911 (+1087900us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540064fad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:09.281071 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1710835584}
W20260709 12:25:09.282652 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.283253 15907 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.285761 13234 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:09.288005 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 1996) took 1325 ms. Trace:
I20260709 12:25:09.288343 12630 rpcz_store.cc:276] 0709 12:25:07.963299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.534891 (+571592us) service_pool.cc:224] Handling call
0709 12:25:09.201809 (+666918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.203569 (+  1760us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.287826 (+ 84257us) spinlock_profiling.cc:243] Waited 666 ms on lock 0x7b5400212fd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:09.287951 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1532816128}
I20260709 12:25:09.298358 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.299886 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:09.300400 15722 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:09.300827 15722 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:09.303366 12628 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:09.304051 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.305610 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:09.305822 13228 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:09.310870 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.312251 12628 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.311010 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.310240 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:09.314407 13228 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.251984 15770 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.319123 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.319814 13198 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:09.327610 13228 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:09.309224 15907 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.329391 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.333165 15710 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.329277 15728 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.344154 15728 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.316128 15863 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:25:09.322108 15804 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 12:25:09.348690 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.349110 15804 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:09.349658 15804 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:09.334318 15951 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:09.324414 15821 consensus_queue.cc:1059] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:09.351266 15804 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.317605 15496 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:25:09.374926 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.375525 15496 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:09.375938 15496 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:09.355520 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.362419 15961 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.322765 15722 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.404554 15863 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:09.394654 12628 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:09.405911 15861 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:09.426702 15863 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.426473 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:09.420914 15496 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.452881 15496 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.455019 15897 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.472311 15897 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:09.429834 16009 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:25:09.490015 15954 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:09.492664 15954 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.493396 15961 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.494990 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.500947 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.437958 15861 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.545770 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:09.546180 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.546615 12699 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:25:09.547657 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 227957us
I20260709 12:25:09.545771 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.554500 13228 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:09.555140 13228 pending_rounds.cc:85] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 6
I20260709 12:25:09.555495 13228 pending_rounds.cc:107] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:09.555792 13228 raft_consensus.cc:2889] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:09.555725 15728 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.567274 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.571636 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:09.478890 15888 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.540s	user 0.011s	sys 0.042s
I20260709 12:25:09.578698 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.570850 15804 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:09.572513 15722 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:09.580113 13232 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:09.582886 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.473193 15897 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.581369 13228 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:09.586544 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:09.584102 15888 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.642s	user 0.011s	sys 0.043s
I20260709 12:25:09.591938 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.596871 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.590914 12600 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:09.596136 13228 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:09.577931 15824 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.581315 15734 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.583938 15961 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.590001 15907 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.599537 15895 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.601660 15898 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:09.587634 15728 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.600121 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.623102 13230 raft_consensus.cc:1240] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:09.625186 15981 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.626833 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.628242 15861 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:09.596700 15528 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.629710 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:09.708354 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 107903us
I20260709 12:25:09.630424 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:09.631816 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 565517us
W20260709 12:25:09.709908 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 109914us
I20260709 12:25:09.631911 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.632577 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.637612 15768 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.638005 15954 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.638258 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.715657 12556 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.638890 12555 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:25:09.715893 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 83381.6us
I20260709 12:25:09.639678 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.639948 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.584760 15903 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:25:09.640760 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.719373 12551 raft_consensus.cc:2410] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
W20260709 12:25:09.640986 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.642058 12559 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:09.642793 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:09.722221 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.723060 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.723132 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.723472 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.723635 12550 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.644865 12553 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:09.724524 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.677520 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:09.725257 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.688181 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 763) took 1803 ms. Trace:
I20260709 12:25:09.725162 12626 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:09.725839 12553 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:09.696975 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.697635 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:09.726432 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:09.727226 12626 raft_consensus.cc:2368] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:09.727147 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.706817 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.711323 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.725888 12625 rpcz_store.cc:276] 0709 12:25:07.884719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.481817 (+597098us) service_pool.cc:224] Handling call
0709 12:25:08.670464 (+188647us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.670660 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:08.670683 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:08.670735 (+    52us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:08.670765 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.670821 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.687945 (+1017124us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54003430d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:09.688101 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":433089920}
I20260709 12:25:09.714154 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:09.716604 12522 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:09.731503 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.732652 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.734124 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:09.735355 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.736310 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.724064 12555 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:09.738281 12558 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:09.728672 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:09.741269 12558 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:09.742528 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.742969 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.743561 12556 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:09.737167 12553 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:09.713126 15821 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.746886 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.747112 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.748332 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:09.712682 15998 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.000s	sys 0.022s
I20260709 12:25:09.696770 15710 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:09.718626 15712 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.750532 12559 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:09.713330 15907 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.751880 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.750128 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.729924 15898 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:09.730176 15895 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:09.740731 15770 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.741844 15954 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.713274 15981 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.763293 12557 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.781934 15981 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:09.750952 15903 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.718427 15768 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.719084 15624 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:09.783639 15624 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:09.784077 15624 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:09.784718 15768 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:09.757579 15998 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.000s	sys 0.023s
I20260709 12:25:09.709861 15728 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.753031 15919 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:09.751487 15991 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:09.755883 15989 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.754844 15821 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.756788 15734 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:09.785102 15624 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.799014 15624 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.773658 15710 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 23740bafdb794232879a0bb6884f7a68 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:09.762557 16002 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.775557 15644 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.779199 15982 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:09.772500 15895 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:09.756599 15528 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:09.779897 15651 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:09.762647 15496 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:09.757133 15331 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:09.801927 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:09.762646 15961 consensus_queue.cc:1059] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:25:09.805881 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:09.807247 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.791232 15991 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:09.852568 15991 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:09.853462 12557 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:09.854818 12557 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:09.858433 15528 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:09.858798 15728 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.858978 15528 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.859651 15331 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:09.861063 12632 raft_consensus.cc:2410] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 12:25:09.861387 15824 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:09.813797 12558 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:09.862227 12556 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:09.813297 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 65148.3us
I20260709 12:25:09.863101 15824 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.841550 15651 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.863678 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:09.829248 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 115158us
I20260709 12:25:09.841949 12626 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:09.849072 12552 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:09.851254 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:09.860863 15331 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.844079 15903 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:09.917632 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66449.8us
I20260709 12:25:09.866832 12558 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:09.924841 12558 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:09.878358 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 72589us
I20260709 12:25:09.824498 12633 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:09.865265 12522 leader_election.cc:400] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:25:09.927057 12522 leader_election.cc:403] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:09.928081 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:09.937448 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:09.938408 12626 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:09.865299 15824 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:09.929128 12558 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.945842 12558 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:09.936873 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 71747us
I20260709 12:25:09.922833 12550 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
W20260709 12:25:09.883301 16017 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:25:09.843894 15907 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:09.949112 12554 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:09.949524 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 188090us
I20260709 12:25:09.949429 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:09.868765 15624 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.082s
W20260709 12:25:09.951000 16022 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:25:09.957685 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.865594 16002 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:09.958998 12523 leader_election.cc:400] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:25:09.960526 12674 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:09.878693 15594 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:09.915309 15799 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.865923 15651 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.867946 15821 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:09.943646 15806 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:10.020273 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.871763 15895 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.944777 15941 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.023926 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:09.935523 15644 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.087s
I20260709 12:25:09.951356 15965 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:25:09.975419 15734 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:10.021091 15594 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.024595 15770 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.964116 15907 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:09.975772 15712 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:25:09.956445 15989 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8.
I20260709 12:25:10.029690 15651 consensus_queue.cc:1059] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:09.963366 16002 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:09.943115 15903 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:09.959347 15888 consensus_queue.cc:1059] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.082s
I20260709 12:25:09.843916 15898 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.039242 12558 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:09.962981 15824 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:09.953873 15496 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.099s
I20260709 12:25:10.051028 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 899) took 1498 ms. Trace:
I20260709 12:25:10.060524 13230 rpcz_store.cc:276] 0709 12:25:08.552713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.552852 (+   139us) service_pool.cc:224] Handling call
0709 12:25:08.595911 (+ 43059us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.702642 (+1106731us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.050796 (+348154us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54006be9d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:10.050970 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361791232}
I20260709 12:25:10.037376 15895 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:10.056142 12634 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2306) took 2538 ms (client timeout 3070 ms). Trace:
I20260709 12:25:10.058437 12558 pending_rounds.cc:85] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 6
W20260709 12:25:10.067751 12634 rpcz_store.cc:269] 0709 12:25:07.517566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.517908 (+   342us) service_pool.cc:224] Handling call
0709 12:25:10.055950 (+2538042us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b5400213ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:10.056057 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3202221440}
I20260709 12:25:10.036494 15961 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:10.068349 12558 pending_rounds.cc:107] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 6.7
W20260709 12:25:10.100116 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 145509us
I20260709 12:25:10.044590 15594 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:10.049587 16013 raft_consensus.cc:3055] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:10.055356 15906 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:10.101254 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:10.065738 15300 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:10.120702 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:10.056656 15907 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.053613 16002 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.122627 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2314) took 1513 ms. Trace:
I20260709 12:25:10.123131 12627 rpcz_store.cc:276] 0709 12:25:08.609335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.067272 (+457937us) service_pool.cc:224] Handling call
0709 12:25:09.067552 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.111134 (+ 43582us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.122350 (+1011216us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b5400210cd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:10.122552 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98434304}
I20260709 12:25:10.069555 12558 raft_consensus.cc:2889] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:10.055375 15903 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:10.048785 15528 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:10.119638 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2327) took 1293 ms. Trace:
I20260709 12:25:10.113233 15991 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.050004 15989 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:25:10.159708 12631 rpcz_store.cc:276] 0709 12:25:08.826421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.109808 (+283387us) service_pool.cc:224] Handling call
0709 12:25:09.110197 (+   389us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.249286 (+139089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.119380 (+870094us) spinlock_profiling.cc:243] Waited 138 ms on lock 0x7b54003453d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:10.119570 (+   190us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318411008}
W20260709 12:25:10.160095 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 200355us
I20260709 12:25:10.040534 15941 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:10.164999 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 199182us
I20260709 12:25:10.115954 16013 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:10.120437 15300 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.172557 12553 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:10.107172 15961 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.109797 15770 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:25:10.159580 15907 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.181476 16043 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:10.182166 16043 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.182715 15941 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.183189 15991 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.183061 16043 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.183771 15300 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.184823 15300 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:10.174978 15993 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:10.188624 15931 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:10.188997 15931 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:10.169250 15644 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:25:10.189775 15931 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.190977 15931 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.191991 16035 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:10.192540 16035 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.194809 16035 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.198091 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:10.181627 15907 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.199987 16002 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.200592 13233 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 816) took 1867 ms. Trace:
I20260709 12:25:10.202564 13233 rpcz_store.cc:276] 0709 12:25:08.333935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.334847 (+   912us) service_pool.cc:224] Handling call
0709 12:25:08.335187 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.905120 (+569933us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.199989 (+1294869us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b540048a8d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:10.200534 (+   545us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1307900672}
I20260709 12:25:10.203423 15961 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.203890 16002 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.166087 15906 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:10.204481 16002 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:10.204840 16002 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:10.196880 16013 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.233927 13227 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:10.234157 16013 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.200908 15981 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:10.201846 15644 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.202176 12522 leader_election.cc:400] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:10.237845 12522 leader_election.cc:403] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:10.238528 15644 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.239087 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:10.240154 13231 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:10.205868 16002 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.241902 15624 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:10.214562 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.243371 12706 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:10.215268 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.244339 12700 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:10.244555 12632 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:10.176311 15496 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.219743 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.245877 12705 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:10.204826 15906 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.200986 15907 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:10.224527 15839 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.229451 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:10.262154 12627 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:10.262565 12625 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:10.231393 12598 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:10.263662 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:10.231752 15594 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.238443 13227 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:10.267346 12632 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:10.213954 12702 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:10.210319 15871 consensus_queue.cc:1059] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:10.270035 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:10.271776 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:10.272481 12634 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:10.266407 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 220240us
I20260709 12:25:10.277133 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:10.250078 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.261139 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:10.283317 12631 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:10.243006 15946 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:10.256327 15989 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.286541 13199 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:10.267114 15965 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.298182 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:10.267712 15839 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:10.305303 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.304982 15941 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:10.305830 15941 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.306298 15941 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.307403 15839 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:10.313884 16004 log.cc:927] Time spent T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 1.164s	user 0.000s	sys 0.014s
I20260709 12:25:10.315073 15941 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.317130 15902 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:10.319409 16018 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:10.326610 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:10.328466 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:10.346454 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66132.9us
I20260709 12:25:10.296655 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:10.289290 12634 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:10.319859 16018 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.261708 15496 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.319666 15902 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:10.386543 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:10.395498 13227 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:10.335146 15834 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:10.397148 15834 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.397641 15834 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.317170 15942 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.082s
I20260709 12:25:10.403077 15496 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.404949 15644 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9.
I20260709 12:25:10.405501 15710 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:10.405543 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 58150.4us
I20260709 12:25:10.406603 15941 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.407701 15728 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:10.408293 15906 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.408520 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.386758 15799 raft_consensus.cc:3055] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:10.322003 15989 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.409657 15799 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:10.410569 15799 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.411171 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.411551 15989 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.411788 15799 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:10.380885 16044 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:10.391191 15770 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:10.413118 15902 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.416280 15834 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.419845 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:10.389467 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 92942.6us
I20260709 12:25:10.396273 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:10.396660 13235 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:10.422181 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:10.422797 12700 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.437103 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:10.444864 16044 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:25:10.394749 15868 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 12:25:10.446939 13227 raft_consensus.cc:1240] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:10.449811 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:10.459267 15770 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:10.459908 15770 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:10.421301 15710 consensus_queue.cc:1175] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "23740bafdb794232879a0bb6884f7a68" responder_term: 8 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:10.488732 16002 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:10.392979 16018 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.490985 15806 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.491616 15806 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.435110 15902 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.445225 15864 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.493772 15864 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.494556 15594 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.495954 15864 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.438953 15823 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.498023 15823 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.500025 15823 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:10.501377 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.506841 12559 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260709 12:25:10.506775 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 57065.4us
I20260709 12:25:10.509541 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.510157 12706 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:10.512419 12706 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:10.514760 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.515436 12701 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:10.515740 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.516602 12708 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:10.513375 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.518792 12706 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:25:10.518882 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.521872 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:10.524075 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 393314us
I20260709 12:25:10.524784 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.511417 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.527362 12699 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:10.528411 12701 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:10.537117 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:10.529486 13198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.009s	sys 0.033s
W20260709 12:25:10.538411 13198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.009s	sys 0.033s
W20260709 12:25:10.538792 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 594886us
I20260709 12:25:10.540042 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:10.498044 15861 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.568162 15861 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:10.568681 15965 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:10.569607 15863 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.534526 15868 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.562251 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:10.570801 15740 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:10.570498 15868 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.571386 15740 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.451957 15906 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.110s
I20260709 12:25:10.572302 15740 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.573658 15868 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:10.577559 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.578435 12701 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:10.579587 12700 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:10.527314 16054 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:10.460866 15770 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.580996 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:10.581743 15983 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:10.582252 15983 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.583074 15983 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.583774 15806 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.584748 16043 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:10.585482 16043 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.586762 16043 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.512135 15496 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.588032 15496 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:10.588373 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48413.2us
I20260709 12:25:10.548231 15594 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:10.589874 15594 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.590332 15594 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:10.594982 15942 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:10.597798 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.598850 12703 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:10.602233 16018 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.562676 15864 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:25:10.606171 15864 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 23740bafdb794232879a0bb6884f7a68 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:10.607687 15861 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.607986 15942 consensus_queue.cc:1059] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:10.609091 15861 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.613850 15951 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:10.632114 15951 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:10.647595 15834 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:10.644834 15496 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:10.651473 15331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.003s	sys 0.026s
I20260709 12:25:10.768584 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.771065 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.772269 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.777382 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:10.778270 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:10.778749 12625 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.000s	sys 0.028s
W20260709 12:25:10.779397 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.779702 12629 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:10.613574 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 453309us
I20260709 12:25:10.792788 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.793069 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.796995 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:10.798713 12632 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:10.798894 12554 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:10.807392 12553 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:10.808375 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.822606 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:10.669674 15951 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:10.875267 12625 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.000s	sys 0.029s
I20260709 12:25:10.879801 12554 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:10.896916 12703 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:10.901780 12701 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:10.905637 16059 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.906787 16059 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:10.909588 12633 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.921909 12700 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:10.922466 12554 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.924103 12554 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:10.927234 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 150418us
I20260709 12:25:10.930199 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.930707 15965 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:10.931218 15965 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.931653 15965 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.934208 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.935595 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.936196 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:10.898866 15331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.004s	sys 0.026s
I20260709 12:25:10.939174 15331 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:10.943131 15898 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:10.946548 15906 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.947679 15906 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.954195 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.955264 12553 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:10.931597 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:10.937141 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:10.976389 12600 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:10.976517 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:10.977834 15710 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:10.978319 15710 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.978364 12552 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:10.978798 15710 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.982362 15770 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:10.983130 15770 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:10.988090 13230 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:25:10.988481 13230 pending_rounds.cc:85] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 6
I20260709 12:25:10.988775 13230 pending_rounds.cc:107] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:25:10.989028 13230 raft_consensus.cc:2889] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:11.000670 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 61637.9us
I20260709 12:25:11.002774 12556 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:11.024036 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:11.025156 12625 raft_consensus.cc:2410] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260709 12:25:11.038378 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 79081.5us
I20260709 12:25:11.039534 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:11.042973 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:11.043836 13227 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:11.046940 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 786) took 1419 ms. Trace:
I20260709 12:25:11.047349 12629 rpcz_store.cc:276] 0709 12:25:09.627102 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.709859 (+ 82757us) service_pool.cc:224] Handling call
0709 12:25:09.710117 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.873638 (+1163521us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.004645 (+131007us) spinlock_profiling.cc:243] Waited 80.5 ms on lock 0x7b54003019a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a62dc0 00007f0e94aeea02 00007f0e94aeadd6 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:25:11.046626 (+ 41981us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540021f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:11.046860 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643161216}
I20260709 12:25:11.058094 16059 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:11.058984 16055 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:11.059513 16055 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:11.066473 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:11.067544 12700 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.074743 15951 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.078651 15496 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.079167 15496 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:11.079581 15496 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.081609 15898 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:11.082494 15898 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.087765 15898 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.060683 16055 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.090512 16055 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.109931 12550 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:11.110185 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.106775 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:11.121431 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 64826.8us
I20260709 12:25:11.103561 15770 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:11.132186 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 77809.6us
W20260709 12:25:11.132964 12634 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.025s
I20260709 12:25:11.148728 12554 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
W20260709 12:25:11.150137 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.150974 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.149503 12554 pending_rounds.cc:85] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
I20260709 12:25:11.156420 12554 pending_rounds.cc:107] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:11.156896 12554 raft_consensus.cc:2889] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.158099 15868 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:11.158587 15868 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:11.158983 15868 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.151499 16045 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:11.175590 15864 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.176441 15864 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:11.182699 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.183216 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.169992 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:11.184024 15799 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:11.192814 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 85583.1us
I20260709 12:25:11.192939 15799 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.194061 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:11.195670 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 154222us
I20260709 12:25:11.195806 15799 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:11.197515 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:11.198969 16063 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:11.200989 15958 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:25:11.202406 13231 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:11.203685 15888 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:11.206624 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:11.208067 15594 consensus_meta.cc:287] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.617s	user 0.015s	sys 0.005s
I20260709 12:25:11.208309 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:11.208606 15594 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.209208 13226 raft_consensus.cc:2368] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:11.210110 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:11.213445 16054 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
W20260709 12:25:11.215045 16068 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:11.215796 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:11.217139 12631 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:11.218088 15864 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.218837 13230 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:11.220021 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:11.221606 15898 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.222779 15799 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.232267 12631 pending_rounds.cc:85] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 6
I20260709 12:25:11.171960 15906 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:11.222061 15594 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.234665 12631 pending_rounds.cc:107] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:11.259827 12631 raft_consensus.cc:2889] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.269533 15768 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:11.270355 15768 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.274175 15768 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:11.205088 15888 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:11.238420 12629 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:25:11.238711 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:10.197914 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.245570 15799 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:11.249583 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45242.8us
I20260709 12:25:11.249544 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:11.251619 12454 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 6 to 7, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:11.229689 16045 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.255208 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 221) took 8529 ms. Trace:
W20260709 12:25:11.284861 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48549.3us
I20260709 12:25:11.257329 15496 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.295414 12633 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:11.278415 15888 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:11.307750 15981 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:11.308252 15981 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.308665 15981 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.308964 15982 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:11.309743 15982 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.288146 15768 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:11.311494 15768 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.311928 15982 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:11.314467 16045 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.291514 15898 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:11.319268 13198 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:11.323988 15768 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:11.351200 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:11.327196 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:25:11.352883 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.343935 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 204699us
I20260709 12:25:11.353932 13232 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:11.329041 15951 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:25:11.365120 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 145196us
I20260709 12:25:11.315802 15710 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.368669 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:11.371409 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:11.376572 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:11.377378 12703 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.378439 15982 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:11.380308 15946 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:25:11.380709 16002 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:25:11.381968 16079 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 12:25:11.285931 12455 rpcz_store.cc:276] 0709 12:25:02.729387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.743226 (+ 13839us) service_pool.cc:224] Handling call
0709 12:25:11.254930 (+8511704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:08.054103 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:08.054855 (+   752us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:08.054910 (+    55us) write_op.cc:435] Acquired schema lock
0709 12:25:08.054945 (+    35us) tablet.cc:662] Decoding operations
0709 12:25:08.057002 (+  2057us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:08.057078 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:08.057119 (+    41us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:25:08.254461 (+197342us) tablet.cc:701] Row locks acquired
0709 12:25:08.254478 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:08.254628 (+   150us) write_op.cc:270] Start()
0709 12:25:08.254744 (+   116us) write_op.cc:276] Timestamp: P: 1783599908254580 usec, L: 0
0709 12:25:08.254762 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:25:08.347587 (+ 92825us) log.cc:844] Serialized 6936 byte log entry
0709 12:25:09.081859 (+734272us) op_driver.cc:464] REPLICATION: finished
0709 12:25:09.619361 (+537502us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e919e10ac 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e98521ef0
0709 12:25:09.864196 (+244835us) write_op.cc:301] APPLY: starting
0709 12:25:09.864295 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:09.864642 (+   347us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:09.864663 (+    21us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:09.866502 (+  1839us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:09.866777 (+   275us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=18
0709 12:25:09.866825 (+    48us) write_op.cc:312] APPLY: finished
0709 12:25:09.867177 (+   352us) log.cc:844] Serialized 125 byte log entry
0709 12:25:09.867342 (+   165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:09.867506 (+   164us) write_op.cc:454] Released schema lock
0709 12:25:09.867566 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:09.867980 (+   414us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:09.868011 (+    31us) write_op.cc:454] Released schema lock
0709 12:25:10.492165 (+624154us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94ae832a 00007f0e94a6df14 00007f0e94a6dec3 00007f0e94a6de38 00007f0e94a6ddf3 00007f0e94a6d0dc 00007f0e94a96e16 00007f0e94a7ecbb 00007f0e94a6939d 00007f0e94a6cd75
Metrics: {"mutex_wait_us":2288465,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":751833,"apply.run_cpu_time_us":3787,"apply.run_wall_time_us":19981,"num_ops":18,"prepare.queue_time_us":212273,"prepare.run_cpu_time_us":104713,"prepare.run_wall_time_us":571896,"raft.queue_time_us":191190,"raft.run_cpu_time_us":40409,"raft.run_wall_time_us":1442487,"replication_time_us":812132,"spinlock_wait_cycles":7959168,"thread_start_us":1149408,"threads_started":4,"wal-append.queue_time_us":295991,"wal-append.run_cpu_time_us":20376,"wal-append.run_wall_time_us":2242421}]]}
I20260709 12:25:11.384119 15993 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:11.385442 16056 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:11.386269 16056 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.387599 12559 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 2.
I20260709 12:25:11.391211 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:11.403666 12703 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:11.368467 15951 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:11.403191 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 72311.5us
I20260709 12:25:11.400967 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:11.350081 15898 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:25:11.408757 15624 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.404754 12454 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 6 to 7, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 7 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:11.402958 15799 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.400489 16054 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.407862 15951 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:11.423728 12556 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:11.412407 15861 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.767s	user 0.005s	sys 0.014s
I20260709 12:25:11.411662 15768 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:11.446910 12700 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:11.451483 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:11.453903 15834 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:11.454605 15834 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:11.455756 15834 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 7.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.450971 15331 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.459229 15331 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.461516 12551 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:11.461848 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:11.462850 12556 raft_consensus.cc:2410] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:11.464143 15331 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:11.466451 15710 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.467151 15710 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:11.468144 15496 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:11.433492 15902 consensus_meta.cc:287] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.826s	user 0.003s	sys 0.014s
I20260709 12:25:11.469820 16056 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:11.438200 15768 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:11.469254 15951 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.471289 15768 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.477537 12555 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:11.478529 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:11.479310 12706 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
W20260709 12:25:11.480105 15965 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.000s
I20260709 12:25:11.434701 15799 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.480728 15965 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.490496 15951 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:11.560535 12454 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 4 to 7, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:11.621799 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 434953us
I20260709 12:25:11.462854 16054 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.483286 15624 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.619211 15799 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.648268 12454 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:11.625507 15868 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:11.663822 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 262283us
I20260709 12:25:11.652736 12597 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:11.638996 15496 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:11.695796 12631 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:11.699199 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 321552us
W20260709 12:25:11.711562 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 58898.5us
I20260709 12:25:11.666030 15898 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.720633 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 401965us
I20260709 12:25:11.751197 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:11.762190 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:11.769033 15898 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.792922 15806 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:11.793453 15806 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:11.793848 15806 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.798072 16054 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:11.799631 16087 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:25:11.801270 16084 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 12:25:11.802124 16082 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260709 12:25:11.803077 16075 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.057s	user 0.001s	sys 0.006s
W20260709 12:25:11.804062 16086 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:25:11.762354 12454 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 4 to 5, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 5 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:11.815167 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.820616 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:11.821461 15799 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:11.822027 15799 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:11.822362 15799 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.822690 15799 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:11.825675 15965 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.755934 15496 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.826385 15868 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.828064 15496 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.829519 15993 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.831173 15624 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:11.790665 15839 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.011s	sys 0.021s
W20260709 12:25:11.813208 15981 consensus_meta.cc:287] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.504s	user 0.012s	sys 0.001s
I20260709 12:25:11.858572 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:11.876744 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.839174 15839 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.012s	sys 0.022s
W20260709 12:25:11.888476 12523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.517s (SENT) [suppressed 37 similar messages]
I20260709 12:25:11.750957 16090 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.229s
I20260709 12:25:11.902937 16063 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:11.903556 16063 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:11.904059 16063 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:11.904247 15983 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:11.909484 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:11.909895 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:11.910465 12631 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:11.915512 16056 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:11.916062 16056 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:11.930497 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 190573us
W20260709 12:25:11.935160 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 217412us
I20260709 12:25:11.877249 15624 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:11.949343 15624 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:11.951294 12634 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:11.951737 12634 pending_rounds.cc:85] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 7
I20260709 12:25:11.951979 12634 pending_rounds.cc:107] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:11.952208 12634 raft_consensus.cc:2889] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:11.952334 15624 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.952926 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:11.888545 15888 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:11.959836 16093 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:25:11.905146 15983 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:25:11.921260 16091 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.207s	user 0.001s	sys 0.002s
W20260709 12:25:11.968348 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.969159 15768 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.970597 15898 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:11.971074 15823 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:11.972100 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:11.972234 15931 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:11.889770 15951 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:11.973906 16101 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:11.974164 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 73790.6us
I20260709 12:25:11.974689 15804 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.878669 15981 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.976495 16113 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.895972 12454 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 5, now has a pending config: VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1), VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2), VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3), VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 5 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:11.978737 12631 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:11.982789 15888 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.017153 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.015793 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:11.983369 15982 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:11.985953 15902 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.987213 16096 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:25:11.989959 16111 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.982684 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:12.022737 12551 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.029716 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.030356 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.031140 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.002671 15931 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:12.033512 16078 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.065644 12550 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:12.014914 15823 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.034578 12553 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:12.049603 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:12.049948 15710 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.014614 15951 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.014727 15624 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.054278 15839 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.055116 12454 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 5 to 7, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:25:12.056555 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 84539.9us
I20260709 12:25:12.088317 16063 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.064504 15983 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:12.064543 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 81983us
I20260709 12:25:12.033339 15804 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.072059 16111 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.071323 16119 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:12.066165 15906 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:12.073570 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.123311 15710 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:12.071789 16090 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:12.069043 16088 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:12.153674 16088 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.154937 15804 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.155810 16088 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:12.082834 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 824) took 1257 ms. Trace:
I20260709 12:25:12.155648 16119 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.128520 16078 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.156430 12552 rpcz_store.cc:276] 0709 12:25:10.825864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.980831 (+154967us) service_pool.cc:224] Handling call
0709 12:25:10.981212 (+   381us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.107687 (+126475us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:11.120676 (+ 12989us) log.cc:844] Serialized 14 byte log entry
0709 12:25:11.207760 (+ 87084us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b18004e2980. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:25:11.662434 (+454674us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.712451 (+ 50017us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.712639 (+   188us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:11.712673 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.712734 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.986389 (+273655us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:12.082588 (+ 96199us) raft_consensus.cc:1685] finished
0709 12:25:12.082610 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.082744 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":3353,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":73722,"raft.run_cpu_time_us":346,"raft.run_wall_time_us":22782,"spinlock_wait_cycles":39881472,"thread_start_us":441665,"threads_started":1,"wal-append.queue_time_us":632399}
I20260709 12:25:12.157486 15906 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.158111 15804 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.085880 15981 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.064291 15902 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.151041 12557 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:12.160183 15906 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.160671 15902 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.087682 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:12.069507 16113 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.162245 15823 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:12.163233 16113 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.017632 15898 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.163920 15898 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:11.917394 16056 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:12.123553 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 354605us
I20260709 12:25:12.133600 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:12.139319 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.066797 16105 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:12.148969 12454 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 4, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 4 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:12.152196 16106 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.152781 16090 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.167145 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:12.158715 15804 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.175740 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.181492 12551 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:12.088317 15806 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.151328 15710 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.184129 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.177198 12454 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:12.191452 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 358580us
W20260709 12:25:12.205011 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 53251.5us
W20260709 12:25:12.190261 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 436681us
I20260709 12:25:12.207463 12454 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 4, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:12.142360 15624 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.216305 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:12.220696 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.193379 15902 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:12.225975 12633 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:12.234923 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.216044 16105 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:12.177034 15839 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:12.264357 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 120774us
I20260709 12:25:12.269022 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.269887 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:12.270678 12556 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.275830 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.276798 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.278563 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.280100 15806 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.212430 15823 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:25:12.284097 15804 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.221055 15888 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
W20260709 12:25:12.354028 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 140230us
W20260709 12:25:12.321218 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54099.1us
I20260709 12:25:12.269901 12631 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
W20260709 12:25:12.249517 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 368121us
W20260709 12:25:12.362936 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 98415.9us
I20260709 12:25:12.226893 15981 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:12.259601 16056 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.227975 15902 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:12.261226 16105 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.260560 15898 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.402850 15982 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.416409 13198 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.402284 15902 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.425940 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.426666 12700 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.425966 12701 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:12.426679 12702 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.402338 16113 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.411453 16078 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:12.406028 16105 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:12.230247 16106 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.450560 12454 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:12.454898 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.455226 12700 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:12.454269 15981 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:12.230511 15931 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.424315 16119 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:12.448396 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:12.434449 15823 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:12.417764 15982 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.470561 12701 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.479404 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.483428 12700 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.485893 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.486964 12551 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:12.493211 12700 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:12.448913 16063 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.497205 12558 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:12.500358 15958 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.501000 15958 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.504227 15624 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:12.505193 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 85856.1us
I20260709 12:25:12.505901 15981 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.459164 15951 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
W20260709 12:25:12.510792 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 97232.8us
I20260709 12:25:12.512979 12702 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:12.521525 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.465570 16113 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.551370 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.556113 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.515027 16112 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:12.559156 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.563819 12629 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:12.499845 15839 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.518289 15931 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.515007 15958 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.520103 16119 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.567848 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.521171 16090 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:12.571480 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.576953 15982 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.577893 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.565079 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.569012 12454 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 6 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 7 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:12.580503 12702 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:12.581676 12700 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:12.561164 16111 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.584898 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.567263 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.589382 12704 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.591132 12556 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:12.565497 15823 raft_consensus.cc:697] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:12.585534 15982 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:12.608340 15982 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.608878 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.609684 16104 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:12.609547 12454 catalog_manager.cc:5697] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 1 to 3, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:12.609591 12550 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:12.611249 12454 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 6, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:12.584146 15958 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:12.587359 16018 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.636655 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.642084 12700 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:12.596213 15983 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.573220 15898 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:12.610574 15982 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.594676 15804 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.644002 16106 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.644708 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:12.580178 16124 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.231s
I20260709 12:25:12.647969 16018 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:12.655062 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.659132 12454 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 2 to 6, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:12.668848 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.663957 12550 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:12.647255 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:12.669675 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.610185 16104 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.650308 15983 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.634837 16119 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.662729 15804 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:12.687291 16135 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260709 12:25:12.679265 15983 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.693228 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:12.702736 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 125532us
I20260709 12:25:12.702608 12554 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:12.703462 12556 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:12.673856 16018 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.703691 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:12.672114 15958 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.707127 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:12.709460 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 52619.7us
I20260709 12:25:12.705657 12699 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:12.668386 15898 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.698975 15804 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.716159 12600 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.717208 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.721433 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:12.723814 12558 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:12.716074 15823 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.729573 16144 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:12.731140 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.731778 12703 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:12.758863 12704 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:12.691805 15624 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:25:12.723771 16132 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 12:25:12.720929 15981 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:12.764147 16119 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:12.758769 15982 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.730176 16138 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.714813 16104 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.761765 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:12.785681 16134 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
I20260709 12:25:12.771924 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.796558 12704 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:12.771816 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:12.732411 15902 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:12.777891 16142 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 12:25:12.779186 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:12.777120 12708 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
W20260709 12:25:12.765048 16140 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.125s	user 0.000s	sys 0.002s
W20260709 12:25:12.796208 15768 consensus_meta.cc:287] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.791s	user 0.008s	sys 0.004s
I20260709 12:25:12.769300 15898 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.766706 16144 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:12.797617 13227 raft_consensus.cc:606] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:12.803890 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.808176 12559 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:12.795177 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.805161 12708 raft_consensus.cc:1217] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Deduplicated request from leader. Original: 4.6->[6.7-6.7]   Dedup: 6.7->[]
I20260709 12:25:12.810386 12708 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:12.797181 16113 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.811448 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.810310 12552 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:12.801246 15839 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:12.806444 15951 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:25:12.814929 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.827380 12629 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:12.814955 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.828068 12559 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:12.815645 15902 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.804534 16151 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:12.818014 12699 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:12.810570 16099 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:12.832908 12701 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:12.822175 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:12.835767 12708 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:12.840395 16063 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:12.840884 16063 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:12.841117 12708 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:12.841347 16063 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.842798 12708 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:12.844255 12708 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:12.803175 15982 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:12.814178 15799 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.991s	user 0.004s	sys 0.010s
I20260709 12:25:12.812608 16139 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.802161 16138 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:12.826818 16147 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:25:12.847424 12701 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:12.801530 15981 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.860018 15982 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.857663 15768 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.861671 15768 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.864303 15768 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.866097 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.865886 16144 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.866801 12633 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:12.867651 12630 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:12.867746 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.868846 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.869220 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.869722 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.870337 12630 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:12.870824 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.872004 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.872692 12633 raft_consensus.cc:2368] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:12.874361 12699 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:12.875799 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.871417 12632 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:12.837966 16151 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:12.887295 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:12.892124 12559 raft_consensus.cc:2410] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:12.845810 16099 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:12.890264 12628 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:12.897184 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.889530 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.893210 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.900131 12627 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:12.906138 12699 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:12.894367 16099 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:12.857008 15799 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.852794 15839 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.926710 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.932588 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:12.926319 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:12.927003 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.877727 16139 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.927317 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.953251 12634 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:12.954928 15839 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.956007 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:12.949249 15710 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.726s	user 0.003s	sys 0.006s
I20260709 12:25:12.961227 16138 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.910275 15740 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:12.953256 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:12.956234 12559 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:12.958492 16144 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:12.960758 15710 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.964246 16063 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:12.960750 12555 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:12.966257 15710 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.966462 16105 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:12.968688 16105 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.970047 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:12.970674 13227 raft_consensus.cc:606] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:12.972551 16139 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:12.973166 12553 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:12.974671 15981 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:12.957866 12557 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
W20260709 12:25:12.953200 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 195207us
I20260709 12:25:12.981986 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:12.993912 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.993031 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:12.997184 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.999519 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:13.001967 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:12.914386 15958 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.005029 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:13.003481 12632 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:12.996039 16144 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:13.001850 15839 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:13.004086 16158 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.916895 15804 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.000411 16138 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.014132 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793f816912494728bf76dd612942dc4c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:13.029323 13227 raft_consensus.cc:606] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:13.029877 13227 raft_consensus.cc:614] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:13.006901 16018 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.033237 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:13.034121 13227 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:13.036267 16168 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.012850 16099 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.021971 16153 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.036888 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.036844 16168 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.037817 12553 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:13.037577 16153 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.041352 12630 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:13.041591 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:13.026630 16158 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.039487 16169 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.043565 16153 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.044482 13227 raft_consensus.cc:606] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:13.050414 13227 raft_consensus.cc:614] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:13.028790 16056 consensus_meta.cc:287] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.626s	user 0.004s	sys 0.007s
I20260709 12:25:13.051796 16018 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:13.042303 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:13.029088 16138 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.049117 16158 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.055764 12629 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.058987 16151 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.028062 15983 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.063472 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:13.069922 12633 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:13.076387 15619 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.077066 15619 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.067303 16138 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.079517 16108 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:13.081295 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.081683 15823 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:13.082280 15823 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:13.085616 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.088546 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.088951 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.089260 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.089151 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.089828 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.093086 13232 raft_consensus.cc:2410] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:13.087909 16151 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.093804 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.094375 12553 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.095240 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.095914 12628 raft_consensus.cc:2368] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:25:13.096673 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.090654 13235 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:13.097152 12628 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:13.100590 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.084823 15710 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.083427 15839 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:13.103798 15651 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.108251 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.110363 12626 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:13.109217 15651 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.114495 15651 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.114548 15839 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.129702 16063 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:25:13.131421 15823 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.134071 16099 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.135380 15804 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.122229 15799 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.139385 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.140689 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.146929 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.147562 13233 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:13.145103 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.148842 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.149868 16136 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.150204 16045 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.150506 16136 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.150889 16045 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.152801 16136 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:13.153044 16045 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.149099 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:13.157943 16168 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.104674 15710 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.143673 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.163791 12625 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:13.162402 12628 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.162055 12553 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:13.174024 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.174489 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:13.174628 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.153338 16136 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.180416 13235 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:25:13.187579 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.165232 15710 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:13.210870 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 576253us
I20260709 12:25:13.214785 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.215914 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.214908 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.217798 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:13.218267 12557 raft_consensus.cc:2393] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:13.215720 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.221181 12630 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:13.218801 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.222512 12629 raft_consensus.cc:2410] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:13.220173 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.223759 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.225466 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.227214 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.228380 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.230458 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:13.232033 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.232599 12558 raft_consensus.cc:2393] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:13.222347 16167 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.253661 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.225044 15823 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.227974 16149 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:13.227844 15799 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.256436 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.254966 13233 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
W20260709 12:25:13.267416 16164 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:25:13.272742 16170 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:25:13.273069 16167 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.256019 16113 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:13.277501 12629 raft_consensus.cc:2393] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:13.278918 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.279992 12553 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:13.207620 16136 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.285187 12628 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:13.288452 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.296881 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.297807 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.298457 12629 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:13.300294 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.283313 16149 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:13.302708 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.303371 12702 raft_consensus.cc:2393] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:13.306336 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.306787 16149 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.286437 15823 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:13.283963 15799 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:13.316329 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.316992 16126 consensus_queue.cc:1059] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:13.317704 12671 leader_election.cc:400] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:13.327752 12671 leader_election.cc:403] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:13.319984 15983 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:13.290273 16112 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.330888 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.326678 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.330399 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.332684 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.333423 12702 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:13.345472 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.345690 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.345986 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.346207 12708 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:13.346771 12699 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.346257 12706 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:13.349768 12629 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:25:13.294518 16113 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.352703 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.298386 16158 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.367511 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.368600 16158 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.370745 12627 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:13.353397 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.372658 12699 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:13.352730 15799 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.356228 16136 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.357753 15823 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.384181 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:13.384776 12632 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.384977 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.360069 15710 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.386216 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.360988 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.363145 16167 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.388224 12628 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:13.360452 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:13.365561 16179 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:13.372799 12704 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:13.354449 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.334302 16138 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.349511 16112 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.403380 12625 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:13.379755 16108 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.404639 16108 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.409293 15619 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:13.409659 15906 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.417665 12629 raft_consensus.cc:606] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.418197 12629 raft_consensus.cc:614] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:13.420861 12632 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:13.381435 13227 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:13.434592 12700 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:13.433347 16119 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:13.436132 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 75767.7us
I20260709 12:25:13.441289 16078 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.442054 15710 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.441984 16078 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.440272 15619 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:13.443789 16078 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:13.444057 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.443660 15619 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.440689 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:13.445896 12631 raft_consensus.cc:2368] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:13.446950 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:13.448419 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.449028 12634 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:13.459118 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:13.465040 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.465910 12699 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:13.457144 12597 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.467593 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.468541 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.469128 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.469233 12701 raft_consensus.cc:2376] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10. Re-sending same reply.
I20260709 12:25:13.470000 12704 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:13.445204 16126 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.474373 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 841) took 1006 ms. Trace:
I20260709 12:25:13.459681 16054 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.475595 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.470759 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:13.474784 12554 rpcz_store.cc:276] 0709 12:25:12.467666 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.467792 (+   126us) service_pool.cc:224] Handling call
0709 12:25:12.468069 (+   277us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.703766 (+235697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.474167 (+770401us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540035e154. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:13.474318 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538932608}
I20260709 12:25:13.460965 15906 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.508961 12626 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:13.482095 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.514672 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.516610 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.445731 16119 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.509382 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.521607 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:13.522207 12705 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:13.474689 15806 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.474278 16158 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:13.477674 16078 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.474658 16126 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:13.527556 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.578931 15619 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.573758 16113 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:13.573995 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:13.579727 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.550596 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.580535 15770 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:13.580960 15770 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:13.521898 16112 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.516223 15906 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.582867 15906 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.582800 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.526073 16151 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:13.579039 16126 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:13.587316 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.508886 15804 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.580567 12632 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:13.523272 16145 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.481834 16054 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.481743 16143 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.597599 12522 leader_election.cc:400] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:25:13.601132 12522 leader_election.cc:403] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:13.599849 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.602491 13227 raft_consensus.cc:2410] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:13.605587 12632 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:13.606603 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:13.603960 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:13.608857 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:13.585812 16151 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.615828 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.594014 16137 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.627130 16137 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.628561 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.621520 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.603399 16054 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.630410 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.630903 12625 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:13.631007 12633 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:13.632335 12625 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:13.635828 16151 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.636439 16151 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.636775 16151 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.621622 16143 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.629196 16137 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.637141 16151 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.624621 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.604614 15768 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:13.614668 16105 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 3. Current term is 4.
I20260709 12:25:13.655155 16143 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.655489 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:13.656499 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:13.657353 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:13.614552 16106 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.639618 12631 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:13.614871 16056 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.647734 12705 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:13.654632 15768 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:13.603206 16145 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.609643 15804 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:13.590780 16078 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.658424 16106 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:13.678692 16145 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.727677 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:13.669615 15768 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:13.681783 15804 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:13.688143 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:13.734638 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46590us
I20260709 12:25:13.692561 15619 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:13.695885 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 88160.9us
W20260709 12:25:13.703411 16181 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.303s	user 0.000s	sys 0.002s
I20260709 12:25:13.738756 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:13.708187 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 838) took 1294 ms. Trace:
I20260709 12:25:13.708899 16137 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:13.712800 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.743049 12557 raft_consensus.cc:2410] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:13.714809 12554 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:13.715982 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.718804 12633 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:13.724794 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:13.661419 16056 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.654672 16144 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:13.692548 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.735723 13198 leader_election.cc:400] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:13.736069 12630 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:13.739758 12555 rpcz_store.cc:276] 0709 12:25:12.414242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.414376 (+   134us) service_pool.cc:224] Handling call
0709 12:25:12.414646 (+   270us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.965740 (+551094us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.707960 (+742220us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b54001d1fd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:13.708114 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1249484160}
I20260709 12:25:13.729897 16106 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.747206 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:13.748657 13198 leader_election.cc:403] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
W20260709 12:25:13.749986 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 141229us
I20260709 12:25:13.750257 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:13.751348 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.730813 16146 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:13.738262 16145 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.760095 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.747267 16124 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:13.763870 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.763921 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.765925 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.748943 16056 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.774358 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.752856 15834 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.776903 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:13.779047 13233 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.760260 16136 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:13.768864 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.760033 16045 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:13.784284 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 160563us
I20260709 12:25:13.745285 16054 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.787385 13234 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:13.787879 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:13.741353 15619 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.766104 16124 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.757313 16137 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.811244 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.805143 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.814429 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:13.815786 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.783937 16138 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:13.817940 13235 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:13.819366 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.764456 16144 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.824304 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.825630 12671 leader_election.cc:400] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:13.768359 16145 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.799641 16124 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.782585 16131 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:13.796695 16136 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:13.843447 13233 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
W20260709 12:25:13.844439 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 60667.9us
W20260709 12:25:13.840978 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 75985.9us
I20260709 12:25:13.841550 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.804004 16055 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.773950 16146 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:13.847509 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 97313.2us
I20260709 12:25:13.848156 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.849257 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.803825 15951 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:25:13.848608 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.849689 12522 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:13.834154 16113 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.851529 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.855252 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:13.826004 16112 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.021s
I20260709 12:25:13.856982 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:13.839757 16094 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.861868 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.862287 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:13.869179 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.871814 16146 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:13.875108 16191 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:13.875664 16191 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:13.876121 16191 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:13.783552 15768 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:13.888197 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:13.890017 16137 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:13.898864 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44646.4us
I20260709 12:25:13.825814 16108 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:13.928719 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 71865.6us
W20260709 12:25:13.928995 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 66483us
I20260709 12:25:13.929903 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:13.890829 16137 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:13.916296 16189 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
W20260709 12:25:13.928664 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 79044.7us
I20260709 12:25:13.867985 16111 raft_consensus.cc:2764] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:13.931824 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:13.865058 16094 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:13.857832 16131 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:25:13.915759 16113 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.031989 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.032769 12550 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.030906 12627 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:13.931898 16146 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:13.925395 16179 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:14.042035 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 112342us
W20260709 12:25:14.045816 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 193154us
I20260709 12:25:13.995594 16198 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.990574 16078 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:14.042738 16175 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:14.071755 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:13.991389 16055 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.046875 16203 raft_consensus.cc:993] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:14.035935 16094 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.937036 16200 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.140s
I20260709 12:25:14.050379 16111 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.108034 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.108866 12556 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.045490 15804 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.044618 16146 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:14.115187 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:14.114956 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 179968us
W20260709 12:25:14.120934 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 191152us
I20260709 12:25:14.122773 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.099951 16202 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.125471 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.056603 16179 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.102098 16054 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.131675 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.112980 15619 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:14.121097 16146 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.054574 16136 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.074950 16198 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.127509 16113 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:14.151033 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 65459.9us
I20260709 12:25:14.124184 15804 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.117374 16055 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.135255 16111 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.133481 16137 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.146107 15619 raft_consensus.cc:1081] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:14.167500 12558 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:14.147750 16144 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.148123 16054 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:14.176424 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 94312.8us
I20260709 12:25:14.175314 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.177772 12553 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.188850 16137 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.190285 12553 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:14.202998 15983 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:14.203481 15983 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:14.178515 12556 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:14.204464 15983 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.205586 16209 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:25:14.167827 16196 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.290s	user 0.001s	sys 0.000s
W20260709 12:25:14.196908 16151 consensus_meta.cc:287] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.535s	user 0.007s	sys 0.001s
I20260709 12:25:14.220943 16146 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.224143 16211 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:14.163447 16145 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:14.226257 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46711.6us
I20260709 12:25:14.199034 16055 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:14.226106 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 233972us
I20260709 12:25:14.235036 12556 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:14.133914 16202 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.203532 16045 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
W20260709 12:25:14.228299 16205 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.081s	user 0.003s	sys 0.000s
W20260709 12:25:14.228124 16204 log.cc:927] Time spent T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.065s	user 0.001s	sys 0.001s
I20260709 12:25:14.173867 16112 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:25:14.247455 13234 raft_consensus.cc:2410] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:14.231848 16179 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:14.246140 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 111430us
I20260709 12:25:14.237816 15804 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:14.276852 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 156560us
I20260709 12:25:14.241792 16108 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.286949 13199 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:14.283456 16045 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:25:14.289566 16045 raft_consensus.cc:993] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:14.290022 15888 raft_consensus.cc:1081] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:14.287143 16054 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.238219 16151 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:14.304908 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 252015us
I20260709 12:25:14.309653 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.318506 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.297544 15983 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.321966 13199 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.306582 16054 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.324466 15951 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.326620 16054 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.327524 16208 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:14.268939 16215 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
W20260709 12:25:14.336251 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 63083.1us
I20260709 12:25:14.337293 16055 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:14.338193 16219 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:14.339284 16180 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:14.339797 16180 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:14.340963 16180 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.342082 16146 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:14.307996 16201 raft_consensus.cc:2764] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:14.338479 16055 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:14.329308 16212 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:25:14.344879 16212 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:14.346755 16055 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:14.347873 16106 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260709 12:25:14.347455 16055 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.350896 16055 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.300459 16200 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 12:25:14.352072 16055 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:14.352608 15906 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.769s	user 0.012s	sys 0.000s
I20260709 12:25:14.352710 16055 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.353130 15906 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.301092 16202 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.342638 16180 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.345217 16212 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.356482 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.370563 12550 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
W20260709 12:25:14.377701 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.381685 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 59803.4us
I20260709 12:25:14.357811 16146 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:14.348302 16106 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.388623 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:14.373651 16215 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:14.378818 16126 consensus_meta.cc:287] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.778s	user 0.010s	sys 0.002s
W20260709 12:25:14.396344 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.395361 12556 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:14.402693 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46302.7us
I20260709 12:25:14.403420 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:14.398352 12553 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.383795 16151 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:14.395934 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 161593us
I20260709 12:25:14.405596 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.404412 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.406982 12628 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:14.409328 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.399932 16198 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:14.394500 16220 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.410627 16218 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:14.408826 16126 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.421306 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:14.445660 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:14.406884 16215 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.421705 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:14.421855 16054 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.412667 16179 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:25:14.410710 16212 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.453615 16212 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.453286 16215 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:14.454064 16056 consensus_meta.cc:287] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.665s	user 0.008s	sys 0.004s
I20260709 12:25:14.454568 16215 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.454458 16056 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.456458 16056 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:14.457319 16179 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:14.458117 12554 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:14.395607 16094 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.426612 15906 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:14.413684 15834 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 12:25:14.429554 12704 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:14.462186 12704 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.458112 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.435945 12557 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:14.400063 16146 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.445487 16218 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.405646 16112 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:14.442526 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.443286 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 169761us
I20260709 12:25:14.444523 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.445168 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:14.450424 12703 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:14.466917 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.467408 12703 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:14.467787 12703 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.468567 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:14.469794 16195 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.649s	user 0.006s	sys 0.009s
I20260709 12:25:14.471310 16119 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.472831 16126 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:14.472924 15768 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.424679 16045 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:14.460409 12700 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:14.476747 12702 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:14.461879 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.457739 16179 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:14.461642 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.462585 12704 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:14.432952 16190 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.607s	user 0.008s	sys 0.024s
I20260709 12:25:14.469755 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.458881 13235 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:14.480585 12703 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.483561 15770 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.484205 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.484804 15770 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.486523 16055 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:14.487346 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.488740 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.489881 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.488811 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:14.492930 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.494028 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:14.492683 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.495209 12703 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.495666 12556 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:14.495987 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.448163 16216 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:25:14.497336 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.495772 16055 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.498261 16055 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:14.501159 16124 consensus_meta.cc:287] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.652s	user 0.008s	sys 0.000s
I20260709 12:25:14.499284 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:14.499607 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.501358 12707 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:14.498741 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.512373 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:14.513031 12551 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.501374 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:14.501888 16179 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.503134 16173 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:14.504105 16145 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:14.504627 16113 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.505739 16055 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.509693 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.527535 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:14.544893 12556 raft_consensus.cc:1813] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Handling vote request from an unknown peer c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.545436 12556 raft_consensus.cc:2368] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:25:14.531423 12597 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.478667 15906 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.465758 16218 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.530632 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.531330 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.537927 13199 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.555646 12551 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:14.559921 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.560421 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.561806 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.563807 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.549525 12704 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.560699 13232 raft_consensus.cc:2376] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5. Re-sending same reply.
I20260709 12:25:14.568998 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.570047 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.573596 12704 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.574766 16179 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.531068 16173 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:14.577140 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.577632 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.583914 13232 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:14.543157 16200 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:14.530551 16145 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.559851 16105 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.557801 16180 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.560839 15958 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.584419 13232 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:14.585915 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.566497 16198 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:14.592069 12597 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:14.569252 16202 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.571180 16176 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.532029 16124 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.568866 16055 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.597209 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.577942 16144 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.577715 16151 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:14.594215 16191 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.714s	user 0.011s	sys 0.004s
I20260709 12:25:14.594780 13232 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.611462 13232 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.585326 16136 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.587440 16056 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.596971 16105 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.624023 16105 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:14.637151 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.637796 13230 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:14.644434 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:14.580303 15906 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.654269 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:14.663795 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.664989 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.567283 16146 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.618034 15804 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:14.668985 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:14.669603 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.679270 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.671458 13228 raft_consensus.cc:2410] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:14.673409 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.591905 15823 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:25:14.643412 16202 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:14.690312 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.692425 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.612340 16055 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.655545 16180 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:14.695698 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:14.459352 16222 consensus_queue.cc:1175] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c6795b140b3247279a2231c6b9360d24" responder_term: 8 status { last_received { term: 6 index: 4 } last_committed_idx: 4 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:14.696574 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.686252 16173 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.656200 16056 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.731899 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:14.706367 16227 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:14.708714 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:14.711481 15823 raft_consensus.cc:993] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:14.711971 16146 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.692983 15804 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:14.713891 16231 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:14.716452 15768 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.692772 16126 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.755334 16173 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.755263 16126 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.615106 16191 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:14.690448 16137 consensus_queue.cc:1175] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a2a8d71f644447218c1afc3e5f7716cd" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:14.743772 16202 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.668184 16111 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.758749 16111 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.637653 16151 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.682484 15839 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:14.761106 16151 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:14.753290 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.761759 16231 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.761917 13226 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:14.762796 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.762717 16231 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.763932 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.764905 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:14.754606 12706 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:14.758013 12558 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:14.759043 16191 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:14.760780 15839 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.656605 16105 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:14.750511 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 71377.6us
I20260709 12:25:14.765357 13232 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:14.749621 16234 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:14.730366 16180 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:14.744375 16210 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:14.770668 16229 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:14.771001 15839 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:14.767735 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.816257 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:14.785135 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.765451 13226 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:14.817310 16112 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:14.810333 12702 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:14.818085 16112 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:14.819300 16112 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.676535 16145 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.768059 15823 raft_consensus.cc:1081] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:14.831260 12555 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:14.832242 12598 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:14.825853 16200 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:14.807730 16180 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:14.796322 16234 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:14.840981 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.841728 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.810453 16144 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:14.842646 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.846392 12630 raft_consensus.cc:2368] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8.
I20260709 12:25:14.847061 16200 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.850433 16113 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:14.853528 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.854537 15906 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.879882 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.859000 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.874974 12551 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:14.881361 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:14.881754 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:14.881819 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:14.877527 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:14.878966 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.883141 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:14.887041 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 844) took 1496 ms. Trace:
I20260709 12:25:14.887430 12629 rpcz_store.cc:276] 0709 12:25:13.390835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.637675 (+246840us) service_pool.cc:224] Handling call
0709 12:25:14.426940 (+789265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.427092 (+   152us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.427116 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:14.427152 (+    36us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:14.427190 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.427237 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:14.886903 (+459666us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54002134d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:14.886992 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1814515456}
I20260709 12:25:14.888712 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.889303 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 846) took 1416 ms. Trace:
I20260709 12:25:14.839893 15839 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.891996 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.893015 12632 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:14.895107 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:14.895675 12631 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:14.895884 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.889688 12627 rpcz_store.cc:276] 0709 12:25:13.473078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.638010 (+164932us) service_pool.cc:224] Handling call
0709 12:25:13.638294 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.034812 (+396518us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:14.889085 (+854273us) spinlock_profiling.cc:243] Waited 357 ms on lock 0x7b5400131354. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:14.889249 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":820520320}
I20260709 12:25:14.844610 16234 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.908427 12705 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:14.915728 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.886058 16119 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.916488 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.923800 12671 leader_election.cc:400] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8.
I20260709 12:25:14.924121 12671 leader_election.cc:403] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:14.923978 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:14.925707 12707 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:14.925622 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:14.927506 12702 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:14.879551 16144 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:14.932122 12631 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:14.835223 16210 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:14.945782 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:14.946627 12629 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.951444 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:14.934747 16113 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.934403 15906 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:14.930348 16126 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.933929 16124 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:14.908219 15804 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:14.998494 16215 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.508s	user 0.007s	sys 0.004s
I20260709 12:25:14.930709 16119 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.151124 16119 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:14.961585 16168 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:14.977650 16112 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.153383 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:15.173307 12523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.023s	sys 0.013s
I20260709 12:25:15.153807 12551 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 12:25:15.181378 12523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.026s	sys 0.013s
I20260709 12:25:15.158517 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:15.181967 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 611954us
W20260709 12:25:15.163924 16238 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
I20260709 12:25:15.170928 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.182674 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.171156 16056 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.143307 16055 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:15.184051 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.186211 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.188273 12556 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 12:25:15.188858 12556 pending_rounds.cc:85] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 4
I20260709 12:25:15.189263 12556 pending_rounds.cc:107] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 12:25:15.189669 12556 raft_consensus.cc:2889] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:15.189073 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.177363 16225 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.424s	user 0.001s	sys 0.000s
W20260709 12:25:15.178259 16188 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 1.468s	user 0.009s	sys 0.000s
I20260709 12:25:15.191020 12558 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:15.176307 15770 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.691s	user 0.008s	sys 0.000s
W20260709 12:25:15.192358 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:15.194567 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 243202us
I20260709 12:25:15.202538 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.203632 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.204563 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.206950 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:15.198251 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 293624us
W20260709 12:25:15.184549 16179 consensus_meta.cc:287] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.594s	user 0.006s	sys 0.004s
W20260709 12:25:15.217530 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 54795.5us
I20260709 12:25:15.219195 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.223420 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:15.224364 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.220461 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.222260 12552 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:15.227223 16112 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.224898 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.229807 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.240466 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2044) took 1377 ms. Trace:
I20260709 12:25:15.240903 12554 rpcz_store.cc:276] 0709 12:25:13.841073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.841272 (+   199us) service_pool.cc:224] Handling call
0709 12:25:15.218647 (+1377375us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b5400375854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:15.218791 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1408365952}
I20260709 12:25:15.241925 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1986) took 1579 ms. Trace:
I20260709 12:25:15.184376 16146 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.246724 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:15.251904 13226 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:15.252106 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.242317 12700 rpcz_store.cc:276] 0709 12:25:13.642078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.642212 (+   134us) service_pool.cc:224] Handling call
0709 12:25:13.654296 (+ 12084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.477054 (+822758us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.221007 (+743953us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b54002a1f54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:15.221186 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853474048}
I20260709 12:25:15.253119 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:15.247665 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.192945 16056 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.253571 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.239300 16199 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.254324 16124 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:15.248767 16078 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.256179 12699 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:15.261008 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.264544 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.218451 16055 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:15.279191 12550 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.279402 12554 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:15.265383 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.280256 12703 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:15.265388 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:15.266089 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:15.281129 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:15.259398 16173 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:25:15.267978 16202 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:15.268361 16244 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:15.265113 16054 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:15.282971 16215 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:15.269433 16233 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.289093 16202 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.291016 16215 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.292052 16245 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.292975 16202 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.297669 16054 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.298183 16054 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:15.298305 16211 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:15.298764 16211 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:15.299511 16211 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.300477 16211 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:15.304767 12625 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.307099 16144 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:15.308288 13227 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 842) took 1543 ms (client timeout 2045 ms). Trace:
W20260709 12:25:15.308738 13227 rpcz_store.cc:269] 0709 12:25:13.765043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.765194 (+   151us) service_pool.cc:224] Handling call
0709 12:25:15.308070 (+1542876us) spinlock_profiling.cc:243] Waited 804 ms on lock 0x7b5400510254. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:15.308207 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1848384768}
I20260709 12:25:15.309931 16236 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:15.310655 16236 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.184417 16168 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.282377 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:15.249512 16112 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.287814 12629 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:15.288350 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.326932 12634 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:15.289680 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.289891 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.281822 12703 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:15.319334 12632 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:15.321866 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.328544 12700 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:15.330662 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.330484 16246 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.340075 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:15.344364 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 288163us
W20260709 12:25:15.354249 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 373815us
W20260709 12:25:15.358342 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.364480 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:15.293284 16215 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.371354 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.356138 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.347733 12705 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:15.372032 12707 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:15.383903 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:15.384799 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:15.385488 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:15.386260 13235 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:15.386173 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.387981 12705 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:15.388286 12703 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:15.389891 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.343151 16231 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:15.334442 16222 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:15.401873 12699 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:15.402459 12699 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.393359 16231 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:15.401957 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.422777 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 846) took 1593 ms. Trace:
I20260709 12:25:15.425387 16106 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:15.425848 16218 consensus_meta.cc:287] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260709 12:25:15.426287 16218 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.428637 16168 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:15.434811 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2039) took 1646 ms. Trace:
I20260709 12:25:15.435200 12557 rpcz_store.cc:276] 0709 12:25:13.788474 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.788601 (+   127us) service_pool.cc:224] Handling call
0709 12:25:13.807685 (+ 19084us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.463099 (+655414us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.434570 (+971471us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b54001a8e54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:15.434751 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1404839168}
I20260709 12:25:15.437654 15906 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8.
I20260709 12:25:15.437773 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.439137 16119 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:15.439595 16234 consensus_meta.cc:287] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.513s	user 0.008s	sys 0.000s
I20260709 12:25:15.440078 16234 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:15.441992 16180 consensus_meta.cc:287] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.568s	user 0.008s	sys 0.001s
I20260709 12:25:15.442411 16180 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.444428 16180 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.445353 12700 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.403245 16222 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.446822 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:15.447516 12700 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:15.447947 16222 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:15.423434 13234 rpcz_store.cc:276] 0709 12:25:13.829008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.829147 (+   139us) service_pool.cc:224] Handling call
0709 12:25:15.422589 (+1593442us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b54007256d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:15.422721 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905863936}
I20260709 12:25:15.449684 12703 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:15.453706 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 83652.8us
W20260709 12:25:15.456056 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.422780 16231 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.456770 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:15.469703 12705 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.485678 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:15.485978 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 238387us
I20260709 12:25:15.486297 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:15.486534 12707 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:15.486797 12600 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.488384 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:15.477034 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:15.491015 13234 raft_consensus.cc:2410] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260709 12:25:15.493577 12628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.002s	sys 0.033s
W20260709 12:25:15.493908 12628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.002s	sys 0.033s
I20260709 12:25:15.495719 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:15.498178 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:15.491954 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.503444 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:15.492683 12699 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.473387 16173 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:25:15.509986 16234 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.502681 16244 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.511337 15839 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:15.502918 16106 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.515229 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.517729 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.476132 16222 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:15.528764 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:15.497534 16206 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:15.536804 16206 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:15.537317 16206 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:15.525139 15958 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:15.497320 15804 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:15.502532 16245 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.549711 13231 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:15.552750 13231 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:15.557991 16218 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:15.558254 13231 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.560624 16176 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:15.561069 16176 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:15.561872 16176 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.563114 16176 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.551487 15958 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:15.566428 15958 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.569001 16144 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.525560 16222 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.527348 15839 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:15.585520 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 86215.4us
I20260709 12:25:15.527153 16244 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
W20260709 12:25:15.598732 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 76233.6us
I20260709 12:25:15.533982 16216 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:25:15.552814 16258 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:15.585631 16222 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.604418 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:15.613754 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:15.616348 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.603511 15839 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:15.618533 16218 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.618831 16258 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:15.611922 16245 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
W20260709 12:25:15.619554 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 90772.7us
I20260709 12:25:15.627578 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2212) took 1297 ms. Trace:
I20260709 12:25:15.641472 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.654649 12552 rpcz_store.cc:276] 0709 12:25:14.330072 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.330278 (+   206us) service_pool.cc:224] Handling call
0709 12:25:15.222028 (+891750us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:15.225884 (+  3856us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.627333 (+401449us) spinlock_profiling.cc:243] Waited 878 ms on lock 0x7b5400375850. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:15.627477 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2018822912}
I20260709 12:25:15.610859 16054 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.655735 12674 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:15.656279 16180 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.658849 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.648548 13201 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.633072 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2211) took 1332 ms. Trace:
I20260709 12:25:15.650646 15888 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.660300 12627 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:15.662111 12553 rpcz_store.cc:276] 0709 12:25:14.301191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.301401 (+   210us) service_pool.cc:224] Handling call
0709 12:25:14.398190 (+ 96789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.404219 (+  6029us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.632875 (+1228656us) spinlock_profiling.cc:243] Waited 96.3 ms on lock 0x7b5400298450. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:15.633012 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":221576576}
I20260709 12:25:15.627799 15804 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.665642 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.669207 16055 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.670439 16094 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:15.671473 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.672919 16094 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:15.675388 12707 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:15.634097 16248 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:15.652801 16265 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
W20260709 12:25:15.647655 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.625228 16111 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:15.683616 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.678324 16173 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.678620 15888 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.693975 16258 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.694408 16206 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.695133 15888 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:15.696471 16206 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.700362 16231 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.710844 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.711696 15804 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:15.681561 16220 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:25:15.633793 16218 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.714951 15839 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.717264 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 1992) took 1064 ms. Trace:
I20260709 12:25:15.717725 12706 rpcz_store.cc:276] 0709 12:25:14.652699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.729108 (+ 76409us) service_pool.cc:224] Handling call
0709 12:25:14.731471 (+  2363us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.765575 (+ 34104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.716991 (+951416us) spinlock_profiling.cc:243] Waited 22.7 ms on lock 0x7b540041ffd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:15.717182 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":52191488}
I20260709 12:25:15.718580 16218 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:15.720595 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 850) took 1858 ms. Trace:
I20260709 12:25:15.721340 16210 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.710139 16206 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:15.720978 13230 rpcz_store.cc:276] 0709 12:25:13.862215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.862401 (+   186us) service_pool.cc:224] Handling call
0709 12:25:13.862797 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.652152 (+789355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:15.720334 (+1068182us) spinlock_profiling.cc:243] Waited 775 ms on lock 0x7b54005b27d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:15.720506 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1781919488}
I20260709 12:25:15.722632 16206 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.723548 15804 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.723924 16246 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:15.724809 16206 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:15.725658 12555 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2045) took 1878 ms (client timeout 1827 ms). Trace:
W20260709 12:25:15.726073 12555 rpcz_store.cc:269] 0709 12:25:13.847802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.847915 (+   113us) service_pool.cc:224] Handling call
0709 12:25:15.725488 (+1877573us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b540035e654. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:15.725593 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1995901696}
W20260709 12:25:15.728952 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 57682.2us
I20260709 12:25:15.729776 12674 leader_election.cc:400] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:25:15.730042 12674 leader_election.cc:403] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:15.680132 16199 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.678846 16112 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:15.736620 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 56568.5us
I20260709 12:25:15.735363 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:15.748188 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.751926 12701 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:15.753389 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.753870 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.760969 12705 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:15.767462 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.768230 12552 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:15.772820 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:15.775005 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.778872 16267 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:15.779434 16267 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.779765 16267 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:15.782215 16262 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:25:15.792812 12699 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.802155 16054 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:15.807505 16119 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.811728 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.826802 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:15.833078 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.833788 12551 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:15.835506 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.830467 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.836757 12558 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:15.837946 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.838127 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:15.838546 12633 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:15.838770 12705 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:15.838884 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:15.839766 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.840404 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.840768 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.841167 12558 raft_consensus.cc:2410] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
I20260709 12:25:15.736341 16248 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:15.846266 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:15.756064 16218 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:25:15.845899 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:15.847951 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:15.843107 12557 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:15.850970 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:15.851593 12552 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:15.852303 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:15.852807 13234 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:15.853092 13234 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:15.808087 16119 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.853773 13234 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:15.854671 13234 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:15.849974 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:15.848855 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:15.855746 16270 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.859789 12633 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:15.860163 16270 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.861943 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.862808 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.774143 16180 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:15.867909 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.869302 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:15.870807 13233 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:15.836129 16124 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:15.873912 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 157449us
I20260709 12:25:15.876703 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.822177 16217 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:15.770097 16111 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:25:15.884742 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.887115 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.942080 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.843923 16223 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.942349 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.942564 12627 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:15.945374 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:15.965456 12630 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:15.970069 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:15.971762 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 114858us
I20260709 12:25:15.840073 15906 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:25:15.978924 12629 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 9. Ops: []
I20260709 12:25:15.984129 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:15.862746 16094 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.987061 13233 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:15.872620 16239 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:15.875583 16215 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.991187 16203 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:15.994053 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:16.022765 13235 raft_consensus.cc:2410] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:15.994167 12598 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.024109 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.994766 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:15.996363 13227 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:15.997284 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:16.003878 16248 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.026154 15958 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.026873 15958 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.005295 16231 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.006814 13232 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:16.027899 16231 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.012405 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:16.005015 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:15.987792 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 116802us
I20260709 12:25:15.941563 16137 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.011610 16270 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.029256 12631 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:16.041927 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 192019us
W20260709 12:25:16.043322 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.030828 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.872292 16106 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.146s
I20260709 12:25:15.942040 16245 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:25:15.989272 16055 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:16.028581 16231 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.043318 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.025731 16094 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:15.963960 16168 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:25:16.020192 16239 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:15.972997 16223 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:15.966693 16124 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.080690 12674 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:16.083330 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 718) took 1500 ms. Trace:
W20260709 12:25:16.087752 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 57007.3us
I20260709 12:25:16.088490 15839 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:16.088742 16270 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:16.089378 16124 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:16.055423 16275 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.091221 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:15.980522 16217 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.103138 12631 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:16.087237 12704 rpcz_store.cc:276] 0709 12:25:14.583193 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.583330 (+   137us) service_pool.cc:224] Handling call
0709 12:25:14.583653 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:14.613730 (+ 30077us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.613779 (+    49us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:14.613842 (+    63us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:14.613889 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.083035 (+1469146us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54000fd2d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:16.083097 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.083261 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":68556544}
I20260709 12:25:16.109434 13226 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:16.077368 16055 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.076550 16094 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:16.133356 13234 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
W20260709 12:25:16.137388 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 260746us
I20260709 12:25:16.039336 16203 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.085896 16239 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.109185 16246 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:16.056746 16144 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260709 12:25:16.138437 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:16.161620 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 312847us
I20260709 12:25:16.172454 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.174935 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.090834 16270 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 12:25:16.178184 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.198791 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.198923 16137 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:16.199558 16137 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:16.180076 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.200057 16282 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:16.184955 16215 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:16.200508 16282 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.200781 16215 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.201370 16215 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.201900 16094 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.202950 16094 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:16.177524 16231 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.206070 16231 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:16.206530 16231 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:16.206684 16266 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:16.207233 16266 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:16.207355 16231 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.207765 16267 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.208302 16266 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.192390 16145 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:16.210505 16217 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.211076 16217 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:16.112656 16275 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.214572 16275 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.214826 16236 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:16.219287 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.219980 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.138422 16055 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.139062 16269 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260709 12:25:16.235615 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:16.238423 12556 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:16.114964 15958 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 12:25:16.245728 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.218851 16282 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:16.253578 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 145135us
I20260709 12:25:16.248126 12559 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:16.200700 16137 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.264544 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.265177 16137 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.177747 16281 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:16.160931 16268 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:25:16.140082 16108 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.097s
I20260709 12:25:16.227542 16111 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:25:16.277323 16281 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.297168 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.297763 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:16.277297 16203 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:16.275179 12556 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:16.164567 16180 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:16.268345 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.308640 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.236820 16266 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:16.277855 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 185842us
I20260709 12:25:16.299785 12555 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:16.306030 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:16.280280 16267 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:16.310988 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 111102us
W20260709 12:25:16.315713 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 135741us
I20260709 12:25:16.317080 12522 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.317739 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.319337 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:16.323115 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.323835 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.324234 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.324695 12555 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:16.324903 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:16.325843 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.296993 16236 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:16.328030 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.280450 15839 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:25:16.309504 16111 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:16.310849 15888 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:16.300676 16281 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.293931 16283 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:16.322029 16203 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:16.327410 16268 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.326434 16124 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:16.322564 16292 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:16.358623 16289 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.383056 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 857) took 1783 ms. Trace:
I20260709 12:25:16.387178 16200 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:16.390887 16270 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:16.391742 16219 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:16.376929 16217 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:16.412074 16244 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:16.413880 16119 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:16.418581 16245 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.361131 15888 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.421948 16231 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.431030 16286 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:16.432322 16277 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.264s	user 0.001s	sys 0.000s
I20260709 12:25:16.433175 16291 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:16.399049 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.378319 16124 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:16.377893 16223 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.289167 16285 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
W20260709 12:25:16.469971 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.472040 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 144043us
I20260709 12:25:16.363595 16215 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.422855 12626 rpcz_store.cc:276] 0709 12:25:14.599198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.599357 (+   159us) service_pool.cc:224] Handling call
0709 12:25:14.617859 (+ 18502us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:14.646584 (+ 28725us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:14.646721 (+   137us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:14.668500 (+ 21779us) log.cc:844] Serialized 52 byte log entry
0709 12:25:14.767175 (+ 98675us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:14.849585 (+ 82410us) log.cc:844] Serialized 14 byte log entry
0709 12:25:16.382399 (+1532814us) spinlock_profiling.cc:243] Waited 1.77 ms on lock 0x7b1800445360. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e946934bc 00007f0e919e148b 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fb455 00007f0e94ae3060 00007f0e94af5716 00007f0e94b06287
0709 12:25:16.382548 (+   149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.382648 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:16.382694 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:16.382803 (+   109us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:16.382986 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35780,"prepare.queue_time_us":126919,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":7250,"raft.queue_time_us":54625,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":22776,"spinlock_wait_cycles":4060928,"thread_start_us":136960,"threads_started":3,"wal-append.queue_time_us":216663,"wal-append.run_cpu_time_us":3428,"wal-append.run_wall_time_us":1397534}
I20260709 12:25:16.452389 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:16.476441 12704 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:16.381222 16203 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:16.428721 16210 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:16.455173 12554 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.454321 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.425559 16200 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:16.485627 12559 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:16.427806 16270 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:16.465802 12699 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:16.445391 16292 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:16.468990 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.473805 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.450112 16244 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:16.378970 16111 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.453845 15888 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.506271 12557 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:16.507820 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 183650us
W20260709 12:25:16.509569 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.469234 16124 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:16.514755 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.427511 16289 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.489234 16200 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.488840 15839 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.489967 16291 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:16.444520 16180 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.457942 16245 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.497393 16287 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:16.512804 16258 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.572388 16258 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.575656 12558 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:25:16.543380 16280 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.262s	user 0.004s	sys 0.000s
I20260709 12:25:16.543136 15839 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.551515 16111 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.558982 16289 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.535207 16233 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.518402 16210 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:16.512372 16144 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:16.562359 15804 consensus_meta.cc:287] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.838s	user 0.012s	sys 0.002s
I20260709 12:25:16.561932 16203 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.530041 16220 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:16.568653 16218 consensus_meta.cc:287] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.704s	user 0.007s	sys 0.001s
I20260709 12:25:16.568500 16239 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.569042 16287 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:16.571584 16222 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.954s	user 0.000s	sys 0.009s
W20260709 12:25:16.613708 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 139979us
I20260709 12:25:16.498287 16292 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.615468 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.598306 16246 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.632611 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.634598 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:16.624457 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.611059 16218 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 3. Current term is 4.
I20260709 12:25:16.578809 12554 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:16.533478 16291 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.599064 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.607082 15804 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.601835 16210 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:16.584138 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RunLeaderElection -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 53760.1us
I20260709 12:25:16.637885 16106 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.594379 16233 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.578079 16244 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.647574 16111 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:16.602366 16144 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.654743 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.637578 16054 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:16.639954 16289 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.615829 16222 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.645921 16291 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.648411 16094 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.668115 12558 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:16.680878 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:16.682278 12631 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:16.682849 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:16.698184 12628 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:16.607993 16220 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.700623 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:16.586488 16270 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.704211 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:16.746066 12701 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:16.651834 16106 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:16.734135 16305 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:25:16.680322 16244 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:16.735814 12558 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:16.736523 13234 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:16.734822 16299 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:25:16.654042 15823 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:25:16.677768 16308 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:16.738991 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:16.797730 13226 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:16.680007 16111 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:16.741214 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 52148us
I20260709 12:25:16.682782 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:16.806595 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 123880us
I20260709 12:25:16.640111 16246 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.705871 16215 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.748216 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:16.757284 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 148050us
I20260709 12:25:16.759708 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:16.770196 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 258623us
I20260709 12:25:16.816762 12708 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:16.697549 16055 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.775024 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:16.777578 16239 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.758786 16284 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:16.786928 12557 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 12:25:16.826687 12557 pending_rounds.cc:85] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 7
I20260709 12:25:16.826933 12557 pending_rounds.cc:107] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:25:16.827140 12557 raft_consensus.cc:2889] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:16.787215 12551 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:16.770773 16176 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.788646 16124 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.790580 16222 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.791090 16258 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.748579 16210 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.793737 16292 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:16.796265 16282 consensus_meta.cc:287] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.516s	user 0.005s	sys 0.002s
I20260709 12:25:16.704336 16094 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.798812 12699 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:16.799139 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:16.817374 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.872772 12552 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 12:25:16.830861 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 73811.9us
I20260709 12:25:16.831554 12705 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:16.863780 12700 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:16.810125 16054 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:16.830268 16285 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.875859 12551 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:16.876641 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 59333.1us
I20260709 12:25:16.888576 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:16.874262 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.889420 12522 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:16.892750 12556 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.016s	sys 0.016s
W20260709 12:25:16.893261 12556 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.016s	sys 0.017s
I20260709 12:25:16.894276 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:16.889385 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:16.898130 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 50638.8us
I20260709 12:25:16.895558 12557 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:16.841286 16137 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:25:16.899848 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:16.900419 16137 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:16.901108 16290 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:16.901521 16290 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:16.902285 16290 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.903193 16290 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:16.903616 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:16.904531 16223 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:16.905447 16223 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:16.906339 16223 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.903846 16137 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:25:16.907387 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:16.908968 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:16.909699 13232 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:16.910200 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:16.910663 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:16.911350 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:16.912483 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:16.913865 13228 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:16.915297 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.916481 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.916517 16137 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:16.906992 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:16.919778 16173 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:16.920351 16173 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.921623 16219 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:16.922640 16173 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.923199 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.924100 16180 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:16.925504 16206 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.924634 16180 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.926298 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:16.931736 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:16.825840 16289 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.062s
W20260709 12:25:16.948316 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.962908 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:16.886046 16234 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:16.825860 16302 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:25:16.893564 16258 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:16.809999 16308 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.970749 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:16.840883 16176 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.933670 16284 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:16.976776 16180 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:16.976997 16217 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:16.977675 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:16.978116 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:16.982263 16314 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:25:16.983940 16094 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.895157 16054 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.984661 16315 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 12:25:16.985697 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.003535 16217 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.011226 16055 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:17.011121 16284 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.992014 16246 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:16.999096 16258 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.016382 16258 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.017566 16310 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.018092 16310 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.020190 16310 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.021925 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.022603 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:17.023713 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:17.024744 16268 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.645s	user 0.010s	sys 0.000s
I20260709 12:25:17.025183 16268 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:17.026360 16176 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:17.026635 16304 log.cc:927] Time spent T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.346s	user 0.002s	sys 0.000s
I20260709 12:25:17.027209 16054 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.028766 16308 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.030014 16112 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:17.030576 16112 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:16.933444 16292 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:17.031716 16112 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.032743 16292 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.034345 16124 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:17.034902 16292 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.937882 16219 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:16.876590 16282 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:16.928460 16285 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:16.975350 16287 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.051614 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.024745 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:17.052971 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:16.997815 12708 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:17.053097 12706 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:17.054219 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:17.054788 12708 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:17.055521 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:16.961910 16206 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.015789 16220 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:16.897203 16222 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:16.936846 16281 consensus_meta.cc:287] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.564s	user 0.003s	sys 0.008s
I20260709 12:25:16.928021 16215 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.053192 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.080701 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.081103 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.064960 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:17.064427 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.071614 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:17.037379 16266 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.720s	user 0.007s	sys 0.001s
I20260709 12:25:17.076030 12632 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:17.058694 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:17.085901 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.087471 13234 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:17.089942 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:17.052618 16112 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.039552 16285 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:16.968633 16111 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.090801 12706 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:17.098703 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:17.104038 12632 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:17.039574 16282 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.050295 16219 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:17.111061 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.072033 16222 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:17.110289 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.113864 12630 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:17.085428 16239 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:17.080746 16318 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.123564 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.080547 16246 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.126058 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.128999 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.136502 13198 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:17.144316 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45780us
I20260709 12:25:17.146023 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:17.117641 16222 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.107352 16244 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.086211 16281 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.166486 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.183960 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.118676 16108 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:17.200044 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.143385 16094 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.152055 16302 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.152187 16285 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:17.208446 12703 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:17.118399 16291 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.180526 16124 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.152791 16246 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:17.226614 15888 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.709s	user 0.009s	sys 0.003s
I20260709 12:25:17.227027 16309 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.227546 16301 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:17.148594 16239 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:17.228785 16323 log.cc:927] Time spent T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:25:17.211584 16094 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:17.231819 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.286463 16282 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.287397 16210 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:17.290431 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48019us
I20260709 12:25:17.199900 16325 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.196934 16290 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.149199 16318 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:17.309535 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 220622us
I20260709 12:25:17.202821 16108 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.205543 16244 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:17.309880 16200 consensus_meta.cc:287] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.768s	user 0.015s	sys 0.002s
I20260709 12:25:17.238754 16302 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.313064 16301 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.309360 16320 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.289757 15888 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.348582 16301 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.348682 16310 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.243939 16219 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.336374 16282 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.341858 16290 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:17.369341 16329 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:17.372819 16291 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:17.338368 16210 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.382867 16337 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.356436 16320 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.376055 16302 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:17.376497 16327 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:17.383605 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38728 (request call id 2235) took 1545 ms. Trace:
I20260709 12:25:17.343297 16200 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.390314 12554 rpcz_store.cc:276] 0709 12:25:15.838511 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:15.838649 (+   138us) service_pool.cc:224] Handling call
0709 12:25:17.383428 (+1544779us) spinlock_profiling.cc:243] Waited 616 ms on lock 0x7b5400374954. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:17.383543 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415712512}
I20260709 12:25:17.336786 16309 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.402593 12631 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.410148 12631 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:17.420475 16281 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:17.367679 16310 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.372819 16222 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.426786 16290 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.427547 12553 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:17.428768 15888 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:17.429634 16318 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.432283 16310 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.432907 16246 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.339514 16325 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.433954 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.434767 16244 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.436023 16200 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.406370 16337 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.437762 16108 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.437037 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.438709 12631 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:17.443789 16325 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.445292 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.447052 12700 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:17.449096 12631 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.457396 15839 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.459924 16309 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.461200 16094 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.462056 12700 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.462527 16210 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.463550 16282 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.468400 12631 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:17.469686 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.475049 16222 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.475314 16258 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.477537 16106 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.478029 16245 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.478575 16215 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.481779 15823 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:17.504702 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.506044 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.507050 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.484879 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.507754 12550 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:17.484001 12554 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:17.486351 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:17.499428 12558 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.509271 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:17.500049 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.500917 12551 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:17.510421 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:17.501915 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.511765 16106 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.512737 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:17.516165 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.516659 16219 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.517601 16200 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.518015 13228 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:17.519114 16222 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:17.519027 16301 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:17.507298 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.520665 12627 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:25:17.521286 16301 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.506913 16217 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.519562 16222 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.522800 16222 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:17.523316 16217 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.529198 13231 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.531635 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.536568 16144 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.537755 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.499567 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2075) took 1028 ms. Trace:
I20260709 12:25:17.541903 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.542235 12553 rpcz_store.cc:276] 0709 12:25:16.471279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.493155 (+ 21876us) service_pool.cc:224] Handling call
0709 12:25:16.493563 (+   408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.427970 (+934407us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.499285 (+ 71315us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400102554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:17.499499 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2127412992}
I20260709 12:25:17.544116 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.545622 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.546201 12628 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:17.546958 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.547581 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:17.547891 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:17.548691 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.549021 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:17.502156 16239 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.516109 16106 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.549678 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:17.545640 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:17.551841 13228 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:17.554370 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.557926 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.582114 12555 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:17.584705 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:17.619733 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 82346.4us
W20260709 12:25:17.581629 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.594934 12632 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.624017 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.625756 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.603492 16320 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:17.631186 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.629673 16258 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:17.635783 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.589046 15888 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.550909 16286 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.110s
I20260709 12:25:17.603639 16231 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:17.642100 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.684491 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.708999 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.675527 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2007) took 1223 ms. Trace:
I20260709 12:25:17.590397 15804 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.551326 16200 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:17.724836 12632 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:17.925201 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.925401 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.722251 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.675020 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.711071 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.715161 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.645350 13231 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:17.776428 13226 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:17.929276 12558 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:17.766920 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46483.1us
I20260709 12:25:17.928124 12559 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:17.693019 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.676638 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.717768 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.926446 12703 rpcz_store.cc:276] 0709 12:25:16.452287 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.452442 (+   155us) service_pool.cc:224] Handling call
0709 12:25:16.452839 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:17.209323 (+756484us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.675174 (+465851us) spinlock_profiling.cc:243] Waited 755 ms on lock 0x7b540004f6d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:17.675447 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737193728}
I20260709 12:25:17.713716 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.637428 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.935503 12550 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:17.930842 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:17.936173 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 815) took 3356 ms (client timeout 1883 ms). Trace:
I20260709 12:25:17.760155 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:17.934791 13230 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:17.679585 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:17.938289 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 258801us
W20260709 12:25:17.939057 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 179023us
W20260709 12:25:17.711599 16331 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.403s	user 0.003s	sys 0.000s
I20260709 12:25:17.939152 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:17.939714 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:17.940331 16108 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.940864 16285 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.941323 15839 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:17.955047 12559 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:17.710513 16258 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.235s
I20260709 12:25:17.756495 15888 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:17.936921 13231 rpcz_store.cc:269] 0709 12:25:14.574466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.575151 (+   685us) service_pool.cc:224] Handling call
0709 12:25:15.549597 (+974446us) spinlock_profiling.cc:243] Waited 5.01 ms on lock 0x7b54004a2ca0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a62dc0 00007f0e94aeee18 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:16.636289 (+1086692us) spinlock_profiling.cc:243] Waited 78.7 ms on lock 0x7b18002f5380. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94b26646 00007f0e94a6058e 00007f0e94ae1f9e 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:25:17.233184 (+596895us) spinlock_profiling.cc:243] Waited 401 ms on lock 0x7b58005504d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:25:17.529021 (+295837us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b58005507d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:25:17.930770 (+401749us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1601568128}
W20260709 12:25:17.868124 16314 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:25:17.951364 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:17.952888 12551 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:17.929364 16173 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.931002 15823 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.926051 16231 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:17.929332 16200 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.955375 15839 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.960767 16246 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:17.956120 16269 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:17.712172 16293 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.243s
I20260709 12:25:17.638152 16222 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:17.775729 16144 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.181s
I20260709 12:25:17.718258 16292 consensus_queue.cc:1059] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.239s
I20260709 12:25:17.964912 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:17.758672 16045 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.196s
I20260709 12:25:17.968430 12597 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:17.969722 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2240) took 1601 ms. Trace:
I20260709 12:25:17.958246 16285 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.957628 16332 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:17.976655 16078 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.976677 16246 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:17.961239 16201 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:25:17.967149 16340 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:18.004058 16340 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.004520 16340 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.005599 16340 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.007084 16340 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.977774 15888 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:25:17.959240 16258 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 23740bafdb794232879a0bb6884f7a68 log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:17.967555 15839 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:18.009768 16311 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:18.010783 16315 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:18.011183 16315 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.012079 16315 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.964965 16223 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:18.013773 16223 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:18.014704 16223 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:18.015458 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.015808 16223 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:17.957331 16320 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 12:25:17.985707 12550 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:25:18.019716 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:18.020380 12550 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:17.967394 16215 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.975966 16200 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.022050 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:17.987823 12556 rpcz_store.cc:276] 0709 12:25:16.368755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.368912 (+   157us) service_pool.cc:224] Handling call
0709 12:25:16.369260 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.894851 (+525591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.894887 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.895290 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:25:17.084144 (+188854us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:17.084187 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.084285 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.711018 (+626733us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:17.967007 (+255989us) raft_consensus.cc:1685] finished
0709 12:25:17.967026 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.969645 (+  2619us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2876,"raft.queue_time_us":33399,"raft.run_cpu_time_us":53,"raft.run_wall_time_us":54,"spinlock_wait_cycles":6931328,"thread_start_us":710841,"threads_started":2,"wal-append.queue_time_us":312271}
I20260709 12:25:17.985072 16239 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:17.993976 16246 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:17.971120 15823 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.994362 15804 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:18.027559 13235 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:17.966236 16173 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:17.994886 16292 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:17.975270 16269 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.000885 16078 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.033694 12556 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:18.014730 16285 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.050944 16106 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.021049 16270 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:18.072216 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.027835 15804 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.071467 16106 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.031998 16292 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:18.077219 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 123124us
I20260709 12:25:18.050988 16203 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.034740 16269 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.036113 16355 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.024369 16231 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.032330 16217 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:25:18.030616 16239 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.088330 16292 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.096276 16203 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.110548 16222 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.111711 15839 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.136287 16203 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:18.077129 16246 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.138461 16246 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.140235 15839 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.095148 16355 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:18.142458 16355 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.143496 16355 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.118994 16106 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.120154 16239 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.087060 15804 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.121047 16248 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.148800 16248 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:25:18.126650 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 186778us
I20260709 12:25:18.129689 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:18.152170 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.134928 16078 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.155131 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:18.156241 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 738) took 1315 ms. Trace:
I20260709 12:25:18.156848 16302 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.157785 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:18.158408 13230 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:18.159770 16291 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.160264 16291 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.161616 16281 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.156662 12708 rpcz_store.cc:276] 0709 12:25:16.840517 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.063668 (+223151us) service_pool.cc:224] Handling call
0709 12:25:17.063897 (+   229us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.064070 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:17.297895 (+233825us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.350858 (+ 52963us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.626703 (+275845us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18002b2b80. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:18.016366 (+389663us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b18002b2b80. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe557 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:18.148999 (+132633us) spinlock_profiling.cc:243] Waited 977 us on lock 0x7b18002b2b80. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e91a00a40 00007f0e919fb4e4 00007f0e919fb455 00007f0e94ae3060 00007f0e94af5716 00007f0e94b06287 00007f0e94b06208
0709 12:25:18.149165 (+   166us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:18.149214 (+    49us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:18.149260 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.149325 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.156186 (+  6861us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10533,"prepare.queue_time_us":291629,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":813961,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":4357,"spinlock_wait_cycles":8974080,"thread_start_us":242426,"threads_started":2,"wal-append.queue_time_us":101854}
I20260709 12:25:18.162122 16281 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.162953 15823 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.164247 16281 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.166592 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:18.169180 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:18.169978 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.170809 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.171455 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:18.172313 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:18.153174 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.175781 12557 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:18.177692 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:18.179358 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.181232 12625 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:18.182065 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.183532 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:18.173226 16302 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.184072 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.184266 12552 raft_consensus.cc:2393] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:18.186853 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.189502 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.191574 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:18.192338 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:18.191112 16078 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:18.193594 16213 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.188902 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.199307 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.200630 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.222008 12600 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:18.192368 16203 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.194505 16213 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.258566 16213 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.261484 16245 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:18.196852 16201 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:18.263044 16201 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.263408 16201 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:18.268332 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.268884 16173 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.269690 16244 consensus_queue.cc:1059] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:18.270502 16244 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:18.197667 16356 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.075s
I20260709 12:25:18.271262 16244 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:18.272251 16244 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:18.197999 16293 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.272604 16244 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.273025 16293 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:18.293217 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.250588 16364 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:18.252612 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 99543us
I20260709 12:25:18.244588 16308 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.256618 16119 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.196570 16078 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:18.220357 16282 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.243348 15839 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.246073 16144 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:18.273567 16307 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:25:18.248009 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48784.5us
I20260709 12:25:18.277493 16108 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.278779 16246 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:18.279417 16311 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.279847 16258 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:18.280402 16245 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:18.283749 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.283829 16248 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.285594 16337 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.286243 16233 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.289619 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.291507 16217 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:18.291697 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:18.292799 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:18.258602 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 864) took 1185 ms. Trace:
I20260709 12:25:18.295500 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.296526 12551 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:18.296980 12554 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:18.299115 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.252205 16291 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:18.301832 12628 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12. Ops: [9.6-11.7]
I20260709 12:25:18.371979 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.301050 12558 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:18.305877 12629 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:18.374619 12555 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:18.197062 16302 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:18.301810 13199 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:18.376057 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 74326.6us
I20260709 12:25:18.376722 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:18.308410 12553 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:18.271275 15958 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:18.335752 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:18.344324 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.381634 12704 raft_consensus.cc:2410] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:18.371979 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:18.373128 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.334766 12707 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:18.328920 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:18.336303 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:18.349794 12674 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.298312 16293 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:18.365780 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.343247 16307 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:18.370633 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 71613.8us
I20260709 12:25:18.345685 16301 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:18.310266 16055 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.325098 16325 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.380292 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.345774 16112 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.325345 16144 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:18.346269 16282 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.388844 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:18.387172 12703 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:18.305048 16244 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.345618 16310 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.394776 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.311215 16308 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.355077 16245 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.407616 15839 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:18.407963 16337 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:18.358736 16106 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.390523 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.497149 15839 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:18.497310 16106 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.499728 16106 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.393136 16355 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.395279 15983 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:18.393865 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 44194.1us
I20260709 12:25:18.505249 15804 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.505987 16231 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.506587 16244 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:18.355861 16246 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.369719 12626 rpcz_store.cc:276] 0709 12:25:17.073324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.076414 (+  3090us) service_pool.cc:224] Handling call
0709 12:25:17.100764 (+ 24350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.426468 (+325704us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:17.426505 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:17.426560 (+    55us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:17.426595 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.258380 (+831785us) spinlock_profiling.cc:243] Waited 321 ms on lock 0x7b54002139d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:18.258422 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.258543 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":737785600}
I20260709 12:25:18.384085 16364 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:18.425010 16112 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.416997 16144 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:18.441609 16078 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.413064 16055 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:18.459321 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.460139 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:18.459435 16269 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:18.445773 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 51086.5us
W20260709 12:25:18.460868 16360 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:18.448048 16310 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.448427 16281 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:18.449033 16359 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
W20260709 12:25:18.443706 16353 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:25:18.394167 16217 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.358280 16258 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.359311 16311 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.356523 16108 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.402271 16302 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.483165 16286 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.483349 16215 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.483799 16213 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.568527 16223 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:18.412148 16301 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.420946 16325 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:18.492797 16363 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.254s	user 0.003s	sys 0.000s
I20260709 12:25:18.494572 16315 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:18.496001 16200 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.497792 15839 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.500756 15983 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:18.427155 12629 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.413353 16222 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.510727 16318 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.501345 16292 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.516062 16245 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:18.522117 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 140106us
I20260709 12:25:17.512437 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:18.526916 12455 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:18.560904 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46079.6us
I20260709 12:25:18.618273 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.619493 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.419907 16332 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:25:18.568315 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.420306 16321 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.145s
W20260709 12:25:18.583788 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 288889us
I20260709 12:25:18.559175 16267 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:18.590341 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:18.593593 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 202821us
I20260709 12:25:18.630422 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:18.484639 16282 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:18.592453 12628 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:18.596993 12632 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:18.598194 12633 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:18.613871 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2231) took 1701 ms. Trace:
I20260709 12:25:18.589148 16364 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.568064 16201 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.620810 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.632025 12629 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:18.614972 15983 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.638363 13229 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:18.640190 12627 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:18.631028 12634 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:18.596577 16215 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.634495 12702 rpcz_store.cc:276] 0709 12:25:16.912456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:17.434379 (+521923us) service_pool.cc:224] Handling call
0709 12:25:17.434737 (+   358us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:18.169341 (+734604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.169370 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.185420 (+ 16050us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.310888 (+125468us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:18.612918 (+302030us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.613185 (+   267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.613270 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.613321 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:18.613631 (+   310us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.613761 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":794655,"prepare.queue_time_us":275275,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":34,"raft.queue_time_us":744478,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":9601,"thread_start_us":377408,"threads_started":2,"wal-append.queue_time_us":260685}
I20260709 12:25:18.647127 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:18.653360 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:18.596727 16286 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.606580 16223 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.656632 12522 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:18.634613 16291 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:18.662647 12634 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:18.640908 16282 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:18.641157 16270 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.622207 16318 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.647789 16245 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:18.704492 12454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 323) took 20228 ms (client timeout 15000 ms). Trace:
W20260709 12:25:18.704900 12454 rpcz_store.cc:269] 0709 12:24:58.476264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.534314 (+ 58050us) service_pool.cc:224] Handling call
0709 12:25:18.704394 (+20170080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:13.057662 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:13.058316 (+   654us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:13.058365 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:25:13.058385 (+    20us) tablet.cc:662] Decoding operations
0709 12:25:13.059839 (+  1454us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:13.059921 (+    82us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:13.059949 (+    28us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:25:13.061248 (+  1299us) tablet.cc:701] Row locks acquired
0709 12:25:13.061295 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:25:13.072237 (+ 10942us) write_op.cc:270] Start()
0709 12:25:13.092287 (+ 20050us) write_op.cc:276] Timestamp: P: 1783599913063882 usec, L: 0
0709 12:25:13.098164 (+  5877us) op_driver.cc:348] REPLICATION: starting
0709 12:25:13.104093 (+  5929us) log.cc:844] Serialized 6531 byte log entry
0709 12:25:13.624769 (+520676us) op_driver.cc:464] REPLICATION: finished
0709 12:25:13.814371 (+189602us) write_op.cc:301] APPLY: starting
0709 12:25:13.814465 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:13.814759 (+   294us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:13.814892 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:13.882898 (+ 68006us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:13.883346 (+   448us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0709 12:25:13.883414 (+    68us) write_op.cc:312] APPLY: finished
0709 12:25:13.886989 (+  3575us) log.cc:844] Serialized 113 byte log entry
0709 12:25:13.887229 (+   240us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:13.887457 (+   228us) write_op.cc:454] Released schema lock
0709 12:25:13.887564 (+   107us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:14.042244 (+154680us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:14.046396 (+  4152us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27498,"reported_tablets":40,"child_traces":[["op",{"apply.queue_time_us":184365,"apply.run_cpu_time_us":5461,"apply.run_wall_time_us":101713,"num_ops":16,"prepare.queue_time_us":83923,"prepare.run_cpu_time_us":37234,"prepare.run_wall_time_us":225121,"raft.queue_time_us":201060,"raft.run_cpu_time_us":47802,"raft.run_wall_time_us":146815,"replication_time_us":526421,"thread_start_us":364227,"threads_started":4,"wal-append.queue_time_us":209491,"wal-append.run_cpu_time_us":15777,"wal-append.run_wall_time_us":1802339}]]}
I20260709 12:25:18.648589 16234 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:18.647583 16244 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.683898 16239 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:18.642274 16364 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.653702 15839 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.699321 16270 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.709933 12455 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:18.635754 16267 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:18.792882 16368 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260709 12:25:18.793568 16239 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:18.689945 16173 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.803654 16217 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.806444 16108 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.809739 16055 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:18.809970 16246 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.810714 16310 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:18.811306 16112 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:18.818828 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 162282us
I20260709 12:25:18.811687 16244 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.805199 16269 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:18.842422 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 274153us
I20260709 12:25:18.812100 16222 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:18.684438 16210 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:18.820236 16362 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:25:18.875538 12625 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:18.881114 12455 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:18.887692 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 268299us
I20260709 12:25:18.912402 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.890290 16292 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.902588 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.904850 16364 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.899343 16233 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:18.920691 12455 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 9, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:18.922722 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:18.947602 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45117.8us
I20260709 12:25:18.948455 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.909054 16248 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:18.972072 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:18.975567 16301 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.921332 16233 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:18.986476 16233 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:18.988108 16233 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.991036 16320 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.991786 16320 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.001214 16308 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.004606 16259 raft_consensus.cc:3055] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:18.972332 16267 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.020450 16144 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:18.952919 12704 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:18.926177 16364 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.953858 16384 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:19.044346 12626 raft_consensus.cc:1240] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:19.044207 16217 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:18.950228 16239 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.048244 16144 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.958173 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:19.054068 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 95974.3us
I20260709 12:25:19.054790 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:19.055717 16384 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.056380 16384 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:19.057675 12674 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.959298 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.058560 12708 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:18.962064 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2010) took 2149 ms. Trace:
I20260709 12:25:19.059578 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:19.060571 12632 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:19.059478 12701 rpcz_store.cc:276] 0709 12:25:16.812215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.812368 (+   153us) service_pool.cc:224] Handling call
0709 12:25:16.812739 (+   371us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:16.827020 (+ 14281us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:17.197871 (+370851us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.025774 (+827903us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b180048eda0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e946934bc 00007f0e919e148b 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a
0709 12:25:18.559743 (+533969us) log.cc:844] Serialized 14 byte log entry
0709 12:25:18.690193 (+130450us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.690744 (+   551us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.690882 (+   138us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:18.690916 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:18.690982 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:18.961763 (+270781us) raft_consensus.cc:1685] finished
0709 12:25:18.961793 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:18.961964 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":217005,"prepare.queue_time_us":798205,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":5482,"raft.queue_time_us":227122,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":34120,"spinlock_wait_cycles":6588672,"thread_start_us":840647,"threads_started":4,"wal-append.queue_time_us":538365,"wal-append.run_cpu_time_us":4782,"wal-append.run_wall_time_us":1006153}
I20260709 12:25:19.062631 12674 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:18.966207 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.066056 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.066496 12706 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.067909 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.068881 12628 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:18.966879 16244 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:18.967155 16213 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:25:19.059906 16301 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:18.967558 16310 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.908989 16222 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.069984 16301 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.070420 16222 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:18.958721 16112 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.072170 16301 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.073576 16245 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:19.074601 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.075129 16301 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.075619 16301 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.005235 16259 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:19.077649 16301 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:19.078172 12523 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.584s (SENT) [suppressed 13 similar messages]
I20260709 12:25:18.976905 15983 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.029699 16318 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.030253 16215 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.030759 16320 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.031229 16286 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.118942 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:18.952983 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.120716 12707 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:19.099680 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.126382 12699 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.031996 16258 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.032588 16307 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.035207 15839 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:19.020488 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.040729 16311 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.955502 16223 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:18.958825 16270 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.063577 16321 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.103255 16112 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:19.064054 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.101346 16302 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.001s
I20260709 12:25:19.064309 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.103214 15983 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.151082 16332 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.210803 13227 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:19.081012 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.082149 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.083197 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.083379 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.212190 12708 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:19.212738 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 131798us
I20260709 12:25:19.084841 12704 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:19.214665 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.215378 12704 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:19.216154 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.216343 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.201351 16307 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.087821 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.222029 12700 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
W20260709 12:25:19.089052 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.223127 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:19.223176 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.227793 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.231488 12699 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:19.233193 12630 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:19.233253 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.236726 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:19.234961 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.078810 16222 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.093225 16213 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.078315 16259 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.093629 16131 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.098850 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.273294 12627 raft_consensus.cc:2410] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:19.129557 12706 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:19.274194 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:19.274313 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.274847 12706 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:19.100262 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.092563 12632 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:19.108907 13229 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:19.098253 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.275622 12634 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:19.250804 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.275353 12628 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
W20260709 12:25:19.184592 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 65776.2us
I20260709 12:25:19.276322 12557 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:18.908840 16337 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.912042 16210 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:19.192804 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:19.290187 12556 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.221558 16320 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.291549 12708 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:19.201233 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:19.292799 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.293458 12559 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:19.293741 12708 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:19.063510 16209 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.099153 16245 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:19.093451 16217 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.202636 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:19.064374 16094 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.962692 16201 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:19.099274 16244 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:19.150291 16310 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:19.143712 16200 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.205006 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.344933 12629 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:19.056958 16293 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.202035 16223 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.927175 12455 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.217681 12702 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:19.217485 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:19.217371 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 139220us
I20260709 12:25:19.086374 12705 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:19.263144 12551 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.263926 13228 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:19.238232 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.322443 16245 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:19.347548 12700 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 4.
I20260709 12:25:19.208051 16302 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.342388 16259 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.362082 16215 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.362681 16215 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.353602 16223 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.367364 12455 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 4 to 5, term changed from 2 to 4, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4), VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3) evicted. New cstate: current_term: 4 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.347352 16112 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.370944 16112 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.270228 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:19.281117 16213 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.376468 16293 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:19.378295 16213 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.298146 16320 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.379350 16320 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.272946 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.326970 16209 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.276851 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:19.278764 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.278462 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:18.924650 16325 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:19.279907 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.383226 13226 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 4.
I20260709 12:25:19.189806 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:19.272939 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.279484 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:19.386731 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 107336us
I20260709 12:25:19.387753 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.261641 15983 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.298413 13199 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.037s	sys 0.104s
W20260709 12:25:19.388810 13199 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.037s	sys 0.105s
I20260709 12:25:19.348341 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:19.342515 16373 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.442s	user 0.001s	sys 0.001s
I20260709 12:25:19.394335 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.302683 12556 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:19.267530 16286 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.202561 16321 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.400193 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.314256 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.276183 16203 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:19.303640 16210 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.346079 12706 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:19.216897 16332 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.349826 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.353502 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.371083 16106 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:19.448079 13226 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:19.446056 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.452490 12700 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.455437 12551 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.373042 16112 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:19.336061 16217 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.391008 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.388640 16215 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.392380 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.479171 13232 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:19.479961 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.391803 12455 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 10, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 10 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.482204 12455 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.483980 12455 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:19.397567 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.299556 12708 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:19.400866 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52593.1us
I20260709 12:25:19.403687 12707 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:19.404441 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:19.489925 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.443059 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.490715 13230 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:19.239856 13227 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:25:19.442514 12705 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.303853 16337 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.406262 12704 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:19.445317 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.405467 15983 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.402894 16209 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.457628 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:19.401217 16078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.011s	sys 0.009s
I20260709 12:25:19.459640 16222 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.445217 16376 consensus_queue.cc:1059] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:19.467355 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 903) took 1172 ms. Trace:
I20260709 12:25:19.469669 16245 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.445732 16223 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.445484 16386 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:19.405856 16286 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.280772 16131 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.343443 16239 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:19.490211 13231 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.526930 16231 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:19.443894 12701 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:19.492054 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.495116 12455 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 4, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:19.560858 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.441097 16246 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.502637 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:19.472669 16200 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.504252 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.536284 16384 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.507242 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:19.571774 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 64597.6us
I20260709 12:25:19.344404 16244 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.511082 12699 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:19.515466 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.575793 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.521301 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.523728 16383 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.524125 16325 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:19.527976 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.529397 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:19.535223 12700 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:19.537120 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.580394 13229 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:19.537739 13234 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:19.487203 16215 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:19.518026 16078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.016s	sys 0.009s
W20260709 12:25:19.591058 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 63153us
W20260709 12:25:19.541615 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 323310us
I20260709 12:25:19.478077 16203 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.531137 12631 rpcz_store.cc:276] 0709 12:25:18.294644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:18.294835 (+   191us) service_pool.cc:224] Handling call
0709 12:25:18.305784 (+ 10949us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:18.306122 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:18.306169 (+    47us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:18.310522 (+  4353us) log.cc:844] Serialized 52 byte log entry
0709 12:25:18.595805 (+285283us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:19.013993 (+418188us) spinlock_profiling.cc:243] Waited 5.2 ms on lock 0x7b180015ea40. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e946934bc 00007f0e919e148b 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fb455 00007f0e984e33c7 00007f0e94af59a7 00007f0e94b050bf
0709 12:25:19.014191 (+   198us) log.cc:844] Serialized 14 byte log entry
0709 12:25:19.014404 (+   213us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:19.014493 (+    89us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:19.466984 (+452491us) raft_consensus.cc:1685] finished
0709 12:25:19.467096 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:19.467283 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1185,"prepare.queue_time_us":117773,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":58436,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":11762,"spinlock_wait_cycles":11963648,"thread_start_us":418096,"threads_started":2,"wal-append.queue_time_us":530751}
I20260709 12:25:19.567736 16200 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.505652 16310 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:19.613451 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 271621us
I20260709 12:25:19.491307 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.615367 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.616814 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.526261 16233 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:19.557554 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 199055us
I20260709 12:25:19.505120 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.618497 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.619179 12707 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.568684 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:19.621531 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.621861 12705 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.568845 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.626101 12701 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.560981 12455 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 3 to 8, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 8 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:19.620925 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:19.544492 16380 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:25:19.572976 12553 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.572453 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:19.589653 13231 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.567539 16246 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.540766 16094 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.560038 16231 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:19.648182 13228 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:19.559569 16386 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:19.571323 16245 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.601872 12626 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
W20260709 12:25:19.609549 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.574659 16111 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:19.632555 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.653208 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:19.577809 13233 raft_consensus.cc:2410] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:19.656615 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.657856 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.631405 12455 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 2 to 4, term changed from 5 to 6, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1), VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2), VOTER c6795b140b3247279a2231c6b9360d24 (127.11.32.3), VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:19.602718 16258 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:19.643886 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:19.641927 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 69541.2us
I20260709 12:25:19.566874 16239 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.618548 16200 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.673285 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:19.575805 16384 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.677064 13231 raft_consensus.cc:606] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.671828 12455 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 8, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 8 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:19.595729 16215 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.687150 12455 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:19.651306 16246 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.662284 16111 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.679881 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:19.648912 16223 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:19.692379 12455 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.694779 12455 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.661646 16302 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:19.590291 16383 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.704478 12699 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:19.705159 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 381967us
I20260709 12:25:19.671630 16258 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.676954 16124 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.676180 16281 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:19.708941 12703 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.648098 16233 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.663777 16222 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:25:19.691790 16403 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.715006 13198 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:19.717546 12707 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:19.739015 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.739303 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.740175 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.740975 12707 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:19.740857 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.662860 16094 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.697057 12455 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:19.734951 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:19.707401 16234 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:19.699235 16111 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:19.699842 16302 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.703917 16223 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:19.687564 16308 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:25:19.705772 16217 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.758782 16332 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.758105 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.761941 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:19.759011 12455 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.743388 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.778548 12699 raft_consensus.cc:2376] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9. Re-sending same reply.
I20260709 12:25:19.756297 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.779247 12707 raft_consensus.cc:2376] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9. Re-sending same reply.
I20260709 12:25:19.779510 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.779177 12455 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.715142 16258 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:19.781688 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 163388us
I20260709 12:25:19.757133 16124 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.778765 12705 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:19.783792 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.781018 12455 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.788836 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.788913 12455 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.791074 12455 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.760068 16337 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.765537 16302 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.759815 16234 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.795995 16318 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:19.724366 16325 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:25:19.722707 16310 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.745108 16321 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.796664 16222 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.830035 16401 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:19.797355 16106 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.798264 16239 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.853837 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.857033 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.857586 12559 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:19.798933 16384 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:19.799026 16286 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.800987 16215 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:19.801743 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 43745.8us
I20260709 12:25:19.734352 16386 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.766116 16403 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:19.807260 16201 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:19.808046 15983 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:19.809624 16307 consensus_meta.cc:287] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.574s	user 0.006s	sys 0.003s
I20260709 12:25:19.728725 16281 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.793561 12455 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.880693 12455 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.708508 16231 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.830044 16387 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.831589 16244 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.786559 16124 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:19.849937 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.898036 12551 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:19.899204 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.900190 12551 raft_consensus.cc:2393] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:19.850965 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.852727 12554 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:19.853379 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.786461 16217 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:19.856020 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.858075 12550 raft_consensus.cc:2410] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:19.803252 12598 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:19.829912 16234 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:19.905144 16231 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.914033 16383 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:19.879334 16213 consensus_queue.cc:1059] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:19.903331 16124 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.864289 12626 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:25:19.917882 12626 raft_consensus.cc:606] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.918236 12626 raft_consensus.cc:614] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:19.864853 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 124056us
I20260709 12:25:19.919684 16270 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.920095 16270 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:19.920475 16270 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.921732 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:19.865115 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.923631 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.924695 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.844385 16112 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:19.874989 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.847085 16401 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:19.925676 16112 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.926397 16401 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:19.926905 16415 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:19.927491 16415 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:19.861398 16106 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:19.882019 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 494293us
I20260709 12:25:19.928346 16415 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.890889 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.891324 12455 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:19.891310 15839 consensus_meta.cc:287] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.706s	user 0.006s	sys 0.006s
I20260709 12:25:19.930500 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.893101 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.933755 12558 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
W20260709 12:25:19.848865 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 238294us
W20260709 12:25:19.895478 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.864287 16131 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:19.872503 16201 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.900823 12556 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:19.901288 12554 pending_rounds.cc:85] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 7
I20260709 12:25:19.948527 12554 pending_rounds.cc:107] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:19.948793 12554 raft_consensus.cc:2889] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:19.905915 12555 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:19.906415 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.910260 16094 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.911381 16217 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.903816 12553 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:19.911726 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:19.959719 13235 raft_consensus.cc:2410] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:25:19.912716 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:19.925271 12559 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
W20260709 12:25:19.938357 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 135179us
I20260709 12:25:19.961112 12558 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:25:19.961643 12558 pending_rounds.cc:85] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 9
I20260709 12:25:19.961910 12558 pending_rounds.cc:107] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:19.962334 12558 raft_consensus.cc:2889] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:19.939699 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:19.940069 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.940521 12705 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:19.878535 16403 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:19.958321 16233 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:19.965344 16403 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:19.935025 12597 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:19.968664 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.968852 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:19.969515 12597 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:19.970009 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 95100.3us
I20260709 12:25:19.970525 12597 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.970670 13198 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:19.945278 13233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:19.946774 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.950120 12551 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:19.973274 13233 raft_consensus.cc:606] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:19.973654 13233 raft_consensus.cc:614] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:19.953291 16201 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:19.961959 12598 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.939538 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:19.983062 12700 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:19.975272 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:19.983909 12627 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:19.977208 12633 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:25:19.984624 12633 pending_rounds.cc:85] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 8
I20260709 12:25:19.958006 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:19.985013 12633 pending_rounds.cc:107] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:25:19.985260 12633 raft_consensus.cc:2889] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:19.979291 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:19.990867 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47212.3us
W20260709 12:25:19.990943 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44213.1us
I20260709 12:25:19.869199 16223 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:19.996814 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.000429 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.001318 12630 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
W20260709 12:25:20.003297 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.003845 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.004204 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.004874 12630 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:20.005275 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.006340 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:20.007820 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45998.5us
I20260709 12:25:20.008554 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:20.014521 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.016357 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.020707 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.021445 13231 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 10: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:20.024196 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:20.026068 16239 raft_consensus.cc:2764] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:20.026261 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.027170 16409 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:20.027724 16409 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.030619 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:19.984371 16267 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:19.984627 16404 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:19.996501 15839 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:19.985884 16106 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:19.991937 16387 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:19.997189 16355 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.014003 16045 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.004534 16233 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:20.050338 12632 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:19.996220 15983 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:20.043054 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.043231 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.055109 13229 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:20.004953 16215 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:19.996655 16376 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:20.022199 16293 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:20.018612 16337 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.029583 16321 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.038825 16404 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.041254 15839 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.036716 16408 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.030493 16286 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:25:20.046453 16111 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.053170 16045 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:20.146957 16407 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.193s	user 0.001s	sys 0.000s
I20260709 12:25:20.045526 16405 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:20.155325 16210 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.677s	user 0.011s	sys 0.000s
I20260709 12:25:20.054649 16078 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.029742 16413 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.126s
I20260709 12:25:20.152149 16409 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:20.188719 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 174312us
I20260709 12:25:20.045363 16355 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.056658 16318 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.115885 16387 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.171764 16301 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:20.049953 16106 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:20.057593 16215 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:20.151206 16320 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.771s	user 0.008s	sys 0.004s
I20260709 12:25:20.133772 16233 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:20.230067 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 207308us
I20260709 12:25:20.160115 15839 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.157195 16404 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:20.188199 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 179734us
I20260709 12:25:20.207230 13226 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:20.233192 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:20.233572 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 203050us
I20260709 12:25:20.234366 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.234616 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.235445 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.235939 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.163923 16408 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.189575 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.213536 12552 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:20.134582 16293 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.216477 16302 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.158349 16337 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.222201 16106 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.228933 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.229362 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.247958 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.248445 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:20.217304 16200 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.003s
I20260709 12:25:20.227618 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.206838 16246 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.190907 16210 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.212059 16355 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.217077 16387 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.211949 16318 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:20.216881 16258 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.245752 16307 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.221174 16301 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:20.242277 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.291168 12708 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:20.225004 16215 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.249008 12555 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:20.245626 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:20.291898 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49668.3us
W20260709 12:25:20.292435 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46893.1us
W20260709 12:25:20.292512 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 55858us
I20260709 12:25:20.293303 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.247282 12625 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:20.294050 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:20.251062 12705 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:20.218683 16217 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.256814 12706 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 5: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:20.240340 16409 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:25:20.241755 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52282.9us
I20260709 12:25:20.240228 16286 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.246068 16245 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.230515 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.241397 16408 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.242550 16386 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.261977 16387 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.268887 12630 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:20.314229 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.291141 16307 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.232802 16320 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.274533 16111 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.275055 16302 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.275200 16233 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.276638 16045 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.276932 16258 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.263721 16318 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.258133 16200 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.285799 16234 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.248813 16106 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.244545 16423 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:20.294453 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.335646 12625 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:20.294804 13234 raft_consensus.cc:606] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.304152 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.336462 12557 raft_consensus.cc:2368] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:20.336723 13234 raft_consensus.cc:614] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:20.338157 16423 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.307089 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.338349 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.338536 16234 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.315435 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.347854 12630 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:20.348798 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.349716 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.350133 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.351030 12630 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:20.348812 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.352186 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.271997 16208 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:20.304994 16418 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.300810 16422 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.313791 16384 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:20.286461 16201 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.313953 16386 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.317531 16307 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.383008 16144 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:20.383416 16144 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:20.384186 16144 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.323872 16270 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.386528 16270 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.386616 16267 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.333689 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.334998 16406 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:20.387570 16406 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:20.387923 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.339079 16286 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:20.388872 16286 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.388501 16406 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.389297 16286 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.389834 16406 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.338586 16423 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.391013 16423 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.391498 16337 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.339457 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.385115 16144 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:20.310078 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.339939 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.336495 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.570775 12625 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
W20260709 12:25:20.571368 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 261381us
I20260709 12:25:20.571797 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:20.346258 16112 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.346926 16203 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.350489 12628 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:20.317448 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.361280 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.373011 16201 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.373394 16386 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.615149 16337 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:20.578759 16308 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.615929 16308 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.615769 16337 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.616425 16308 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.618062 16337 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.618603 16337 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:20.619056 16337 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.611528 16270 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:20.620522 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.620325 16270 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.373026 16200 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.375108 16404 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.359825 16078 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.381081 16293 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.381526 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.328347 16210 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.623879 16376 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.628645 16376 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.387181 16267 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:20.629453 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:20.630241 13231 raft_consensus.cc:2368] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:20.630709 16376 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.389703 16246 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.394852 12550 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:20.314097 16416 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:20.631455 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:20.341045 16320 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:20.396638 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 57254.7us
I20260709 12:25:20.339849 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.551209 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.632977 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.508245 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2041) took 1047 ms. Trace:
I20260709 12:25:20.634038 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:20.634240 12708 rpcz_store.cc:276] 0709 12:25:19.460651 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.616531 (+155880us) service_pool.cc:224] Handling call
0709 12:25:20.508087 (+891556us) spinlock_profiling.cc:243] Waited 673 ms on lock 0x7b54003eadd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:20.508188 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1548972800}
I20260709 12:25:20.549530 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.635671 16404 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.635779 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.635914 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.625844 16078 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.636876 16045 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:20.637322 16045 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:20.637737 16045 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:20.553885 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.507349 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.639861 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.640583 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:20.641641 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:20.511742 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.642552 12701 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:20.509150 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2107) took 1258 ms. Trace:
I20260709 12:25:20.643555 12557 rpcz_store.cc:276] 0709 12:25:19.250653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.278176 (+ 27523us) service_pool.cc:224] Handling call
0709 12:25:20.508941 (+1230765us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b540018b854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:20.509087 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2171460352}
I20260709 12:25:20.506491 12707 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:20.494091 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.648134 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.650188 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.488715 16281 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.651229 16270 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.651830 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.483763 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.652377 12701 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.652878 12631 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:20.654878 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.655700 16423 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.526099 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:20.508282 16286 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.657338 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.658387 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:20.658923 13230 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.658958 16286 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.660550 12701 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:20.513868 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.509687 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.664186 13228 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:20.666298 16213 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.666529 16355 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.634012 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:20.672910 16423 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.649165 12557 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:20.673475 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:20.612746 16233 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:20.677577 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44680.1us
I20260709 12:25:20.677826 16233 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.678478 16427 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.678916 16427 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.679247 16427 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.679719 12631 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:20.680084 16233 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.668797 16355 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.680831 12631 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:20.367668 16301 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.545432 16244 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.547434 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.689405 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.689519 13198 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:20.689709 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 142364us
I20260709 12:25:20.691109 13199 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.565325 16215 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.536134 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:20.696452 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 160439us
I20260709 12:25:20.696666 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.697144 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:20.698043 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.698719 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.510224 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.510881 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.366907 16422 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.355438 16106 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.368865 16384 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.394052 16234 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.570441 12633 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:20.552604 16325 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.573822 16208 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.614166 12555 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:20.583962 16307 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.377599 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:20.622454 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:20.626434 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.627209 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.628072 16409 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.632587 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:20.639977 12703 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:20.757928 12557 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:20.360613 16418 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.678287 12522 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.569591 16387 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.570439 16321 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.682271 12559 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:20.681730 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.656054 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:20.770295 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.770591 12701 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:20.683504 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.516710 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:20.504015 16124 consensus_meta.cc:287] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.587s	user 0.009s	sys 0.000s
I20260709 12:25:20.394207 15839 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:20.691979 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 182361us
I20260709 12:25:20.692903 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:20.717190 16210 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:20.712458 16422 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.722841 16213 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.700457 13227 raft_consensus.cc:2393] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:20.699854 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.701581 12631 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.715096 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:20.717769 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 204002us
W20260709 12:25:20.719306 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:20.665202 16408 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.661060 16318 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.711546 16332 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 12:25:20.753309 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:20.729378 12633 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:25:20.723459 16384 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.759603 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:20.814908 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 55378.4us
I20260709 12:25:20.816634 12633 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:20.816746 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.752791 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:20.817776 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 65093.3us
I20260709 12:25:20.762976 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.770624 12629 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:20.712137 15983 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.713845 16404 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:20.711529 16112 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.695307 16364 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:20.718034 16416 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:20.694424 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:20.777983 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 99772.9us
I20260709 12:25:20.855593 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.711783 16173 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:20.694155 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.857506 12700 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:20.712966 16244 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.726235 16270 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.720808 16234 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:20.715916 16286 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:20.787959 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.788590 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.788863 12701 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:20.859102 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:20.790023 12634 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:20.790814 12632 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:20.791903 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 92109us
I20260709 12:25:20.870108 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.757424 16301 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.811169 12630 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:20.763948 16208 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.763528 16423 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:20.819311 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2033) took 1360 ms. Trace:
I20260709 12:25:20.821585 16246 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.822021 12625 raft_consensus.cc:2368] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:20.822889 12633 raft_consensus.cc:1240] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:20.826263 16215 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.826777 16376 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.773890 16418 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.725070 16386 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.837358 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.897259 13230 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:20.862417 16270 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.838343 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.844256 12627 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:20.802627 16405 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:20.801330 16380 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.872341 12600 leader_election.cc:400] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
W20260709 12:25:20.902491 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46151.5us
I20260709 12:25:20.883580 16233 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:20.897341 16246 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:20.909657 16106 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.771291 16409 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.834551 16404 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.913739 16404 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.914150 16387 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.888021 16112 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:20.891425 16337 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.885547 16286 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.918735 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:20.919061 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.770780 16325 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.839792 16402 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:20.782969 16124 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.890879 16376 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.883414 16320 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:20.849105 16429 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:20.892977 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 55257.1us
I20260709 12:25:20.893590 13226 raft_consensus.cc:606] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:20.935981 13226 raft_consensus.cc:614] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:20.895968 12632 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:20.838382 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:20.879395 16234 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.849874 16416 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:20.900163 13235 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:20.875478 16258 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.876946 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.906635 16233 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.812940 12703 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:20.883886 12707 rpcz_store.cc:276] 0709 12:25:19.458569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.780051 (+321482us) service_pool.cc:224] Handling call
0709 12:25:20.506249 (+726198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:20.645329 (+139080us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:20.819055 (+173726us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400460ad0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:20.819238 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669470592}
I20260709 12:25:20.920926 16402 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.875451 16388 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:25:20.902006 16270 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.913204 16409 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:20.963757 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 86903.2us
W20260709 12:25:20.964318 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 140244us
W20260709 12:25:20.977814 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 91195.3us
W20260709 12:25:20.931219 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 143285us
I20260709 12:25:20.968528 13233 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:20.968320 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:20.932695 16144 consensus_queue.cc:1059] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 12:25:20.934705 16376 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.927459 16405 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:20.979825 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:20.989820 12597 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:20.987851 16401 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:20.990326 16244 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:20.990648 16401 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:20.991359 16286 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.991573 16401 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.992313 15839 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:20.994611 16259 raft_consensus.cc:3055] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:20.995033 16259 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:20.995913 16259 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.963727 16201 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:20.998097 16441 log.cc:927] Time spent T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:20.997783 16201 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.000099 16201 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:20.970472 16233 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:20.984268 12522 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:20.916923 16364 consensus_queue.cc:1059] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 12:25:20.965167 16416 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.935078 16320 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.975486 16402 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:20.968302 15888 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:25:20.997195 16259 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:21.039273 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49560.2us
I20260709 12:25:21.056560 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:21.038872 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 65088us
I20260709 12:25:21.061676 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.062712 12707 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:21.062973 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.063898 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:21.064586 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:20.970732 16106 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:21.038812 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54647us
I20260709 12:25:21.064687 12699 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:20.960279 16429 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:20.970458 16258 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:20.983805 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:21.072424 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:20.997164 16234 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.040366 16307 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.086256 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.086949 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.087822 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.080747 12597 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:21.042042 16286 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:21.094412 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.067509 16106 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:21.186918 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.187608 12628 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.187896 12629 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:21.066705 15839 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:21.051399 16244 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.051997 16320 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.091885 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.092130 13230 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:21.037972 16447 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:21.164148 16223 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.094249 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.094744 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.067735 16321 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.188154 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.070505 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:21.242975 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 172578us
W20260709 12:25:21.209239 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 225537us
I20260709 12:25:21.092585 16246 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:21.211331 16443 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:25:21.215996 12628 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:21.251140 16321 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.251564 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.252333 12628 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:21.072968 16423 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:21.046286 16245 consensus_queue.cc:1059] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:21.254091 16245 raft_consensus.cc:3055] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:21.254058 16423 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.237107 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.076766 16200 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.144s
I20260709 12:25:21.093889 16286 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:21.257599 16286 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.258751 16429 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.206187 16106 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.249673 15839 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:21.249473 16223 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.254629 16245 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:21.188333 16408 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.085309 16387 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:21.223191 16045 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.585s	user 0.010s	sys 0.000s
I20260709 12:25:21.266247 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:21.256738 16270 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:21.241192 16308 consensus_meta.cc:287] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.624s	user 0.007s	sys 0.003s
I20260709 12:25:21.276607 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:21.279085 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:21.279119 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:21.281750 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.239126 16364 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:21.263172 16267 consensus_meta.cc:287] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.633s	user 0.000s	sys 0.008s
I20260709 12:25:21.243867 16112 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:21.307188 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:21.267326 16200 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.266978 15839 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.207558 16422 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.296753 16111 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:21.278389 16213 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:21.284101 16413 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:21.297112 16406 raft_consensus.cc:2764] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:21.298753 16208 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.278705 16045 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.303164 16386 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.315757 16447 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:21.333190 13227 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:21.325567 16111 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.319610 15839 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.300237 16281 consensus_queue.cc:1059] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:25:21.322679 16321 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:21.334729 16078 consensus_meta.cc:287] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.697s	user 0.003s	sys 0.007s
I20260709 12:25:21.322971 16200 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.206799 16405 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.328110 16215 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:21.329710 16124 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.336486 16413 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:21.308591 16267 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.310768 16448 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.041s
I20260709 12:25:21.304620 16308 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.344564 16078 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.362756 16045 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.442770 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.381829 16270 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.444347 13231 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.377910 16325 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.383637 16318 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.430382 12626 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:21.432901 16078 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.315927 16112 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.461658 16448 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:21.462627 16112 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.462515 16448 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.464578 16223 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.390753 16413 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.381709 16258 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:21.436246 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 129005us
W20260709 12:25:21.352548 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.435595 16233 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.377441 16234 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:21.427181 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.384407 16416 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.330940 16245 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:21.364953 16427 consensus_meta.cc:287] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.685s	user 0.002s	sys 0.006s
W20260709 12:25:21.428689 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 151961us
I20260709 12:25:21.365083 16286 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:21.385929 16445 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.459s	user 0.003s	sys 0.000s
I20260709 12:25:21.429666 16267 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:21.387008 16301 consensus_meta.cc:287] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.506s	user 0.010s	sys 0.001s
I20260709 12:25:21.454973 16458 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:21.518419 16458 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.519472 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 2112) took 1519 ms. Trace:
I20260709 12:25:21.520105 12627 rpcz_store.cc:276] 0709 12:25:19.999443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.339624 (+340181us) service_pool.cc:224] Handling call
0709 12:25:21.518850 (+1179226us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b5400130e54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.519207 (+   357us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":463322880}
I20260709 12:25:21.458072 16111 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.457863 16402 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.522459 12556 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:21.523553 16458 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.524386 16402 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.524756 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2433) took 1013 ms. Trace:
I20260709 12:25:21.525251 12632 rpcz_store.cc:276] 0709 12:25:20.510878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.641443 (+130565us) service_pool.cc:224] Handling call
0709 12:25:21.524393 (+882950us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54002134d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.524573 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341751680}
I20260709 12:25:21.526937 16203 raft_consensus.cc:993] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:21.527731 16203 raft_consensus.cc:1081] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:21.528954 16203 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:21.483369 16308 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.465380 16448 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.459180 16200 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.477651 16245 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:21.499461 16321 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:21.538095 16321 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.486402 12628 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:21.547079 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.548185 13232 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:21.549528 16321 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:21.490382 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.484378 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.486274 16258 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:21.489996 16234 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.486030 16408 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:21.491094 16223 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:21.485119 16416 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.478744 16427 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.491197 16233 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.562598 16258 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.563397 16234 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.564196 16427 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.469991 16422 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.525727 13234 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:21.482133 16286 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.531307 16210 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:21.567330 16210 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:21.561674 16223 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.569144 16210 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:21.570318 16418 consensus_meta.cc:287] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.666s	user 0.012s	sys 0.007s
I20260709 12:25:21.570704 16210 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.571000 16223 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.570861 16418 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.535490 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57436 (request call id 11) took 1186 ms. Trace:
I20260709 12:25:21.550532 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.557781 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.572268 12708 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:21.571816 13226 rpcz_store.cc:276] 0709 12:25:20.348727 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.348855 (+   128us) service_pool.cc:224] Handling call
0709 12:25:21.535036 (+1186181us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b540080acd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94ae5853 00007f0e99ab360a 00007f0e930397d4 00007f0e93039762 00007f0e93039691 00007f0e9303960c 00007f0e930388c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.535237 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":315489536}
I20260709 12:25:21.572666 13228 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:21.573205 16422 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:21.574004 16422 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.529363 16203 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:21.575845 16286 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:21.582209 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.584100 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.584823 12629 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.585762 16234 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.578902 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:21.586184 16203 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.586949 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.587718 16203 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:21.578812 13231 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:21.595593 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 292468us
I20260709 12:25:21.596436 16223 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:21.598141 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.566186 16258 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:21.600821 16376 consensus_meta.cc:287] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.600s	user 0.009s	sys 0.009s
I20260709 12:25:21.577342 16422 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:21.602538 16451 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.439s	user 0.004s	sys 0.000s
I20260709 12:25:21.604206 12671 leader_election.cc:400] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:21.606467 12671 leader_election.cc:403] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:21.611588 16418 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:21.617053 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.641882 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:21.643734 16259 consensus_meta.cc:287] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.574s	user 0.009s	sys 0.008s
I20260709 12:25:21.644565 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.645313 12628 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
W20260709 12:25:21.618032 16384 consensus_meta.cc:287] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.779s	user 0.020s	sys 0.000s
I20260709 12:25:21.618438 16320 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.646724 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:21.647718 16320 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.648155 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2044) took 1011 ms. Trace:
I20260709 12:25:21.575706 15839 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.651304 15839 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.652114 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.652251 12634 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:21.654152 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.654398 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.654868 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:21.656042 16404 consensus_meta.cc:287] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.742s	user 0.019s	sys 0.000s
W20260709 12:25:21.656808 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 52924.8us
I20260709 12:25:21.656664 16404 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.657737 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:21.658196 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2423) took 1347 ms. Trace:
I20260709 12:25:21.659036 16111 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:21.659895 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:21.660085 16111 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:21.661136 16111 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:21.658675 12626 rpcz_store.cc:276] 0709 12:25:20.310945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.338115 (+ 27170us) service_pool.cc:224] Handling call
0709 12:25:21.657989 (+1319874us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400343ad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.658138 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2508750592}
I20260709 12:25:21.619555 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.645764 13232 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:21.654946 12628 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:25:21.648579 12708 rpcz_store.cc:276] 0709 12:25:20.636662 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.639625 (+  2963us) service_pool.cc:224] Handling call
0709 12:25:21.647838 (+1008213us) spinlock_profiling.cc:243] Waited 931 ms on lock 0x7b54000fc654. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.648015 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2142129408}
I20260709 12:25:21.649129 16380 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:21.669872 16415 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.992s	user 0.011s	sys 0.015s
I20260709 12:25:21.670521 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:21.672659 16415 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.012s	sys 0.015s
I20260709 12:25:21.673391 16223 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:21.673800 16223 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:21.674775 16223 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.601310 16376 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.677598 12634 raft_consensus.cc:2393] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 5: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:21.648571 16320 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:21.678174 16320 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.678627 16320 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.678725 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.679437 12634 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:21.665149 16293 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:21.690279 12554 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:21.690429 16245 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:21.691591 12558 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:21.692036 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:21.692912 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2425) took 1374 ms. Trace:
I20260709 12:25:21.693388 12630 rpcz_store.cc:276] 0709 12:25:20.318223 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.351903 (+ 33680us) service_pool.cc:224] Handling call
0709 12:25:21.668282 (+1316379us) spinlock_profiling.cc:243] Waited 458 ms on lock 0x7b54003449d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.692694 (+ 24412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1053563264}
I20260709 12:25:21.693994 12629 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:21.700749 16460 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:21.700801 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.676304 16380 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:21.692142 12557 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:21.712479 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.712646 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:21.713166 16223 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:21.713740 16403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.010s	sys 0.013s
W20260709 12:25:21.714165 16403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.010s	sys 0.013s
I20260709 12:25:21.714985 16403 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:21.705147 16380 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.716485 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:21.716742 16380 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.719202 16337 raft_consensus.cc:3055] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:21.719650 16337 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:21.722375 13233 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 889) took 1702 ms (client timeout 1887 ms). Trace:
I20260709 12:25:21.722543 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2435) took 1187 ms. Trace:
W20260709 12:25:21.722862 13233 rpcz_store.cc:269] 0709 12:25:20.020082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.021062 (+   980us) service_pool.cc:224] Handling call
0709 12:25:21.721967 (+1700905us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54006f68d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.722142 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1522044672}
I20260709 12:25:21.724509 16460 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:21.724970 16460 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:21.662056 16111 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:21.726099 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:21.726312 16111 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.727142 12632 raft_consensus.cc:2410] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:21.734071 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:21.734907 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:21.735303 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:21.735636 12558 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.736004 12553 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:21.738646 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:21.738997 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:21.739475 12559 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:21.715495 16403 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:21.740705 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:21.741369 12559 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:21.741209 16403 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.742452 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 857) took 1233 ms. Trace:
I20260709 12:25:21.722955 12625 rpcz_store.cc:276] 0709 12:25:20.535318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.571496 (+ 36178us) service_pool.cc:224] Handling call
0709 12:25:21.722144 (+1150648us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b5400131354. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.722367 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":563161856}
I20260709 12:25:21.713332 12626 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:21.720768 16337 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.734937 12557 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:21.742820 13235 rpcz_store.cc:276] 0709 12:25:20.508971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.510654 (+  1683us) service_pool.cc:224] Handling call
0709 12:25:21.742108 (+1231454us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54007b93d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.742267 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":458164608}
I20260709 12:25:21.750872 12627 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:21.799551 12558 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:21.757346 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:21.786708 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:21.758790 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38728 (request call id 2276) took 1512 ms. Trace:
I20260709 12:25:21.787108 16337 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:21.804497 12556 rpcz_store.cc:276] 0709 12:25:20.246714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.381235 (+134521us) service_pool.cc:224] Handling call
0709 12:25:21.743935 (+1362700us) spinlock_profiling.cc:243] Waited 896 ms on lock 0x7b540035f554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.758692 (+ 14757us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2061657856}
W20260709 12:25:21.812218 16106 consensus_meta.cc:287] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.550s	user 0.003s	sys 0.014s
I20260709 12:25:21.815452 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.813911 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:21.706863 16384 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.788625 16320 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.823807 16320 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.826375 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.817867 16112 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.827227 12707 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:21.827883 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:21.827692 16112 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.828655 12703 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:21.829337 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.830240 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.830935 12703 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.827330 12701 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:21.833669 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:21.834013 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.834728 12701 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.834851 16112 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.835767 16409 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:21.817492 16245 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.836213 16409 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.836694 16409 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:21.836625 16245 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.835263 16422 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
W20260709 12:25:21.839421 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 95374.5us
I20260709 12:25:21.839866 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:21.841532 16245 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.841782 16444 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:21.841990 15888 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.820719 12628 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:21.833606 16416 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.819723 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:21.852118 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.726158 16460 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.852685 16404 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:21.853525 16310 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.017s	user 0.000s	sys 0.054s
I20260709 12:25:21.854274 16246 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:21.853653 16460 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:21.854387 16310 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.204s	user 0.000s	sys 0.055s
I20260709 12:25:21.862912 12702 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:21.864053 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:21.865911 16173 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:21.866459 16173 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:21.866878 16173 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:21.868453 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2023) took 2570 ms. Trace:
I20260709 12:25:21.865033 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:21.871218 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.868829 12702 rpcz_store.cc:276] 0709 12:25:19.297862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.347888 (+ 50026us) service_pool.cc:224] Handling call
0709 12:25:19.348188 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:21.863385 (+2515197us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:21.868179 (+  4794us) spinlock_profiling.cc:243] Waited 2.51 s on lock 0x7b54000d02d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:21.868378 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5782372096}
I20260709 12:25:21.871490 16376 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:21.871850 12700 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.872586 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.874958 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.875581 12702 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:21.877758 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.882030 12628 raft_consensus.cc:2368] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:21.815299 16106 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.882095 12553 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:21.882545 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.888476 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:21.842667 15888 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:21.892748 12558 raft_consensus.cc:2368] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:21.899880 12705 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:21.900952 12700 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:21.905056 12555 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:21.910624 16106 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:21.910903 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2043) took 1284 ms. Trace:
I20260709 12:25:21.911528 12705 rpcz_store.cc:276] 0709 12:25:20.626052 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:20.626189 (+   137us) service_pool.cc:224] Handling call
0709 12:25:21.910575 (+1284386us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b54000d07d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:21.910803 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2627892096}
I20260709 12:25:21.913908 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:21.918795 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:21.923264 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.913043 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:21.932121 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.933008 12555 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:21.934590 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46795.7us
W20260709 12:25:21.935063 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 65075.6us
I20260709 12:25:21.936286 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.934079 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:21.920295 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:21.944351 12703 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
W20260709 12:25:21.951937 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:21.956663 12556 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:21.957578 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:21.963104 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:21.965728 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 75721.4us
I20260709 12:25:21.961692 12708 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:21.889047 16416 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:21.972766 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:21.997031 16376 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:21.958570 16448 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:21.977013 16374 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:25:21.987370 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:21.988380 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:22.033277 13232 raft_consensus.cc:1813] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Handling vote request from an unknown peer c6795b140b3247279a2231c6b9360d24
I20260709 12:25:21.989795 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:22.032600 13233 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:22.035347 16270 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.035769 16416 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:22.036199 16469 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:25:22.036106 16270 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.036784 16374 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:22.037730 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.038157 13232 raft_consensus.cc:2410] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:25:21.989892 12625 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:22.039759 12553 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:22.037245 16374 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:21.993176 15888 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:21.994655 16402 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:21.997681 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49553.4us
I20260709 12:25:21.998567 12632 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:22.043963 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.000025 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.001760 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:22.003051 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.004452 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.007085 12455 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 222) took 8881 ms. Trace:
I20260709 12:25:22.014007 16310 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.014510 13198 leader_election.cc:400] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:22.047994 13198 leader_election.cc:403] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:22.015843 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:22.015556 12456 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 6, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:21.973762 12628 raft_consensus.cc:2393] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:22.007083 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.050071 12552 raft_consensus.cc:2368] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:22.050375 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:22.025803 12701 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:22.025803 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 67153.6us
I20260709 12:25:22.032608 12704 raft_consensus.cc:2410] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 11 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
W20260709 12:25:22.042088 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.052850 12707 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:22.048106 16448 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.054368 16402 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:22.055275 12671 connection.cc:256] RPC call timeout handler was delayed by -1.23837239400018s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1819s for a response
I20260709 12:25:22.055832 16310 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.056728 12629 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:22.047392 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:22.056802 16402 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:22.058682 12699 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:22.058588 12456 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.078806 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.060083 16409 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.061401 16270 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.062153 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:22.085140 13232 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:22.062887 16374 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.065426 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.048290 16376 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:22.065989 13233 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:22.067862 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.068410 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.069900 12552 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:22.070287 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.071341 16384 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:22.097326 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:22.098488 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:22.071420 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:22.059844 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 45555.8us
I20260709 12:25:22.079686 12701 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:22.082966 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:22.100538 13234 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:22.100931 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:22.103873 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.107331 12597 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:22.053581 12627 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:22.065841 16201 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.110045 12559 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:22.084446 16223 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:22.101608 12456 catalog_manager.cc:5697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.117712 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:22.117997 12699 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:22.118573 13227 raft_consensus.cc:2368] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:25:22.119043 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.119822 12699 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.120362 16409 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:22.121659 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.122442 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:22.122946 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.124162 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.125252 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:22.125536 16223 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.118016 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.126230 12631 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:22.128508 12634 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:22.087342 12705 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:22.057220 16448 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.099150 13231 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.084110 16416 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.135301 12702 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:22.138499 13199 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:22.140244 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:22.088649 16112 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:22.136415 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:22.106220 16270 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:22.145967 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:22.145838 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:22.142473 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:22.150876 12625 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:22.126207 16223 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:22.149150 12555 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:22.158938 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.078154 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:22.131705 16337 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:22.168454 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.168457 13230 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:22.169103 16332 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:22.171139 16173 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.152128 16270 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.193463 16270 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:22.172066 16112 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.174069 12633 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:22.174682 12626 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:22.178449 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:22.177560 16374 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.046974 12455 rpcz_store.cc:276] 0709 12:25:13.125473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:13.125671 (+   198us) service_pool.cc:224] Handling call
0709 12:25:13.638430 (+512759us) spinlock_profiling.cc:243] Waited 104 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a55090 00007f0e94af3f3a 00007f0e9a8a9e9c 00007f0e9a9a804e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc 00007f0e98e68392 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:22.006309 (+8367879us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:20.362465 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:20.362878 (+   413us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:20.362907 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:25:20.362919 (+    12us) tablet.cc:662] Decoding operations
0709 12:25:20.364218 (+  1299us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:20.364282 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:20.364300 (+    18us) tablet.cc:685] Acquiring locks for 25 operations
0709 12:25:20.365639 (+  1339us) tablet.cc:701] Row locks acquired
0709 12:25:20.365653 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:25:20.365768 (+   115us) write_op.cc:270] Start()
0709 12:25:20.365865 (+    97us) write_op.cc:276] Timestamp: P: 1783599920365732 usec, L: 0
0709 12:25:20.365880 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 12:25:20.427132 (+ 61252us) log.cc:844] Serialized 9640 byte log entry
0709 12:25:21.091963 (+664831us) op_driver.cc:464] REPLICATION: finished
0709 12:25:21.381108 (+289145us) write_op.cc:301] APPLY: starting
0709 12:25:21.388485 (+  7377us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:21.394232 (+  5747us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:21.394399 (+   167us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:21.487139 (+ 92740us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:21.487870 (+   731us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=25
0709 12:25:21.487955 (+    85us) write_op.cc:312] APPLY: finished
0709 12:25:21.489106 (+  1151us) log.cc:844] Serialized 170 byte log entry
0709 12:25:21.493917 (+  4811us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.494730 (+   813us) write_op.cc:454] Released schema lock
0709 12:25:21.494849 (+   119us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:21.495824 (+   975us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.495880 (+    56us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1379831,"reported_tablets":32,"spinlock_wait_cycles":239749248,"child_traces":[["op",{"apply.queue_time_us":278521,"apply.run_cpu_time_us":8449,"apply.run_wall_time_us":117236,"num_ops":25,"prepare.queue_time_us":314889,"prepare.run_cpu_time_us":185807,"prepare.run_wall_time_us":476738,"raft.queue_time_us":53896,"raft.run_cpu_time_us":73044,"raft.run_wall_time_us":240112,"replication_time_us":725962,"thread_start_us":899098,"threads_started":4,"wal-append.queue_time_us":423923}]]}
I20260709 12:25:22.177663 12701 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
W20260709 12:25:22.185112 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46743.9us
I20260709 12:25:22.163028 13229 raft_consensus.cc:606] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:22.185382 12700 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:22.147670 16448 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:22.192807 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 115970us
I20260709 12:25:22.198215 12705 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:22.217607 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.146795 16444 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:25:22.228116 12699 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:22.230700 12705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:22.236265 12705 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:22.236748 12705 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.231338 12703 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:22.234288 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.238533 12554 raft_consensus.cc:2410] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:22.186180 16337 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.238463 12456 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 5 to 7, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.148257 16416 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.234565 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.158646 16320 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260709 12:25:22.247756 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.189476 16384 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.268579 12704 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:22.225471 15888 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:22.262419 16422 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:22.275993 12456 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 1 to 3, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 3 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.276749 16446 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:22.277895 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52779.2us
W20260709 12:25:22.286768 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 52012.3us
I20260709 12:25:22.287811 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:22.289678 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 63131.8us
I20260709 12:25:22.297991 13201 leader_election.cc:400] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
W20260709 12:25:22.298159 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50483.6us
I20260709 12:25:22.298544 13201 leader_election.cc:403] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:22.299006 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.299679 12629 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:22.294143 16293 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.263609 16337 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:22.248458 16380 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:22.263428 16111 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:22.245114 16246 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:22.305917 12705 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.304072 16293 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.312762 15839 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:22.294329 16446 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:22.313279 16173 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:22.314325 16310 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.294651 16245 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:22.234963 16448 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.328704 12625 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:22.341058 12705 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.343638 12700 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:22.317549 16111 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:22.354528 16470 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260709 12:25:22.334046 16446 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:22.316167 16422 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.357565 16217 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:22.319157 16409 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:22.346926 15839 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:22.310309 16384 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.358706 16173 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.359098 16094 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.147s
I20260709 12:25:22.360141 16106 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:22.361562 12700 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:25:22.365769 16448 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.373764 16310 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:22.387393 16111 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.376853 16112 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:22.377118 16418 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.377738 16245 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.342111 16402 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:22.289513 16376 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:22.381364 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.390282 12703 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:22.381228 12701 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:22.409911 16460 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.407820 12456 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 7 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:25:22.375336 16472 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:22.407269 12700 pending_rounds.cc:85] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 6
I20260709 12:25:22.385125 16416 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.407102 16173 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.340615 16380 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.395985 13231 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:22.406005 16217 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:22.469009 12705 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:22.414768 16409 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:22.410804 16106 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.482295 12700 pending_rounds.cc:107] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:22.491782 12700 raft_consensus.cc:2889] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:22.491161 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 192225us
I20260709 12:25:22.497167 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.473276 16448 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:22.414513 16246 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.514997 16209 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:22.516278 16217 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.519174 16112 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:22.519639 16112 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:22.520604 16112 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.521552 15839 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.534962 16112 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.501168 16448 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:22.487217 16460 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:22.545502 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 367176us
W20260709 12:25:22.543809 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.551838 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.541807 16293 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:22.544284 16332 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:22.561861 16094 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:22.562249 16320 consensus_queue.cc:1243] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer a2a8d71f644447218c1afc3e5f7716cd log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:22.566126 15888 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:22.576085 16094 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:22.594388 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 292945us
I20260709 12:25:22.580260 16422 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:22.597575 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 295514us
I20260709 12:25:22.583621 16293 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:22.602097 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:22.589367 16384 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.616758 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.573604 16409 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:22.626052 12523 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.013s	sys 0.038s
I20260709 12:25:22.627175 16460 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.584331 16448 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.703019 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:22.715158 12523 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.016s	sys 0.038s
W20260709 12:25:22.699937 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 202817us
W20260709 12:25:22.629262 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 345915us
W20260709 12:25:22.636024 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 70484.1us
I20260709 12:25:22.645121 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:22.717013 12632 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:22.665351 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.716229 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.664444 12556 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:22.629493 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 280132us
I20260709 12:25:22.607615 16403 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:22.664958 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.665617 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.664922 12550 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:22.665810 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:22.702376 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 102506us
W20260709 12:25:22.715662 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 667054us
I20260709 12:25:22.650616 12554 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:22.649920 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.727706 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.728657 12704 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:22.610106 16380 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.730523 12558 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:22.744675 12522 leader_election.cc:400] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:25:22.745141 12522 leader_election.cc:403] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:25:22.665115 16468 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:22.747362 12671 leader_election.cc:400] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
W20260709 12:25:22.631083 16201 consensus_meta.cc:287] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.001s
W20260709 12:25:22.647300 16471 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:25:22.636909 16217 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.751711 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.753309 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.750562 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:22.759128 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.759840 12552 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:22.643898 16491 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.666105 16422 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:22.629159 16337 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.762321 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.643692 16246 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:22.701916 16293 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:22.650975 16480 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:22.657986 16173 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:22.657616 16106 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:22.763979 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47149.7us
W20260709 12:25:22.750125 16482 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:25:22.730839 16403 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:22.768842 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:22.774796 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.758921 16201 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
W20260709 12:25:22.775847 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 59700.1us
I20260709 12:25:22.635401 16223 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.721330 16270 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.765714 16448 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:22.799868 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:22.797799 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.800799 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:22.793210 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.803763 16494 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:22.804083 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:22.804606 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:22.773351 16484 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:22.854998 12555 raft_consensus.cc:1813] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Handling vote request from an unknown peer c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.805910 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:22.858791 12555 raft_consensus.cc:2393] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 5: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:22.662601 16094 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:22.861774 13229 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 6: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:22.775522 16380 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:22.858271 12552 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
W20260709 12:25:22.868978 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 75848.9us
I20260709 12:25:22.865706 12559 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:22.641314 15888 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.800017 16480 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:22.874377 16418 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:22.879573 16418 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:22.879943 16418 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:22.881191 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.873478 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.875077 12628 raft_consensus.cc:2393] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:22.875778 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.767958 16209 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.088s
I20260709 12:25:22.874133 16094 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.874207 16376 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:22.780222 16217 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.633599 16332 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:22.896314 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 104762us
I20260709 12:25:22.880008 16480 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.864419 16484 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:22.774984 16489 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:25:22.883487 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:22.805511 16497 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:22.910365 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.874505 16380 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:22.911087 15839 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:22.914122 16106 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:22.915223 16217 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:22.905189 16246 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.929451 16293 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:22.933775 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 65741.3us
I20260709 12:25:22.935802 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.775796 16491 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.924048 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:22.945430 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.915634 16270 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:22.940812 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 164347us
I20260709 12:25:22.944118 12632 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:22.945307 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:22.953359 13235 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:22.908269 16484 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:22.918915 16376 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:22.956658 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.957660 12558 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:22.926282 16380 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:22.963558 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 786) took 1105 ms. Trace:
I20260709 12:25:22.961665 13230 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:22.967012 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:22.969099 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:22.969765 16495 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:25:22.973587 16374 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:22.964118 12707 rpcz_store.cc:276] 0709 12:25:21.857856 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.175933 (+318077us) service_pool.cc:224] Handling call
0709 12:25:22.176375 (+   442us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:22.214644 (+ 38269us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:22.214676 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:22.215350 (+   674us) log.cc:844] Serialized 52 byte log entry
0709 12:25:22.263097 (+ 47747us) spinlock_profiling.cc:243] Waited 2.76 ms on lock 0x7b18002b2ee0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b0d1 00007f0e94aa6a0f
0709 12:25:22.552676 (+289579us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:22.552718 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:22.552789 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:22.954492 (+401703us) raft_consensus.cc:1685] finished
0709 12:25:22.954510 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:22.963471 (+  8961us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27317,"raft.queue_time_us":35684,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":16884,"spinlock_wait_cycles":6350080,"thread_start_us":289366,"threads_started":1,"wal-append.queue_time_us":410251}
I20260709 12:25:22.977926 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:22.993757 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:22.929522 16246 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:22.996363 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:22.996405 12559 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:23.001214 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:23.004640 12552 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:23.005287 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:22.986579 16111 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.004s
I20260709 12:25:22.987711 16489 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:22.987468 16112 raft_consensus.cc:2764] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:25:22.992329 16209 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:22.937580 16403 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.016356 16246 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.018095 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:23.018831 16479 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:25:23.020095 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:23.026043 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:22.996568 15839 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:23.049100 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 113600us
I20260709 12:25:23.048996 13232 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:23.052358 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:23.031418 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:23.054136 13230 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:23.057046 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:23.069803 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 143750us
I20260709 12:25:22.994643 16384 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:22.992620 16460 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:25:23.010860 16337 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:23.077214 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 168859us
I20260709 12:25:23.032894 16310 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.081465 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:23.050127 15839 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:22.999454 16416 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:25:23.085553 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:23.087973 13226 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:23.011355 16111 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.097908 12707 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:23.077217 16479 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:23.103787 16416 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:23.112637 16422 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.113444 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:23.113754 16409 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.114979 12626 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:23.115569 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.117547 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.118070 12627 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: [10.12-10.12]
W20260709 12:25:23.119837 16500 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:25:23.119985 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.087925 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:23.120729 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.088478 15888 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:23.172026 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.121580 16418 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.122099 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.141510 16403 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.157948 12632 raft_consensus.cc:1813] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Handling vote request from an unknown peer c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.196695 12632 raft_consensus.cc:2368] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:25:23.197846 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.147197 13234 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:23.090104 15839 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:23.094296 16337 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.121452 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.170292 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.204831 12630 raft_consensus.cc:2393] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:23.204962 12626 raft_consensus.cc:2410] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260709 12:25:23.175316 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 89896.5us
I20260709 12:25:23.178241 12634 raft_consensus.cc:2393] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:23.179009 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.206174 12627 raft_consensus.cc:2410] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
W20260709 12:25:23.140547 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 116299us
I20260709 12:25:23.071873 16376 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.144585 16422 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.142632 16416 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:23.211055 12706 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.143333 16479 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:23.168589 16506 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.204120 16270 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:23.227901 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:23.225620 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 97721.3us
I20260709 12:25:23.228961 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:23.229543 12703 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:23.230206 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:23.213215 16497 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:23.215751 16422 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.227217 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:23.232738 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:23.226123 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.247277 12707 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.183413 16409 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.211082 16337 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.239789 13230 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:23.240245 13235 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:23.242233 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.242491 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 949) took 1115 ms. Trace:
I20260709 12:25:23.194414 15888 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.228576 16506 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:23.254446 16418 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.275189 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.279613 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.280319 12626 raft_consensus.cc:2368] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:25:23.279934 16484 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.279757 16111 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:23.250866 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.276237 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.287700 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.286688 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:23.285061 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 62188.9us
I20260709 12:25:23.275771 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.294093 12706 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:23.281364 12626 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:23.310285 13233 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:23.254534 12600 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.257422 12702 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:23.282366 12631 raft_consensus.cc:2368] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:23.309559 12552 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
W20260709 12:25:23.492431 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.487861 16510 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.666220 16510 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.408429 16504 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:23.368690 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 122451us
W20260709 12:25:23.631498 13226 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.008s	sys 0.007s
I20260709 12:25:23.282949 16409 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.285640 16460 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:23.254413 16497 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:23.670316 16460 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.386855 12707 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:23.290455 16094 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:23.670826 16497 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.664887 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:23.328774 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:23.300998 12628 rpcz_store.cc:276] 0709 12:25:22.127286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.127402 (+   116us) service_pool.cc:224] Handling call
0709 12:25:23.242344 (+1114942us) spinlock_profiling.cc:243] Waited 729 ms on lock 0x7b540021f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:23.242445 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1676291456}
W20260709 12:25:23.669616 13226 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.008s	sys 0.007s
W20260709 12:25:23.664499 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 332702us
I20260709 12:25:23.675400 12671 leader_election.cc:400] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:25:23.675776 12671 leader_election.cc:403] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:23.572111 15839 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:23.603685 16448 consensus_meta.cc:287] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.739s	user 0.010s	sys 0.000s
I20260709 12:25:23.307562 12634 raft_consensus.cc:2368] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13.
I20260709 12:25:23.485780 16380 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:23.272445 16508 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 12:25:23.391484 12629 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:23.671530 16094 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:23.673487 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 344793us
I20260709 12:25:23.684617 12523 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.672144 12600 leader_election.cc:400] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:23.246274 16491 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.677935 12708 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:23.681605 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:23.681563 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:23.427222 16515 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:25:23.674062 15888 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.692080 12630 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:23.428437 16513 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:25:23.549041 16446 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 1.139s	user 0.009s	sys 0.003s
I20260709 12:25:23.281514 16337 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.639978 16404 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:23.635396 16403 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:23.249892 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet d9812250f15d4075a3c8831ca5f3ed41 with delete_type TABLET_DATA_TOMBSTONED (TS c6795b140b3247279a2231c6b9360d24 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:45128
W20260709 12:25:23.682947 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.245622 16270 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.683573 16409 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.670327 16484 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.668668 16510 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.684171 16310 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.670928 16460 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.699172 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:23.699644 16519 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.742628 16519 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.742651 16310 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:23.700407 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:23.702229 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:23.710011 16483 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.409973 16506 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.721619 16404 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.723978 16446 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.737922 16478 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.688311 16448 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.691835 16293 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:23.793744 16293 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:23.794361 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 952) took 1175 ms. Trace:
I20260709 12:25:23.794967 16293 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.795773 16519 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.797623 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:23.797811 16404 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.798202 12704 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:23.288210 16416 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.798416 16404 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:23.798905 16404 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.799281 16404 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.750635 13198 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:23.802254 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 114445us
W20260709 12:25:23.803007 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 57185.4us
I20260709 12:25:23.803046 13199 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:23.803902 16519 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:23.804586 16480 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:23.753031 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:23.805061 16480 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.805449 16480 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:23.725375 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 53357.9us
I20260709 12:25:23.738519 16409 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:23.814399 16409 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.814607 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:25:23.774331 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 89766.7us
W20260709 12:25:23.780354 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 98864.7us
I20260709 12:25:23.785995 16310 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:23.822118 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 88373.4us
I20260709 12:25:23.836733 12597 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:23.787865 16446 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.788394 13231 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:23.789027 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:23.842792 12700 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.738667 16403 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.329632 16479 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.790194 16478 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:23.745823 16376 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:23.691509 16491 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:23.794770 12625 rpcz_store.cc:276] 0709 12:25:22.618677 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.620409 (+  1732us) service_pool.cc:224] Handling call
0709 12:25:22.620798 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:22.665833 (+ 45035us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:22.773393 (+107560us) log.cc:844] Serialized 14 byte log entry
0709 12:25:22.997614 (+224221us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:23.234657 (+237043us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b2c00000238. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:25:23.235151 (+   494us) log.cc:844] Serialized 26 byte log entry
0709 12:25:23.235287 (+   136us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:23.235326 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:23.235395 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:23.794081 (+558686us) raft_consensus.cc:1685] finished
0709 12:25:23.794171 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:23.794289 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35817,"prepare.queue_time_us":257937,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":2324,"raft.queue_time_us":95249,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":37553,"spinlock_wait_cycles":4501888,"thread_start_us":221911,"threads_started":2,"wal-append.queue_time_us":292402}
I20260709 12:25:23.820791 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.756270 16402 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:23.858098 16402 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:23.859571 16402 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.843662 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:23.836325 16422 consensus_meta.cc:287] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.527s	user 0.009s	sys 0.003s
I20260709 12:25:23.861718 16422 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.862668 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:23.864368 16422 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.864499 12671 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:23.867408 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.879417 12633 raft_consensus.cc:2368] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10.
I20260709 12:25:23.853713 16483 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:23.883364 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 62648.5us
I20260709 12:25:23.899060 12523 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.899314 12700 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:23.900771 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:23.866376 16422 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:23.857496 16527 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:23.904269 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:23.856003 16418 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:25:23.885617 16526 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:23.908869 12598 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:23.913743 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 99268.6us
I20260709 12:25:23.902130 16310 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:23.916911 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:23.918646 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:23.877616 16491 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.909844 16380 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.911857 15888 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:23.898543 16483 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.944321 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:23.931078 16310 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.945497 16506 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:23.946138 16506 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.923944 16094 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:23.930153 15839 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:23.918020 16526 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:23.938509 16527 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.949319 16544 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:23.937044 16539 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:23.937243 16540 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:23.940340 16535 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:23.955513 16403 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:23.983245 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 82549us
I20260709 12:25:23.988379 12671 leader_election.cc:400] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:25:23.988987 12671 leader_election.cc:403] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:25:23.956717 15888 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:23.953593 16529 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.980471 16270 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.017725 16223 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.989107 16094 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:24.024458 16409 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:24.027630 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:24.008387 16483 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.981786 16527 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:23.988483 16538 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:24.028688 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 119890us
I20260709 12:25:24.031487 13226 raft_consensus.cc:2368] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6.
I20260709 12:25:23.981032 16542 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:24.037657 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:24.034654 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.038697 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.041086 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:24.041745 12702 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:24.012833 16480 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.025801 16540 raft_consensus.cc:697] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:24.033047 16376 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:24.046190 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 61356.7us
I20260709 12:25:24.047870 12707 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:24.048682 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:24.054936 12700 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:24.049374 15888 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.070650 16529 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:24.071017 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.072160 16529 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:24.072556 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.072963 16480 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.050136 16481 raft_consensus.cc:993] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:25:24.050130 16540 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.075734 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:24.076339 12702 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 4.
I20260709 12:25:24.051497 16526 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:23.994683 16535 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.032858 16543 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:24.052531 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.052819 16506 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.036230 16380 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.037456 16094 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
W20260709 12:25:24.055377 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 218722us
I20260709 12:25:24.056545 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.120566 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.057542 16478 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.058483 16491 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.059502 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 802) took 1286 ms. Trace:
I20260709 12:25:24.033663 16270 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:25:24.059875 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:24.041316 16538 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.060781 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.061717 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.063279 16448 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 5. Current term is 6.
I20260709 12:25:24.066785 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 906) took 1088 ms. Trace:
W20260709 12:25:24.089745 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 171201us
I20260709 12:25:24.121032 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:24.269955 12522 leader_election.cc:400] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6.
I20260709 12:25:24.269258 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:24.193993 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:24.306154 12522 leader_election.cc:403] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:25:24.306344 12705 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.299242 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:24.201174 12706 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 800) took 1597 ms (client timeout 1739 ms). Trace:
I20260709 12:25:24.096392 16246 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.307415 12702 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.171593 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.182504 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:24.152118 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.195156 12554 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
W20260709 12:25:24.286134 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.191223 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.287775 12628 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:24.127111 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:24.258193 12550 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:24.150398 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:24.114233 16494 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.209s	user 0.003s	sys 0.032s
I20260709 12:25:24.182323 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.191251 12707 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:24.889575 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:24.890467 12554 pending_rounds.cc:85] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
I20260709 12:25:24.388200 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:24.890892 12554 pending_rounds.cc:107] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:24.891188 12554 raft_consensus.cc:2889] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:24.194432 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:24.892506 12700 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:24.150858 12708 rpcz_store.cc:276] 0709 12:25:22.772598 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.777085 (+  4487us) service_pool.cc:224] Handling call
0709 12:25:24.059356 (+1282271us) spinlock_profiling.cc:243] Waited 819 ms on lock 0x7b54002a2954. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:24.059450 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1883809024}
I20260709 12:25:24.311542 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.674124 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2450) took 1425 ms. Trace:
I20260709 12:25:24.412017 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:24.304890 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:24.287441 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.894755 12559 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:24.114956 16259 raft_consensus.cc:1081] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:25:24.895993 12552 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 7: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:24.309496 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:24.505909 13235 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:24.306563 13231 rpcz_store.cc:276] 0709 12:25:22.977936 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.978132 (+   196us) service_pool.cc:224] Handling call
0709 12:25:22.978518 (+   386us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.842558 (+864040us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.066546 (+223988us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400698cd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:24.066708 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1862104320}
W20260709 12:25:24.568439 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.896790 12555 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:24.378242 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 108485us
W20260709 12:25:24.165161 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 134432us
W20260709 12:25:24.796269 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:24.510183 16310 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:24.349195 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 228234us
I20260709 12:25:24.899142 12671 leader_election.cc:400] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13.
I20260709 12:25:24.666714 12705 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:24.894132 12557 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
W20260709 12:25:24.307207 12706 rpcz_store.cc:269] 0709 12:25:22.603593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.603781 (+   188us) service_pool.cc:224] Handling call
0709 12:25:24.200959 (+1597178us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54003eb2d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:24.201094 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":694296960}
I20260709 12:25:24.898397 12630 rpcz_store.cc:276] 0709 12:25:23.248488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.248635 (+   147us) service_pool.cc:224] Handling call
0709 12:25:23.276767 (+ 28132us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:23.694766 (+417999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.673817 (+979051us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b54002eccd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:24.674039 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":953424640}
I20260709 12:25:24.897286 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:24.343298 13199 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.739s (SENT) [suppressed 5 similar messages]
I20260709 12:25:24.911677 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:24.912068 12704 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
W20260709 12:25:24.912617 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 603215us
I20260709 12:25:24.912911 12553 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:24.910990 12597 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:24.913887 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.605s	user 0.000s	sys 0.017s
I20260709 12:25:24.913949 12671 leader_election.cc:403] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:24.914285 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.000s	sys 0.017s
W20260709 12:25:24.531101 16558 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:25:24.653378 16556 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260709 12:25:24.915297 12556 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
W20260709 12:25:24.893100 16494 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.995s	user 0.015s	sys 0.046s
I20260709 12:25:24.917107 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:24.917886 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:24.499791 16560 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
W20260709 12:25:24.600996 16404 consensus_meta.cc:287] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.746s	user 0.006s	sys 0.007s
I20260709 12:25:24.921689 16538 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.915481 16527 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:24.927451 16293 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.927255 16404 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.928258 16497 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.928711 16270 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:24.928748 16497 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:24.931612 16497 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.153990 16380 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.929160 16270 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:24.934551 16270 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:24.915158 16517 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.938612 12701 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:24.939118 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:24.200742 16483 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.731s
I20260709 12:25:24.307261 16374 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.377547 16337 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:24.715708 16490 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.275712 16376 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:24.919165 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:24.126461 16526 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.151183 16532 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.922637 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:24.308405 16484 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.120522 16543 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:24.501029 16553 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.307667 16446 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.414963 16491 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:24.714663 16460 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.696779 16563 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:24.974028 16526 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:24.925931 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:24.975114 12707 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.974946 16563 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.976313 16526 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.389498 16561 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:24.977149 16561 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:24.972280 12700 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 5.
I20260709 12:25:24.978020 13232 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:24.126688 16506 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:24.308826 16409 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.711184 16481 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.927997 16293 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.990108 16481 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.991119 16561 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:24.500700 16559 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260709 12:25:24.719900 16479 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:24.895179 16478 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.113037 16422 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:24.504452 16402 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:24.932798 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:24.933210 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:24.501168 16551 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:24.933501 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:24.910666 16534 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.004s	sys 0.012s
I20260709 12:25:24.710831 16552 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:24.830636 16111 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:25.043635 16111 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:24.645998 16522 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:24.980592 16446 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:25.046348 16562 log.cc:927] Time spent T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:25:25.045991 16522 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.970881 16374 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.933877 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.050565 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.921387 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:24.940480 12699 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:24.940681 12671 leader_election.cc:400] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:24.941912 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:25.052735 12671 leader_election.cc:403] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:24.969765 12630 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 2.
I20260709 12:25:24.919806 16310 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13.
I20260709 12:25:24.910899 16246 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.926257 16535 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.929392 16404 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.971197 12702 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:24.973431 12552 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
W20260709 12:25:24.974138 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47708us
I20260709 12:25:25.067793 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:24.973909 16553 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.070830 16246 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.071666 16553 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.924947 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:24.973106 16490 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.977670 16563 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:24.972865 16543 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:24.982143 16506 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.986213 12707 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:24.933609 16494 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:25.082667 16494 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.978056 16538 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:24.976819 16532 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.994221 16380 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.972816 16337 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:25.032122 12556 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:24.967504 16517 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.033897 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 908) took 1006 ms. Trace:
I20260709 12:25:25.037043 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.043097 16481 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.053826 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:24.987439 16510 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:25.049063 16522 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.058019 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.060496 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 875) took 1002 ms. Trace:
W20260709 12:25:25.037573 16534 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.004s	sys 0.012s
I20260709 12:25:24.977856 16376 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.108693 16337 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.063759 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.150883 12633 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:25.001778 16293 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.050498 16374 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.065655 16418 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:25.069314 16404 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:25.035984 16551 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.069762 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.072757 12552 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:25:25.156335 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:24.982443 16484 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:25.073472 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 132918us
W20260709 12:25:25.072046 16555 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.719s	user 0.004s	sys 0.000s
I20260709 12:25:25.083072 16506 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:24.970067 16497 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.164650 16497 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:24.994722 16478 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.107717 16111 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.108229 16517 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.115208 16490 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.124819 16532 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.037051 16402 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.105077 16510 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:25.157959 16564 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.186s	user 0.002s	sys 0.003s
I20260709 12:25:25.126940 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.179613 12632 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:25.044590 16422 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.139165 12559 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:25.181993 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2152) took 1029 ms. Trace:
I20260709 12:25:25.145395 13198 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:25.182395 12559 rpcz_store.cc:276] 0709 12:25:24.152380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.152572 (+   192us) service_pool.cc:224] Handling call
0709 12:25:25.181933 (+1029361us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:25.149124 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 226541us
I20260709 12:25:25.100209 13227 rpcz_store.cc:276] 0709 12:25:24.027557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.027692 (+   135us) service_pool.cc:224] Handling call
0709 12:25:24.039871 (+ 12179us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.040263 (+   392us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.040304 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.053875 (+ 13571us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.113245 (+ 59370us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:24.113669 (+   424us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.114043 (+   374us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.033682 (+919639us) raft_consensus.cc:1685] finished
0709 12:25:25.033701 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.033838 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":809,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3324,"thread_start_us":37881,"threads_started":1,"wal-append.queue_time_us":210005}
I20260709 12:25:25.104285 13232 rpcz_store.cc:276] 0709 12:25:24.057858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.108160 (+ 50302us) service_pool.cc:224] Handling call
0709 12:25:25.060343 (+952183us) spinlock_profiling.cc:243] Waited 84.5 ms on lock 0x7b540064e6d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:25.060440 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":194325888}
I20260709 12:25:25.152930 12556 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
W20260709 12:25:25.155431 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 812120us
I20260709 12:25:25.157848 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.158408 12671 leader_election.cc:400] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10.
W20260709 12:25:25.189436 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.190167 12598 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:25.163508 16551 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.164016 12708 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:25.168080 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.170719 16497 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.170312 16270 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.073021 16552 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.171465 16506 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:25.171537 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.225178 16332 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:25.227838 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.227967 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.172706 12630 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:25.173280 16484 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:25.173997 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 104359us
I20260709 12:25:25.152046 16491 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6.
I20260709 12:25:25.150714 16446 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.192358 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:25.236042 13231 raft_consensus.cc:2393] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:25.192740 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:25.188346 12628 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:25.186391 16490 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.207527 16402 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.207917 16246 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:25.208156 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.209554 12559 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:25.165915 16293 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:25.195300 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.210140 16576 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:25.217775 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:25.245121 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:25.245932 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:25.246691 13231 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.246892 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:25.246722 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 152589us
I20260709 12:25:25.218421 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.187131 16532 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.181645 16510 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:25.220613 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.223426 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:25.223726 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.248656 13230 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:25.223780 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.249928 13235 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:25.224598 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:25.226667 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.233184 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.217288 16409 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:25.241688 12552 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:25.211045 12631 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
W20260709 12:25:25.242172 16571 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:25:25.253814 16374 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.254209 16569 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.254333 16374 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.254731 16569 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.255013 16409 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.254659 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.255285 16569 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.248473 13227 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 5.
I20260709 12:25:25.255488 16409 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.257077 16532 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.257611 16402 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:25.257926 16487 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:25.258103 16402 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.258460 16487 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:25.258505 16402 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.259438 16487 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.261886 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.263579 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.266005 12556 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:25.273561 16293 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.276350 16293 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.280740 13231 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:25.286460 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.287570 16111 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.292184 16576 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.335014 16111 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.287659 16418 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.287968 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:25.337065 16418 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:25.337661 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49777.1us
I20260709 12:25:25.288553 16517 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.290194 16551 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.291117 16491 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.242524 16486 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:25:25.241272 16506 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:25.293740 12554 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:25.310179 12551 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:25.338971 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.338433 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.402423 16374 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.421818 16517 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.399159 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.366256 16418 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.424685 16517 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.422559 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.401821 16111 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.347826 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.293004 16543 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.398785 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.427863 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.449322 12627 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:25.427971 13230 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:25:25.423164 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 84829.3us
I20260709 12:25:25.426440 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.451371 16522 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:25.447399 16491 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.451854 12629 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:25.402983 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.452060 16522 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.453020 12625 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:25.347476 16544 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:25.453667 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 2152) took 1040 ms. Trace:
I20260709 12:25:25.424360 16551 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.405961 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.454077 12625 rpcz_store.cc:276] 0709 12:25:24.413060 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.603047 (+189987us) service_pool.cc:224] Handling call
0709 12:25:25.402817 (+799770us) spinlock_profiling.cc:243] Waited 3.05 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:25.453549 (+ 50732us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7016192}
I20260709 12:25:25.455559 13199 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:25.455806 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.456343 12559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:36566
I20260709 12:25:25.456656 12625 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:25.456931 12559 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:25.457278 16563 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.457453 12559 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.457772 16563 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.458182 16563 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.426332 12554 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:25.428180 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.458693 16446 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:25.399302 16416 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.423899 16531 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:25.419847 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 179533us
I20260709 12:25:25.455864 16551 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.462020 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.463349 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.464502 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.449771 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:25.468663 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:25.439231 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.468062 12559 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.473217 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:25.394320 16566 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.420s	user 0.002s	sys 0.002s
I20260709 12:25:25.482982 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.462996 16376 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.485953 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:25.487996 12631 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:25.454962 16522 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.476828 16497 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.502127 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:25.484112 16551 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:25:25.503172 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.504520 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.505129 16544 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.505712 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.510908 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.506561 16551 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:25.507535 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.513712 16402 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.428369 16409 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.516214 16402 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.516641 16544 raft_consensus.cc:2764] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election decision vote started in defunct term 9: won
I20260709 12:25:25.518589 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.519642 13230 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:25.520416 16544 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.523833 16544 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:25.524278 16544 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.484313 16504 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:25.521945 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:25.488656 16111 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:25.531981 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:25.552965 16418 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.496707 16376 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.553556 16418 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:25.553854 16376 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.554082 16418 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.554318 16376 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.549925 16517 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.556730 16517 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.557126 16517 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.551877 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:25.557830 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 86091.1us
W20260709 12:25:25.560377 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 62131.8us
I20260709 12:25:25.482226 16540 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
W20260709 12:25:25.565214 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 96626us
I20260709 12:25:25.422432 16506 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.528970 16404 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:25:25.562341 16380 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:25.585182 16479 consensus_meta.cc:287] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.001s
I20260709 12:25:25.590996 16479 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:25.591310 16586 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:25.586620 16380 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.593874 16380 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.594007 16584 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:25.592756 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:25.610003 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2151) took 1458 ms. Trace:
I20260709 12:25:25.591691 16479 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.610496 12558 rpcz_store.cc:276] 0709 12:25:24.152048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.152187 (+   139us) service_pool.cc:224] Handling call
0709 12:25:24.221688 (+ 69501us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:24.284817 (+ 63129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:24.284859 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:24.312188 (+ 27329us) log.cc:844] Serialized 26 byte log entry
0709 12:25:24.872555 (+560367us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:24.872599 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:24.872672 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.367238 (+494566us) spinlock_profiling.cc:243] Waited 4.43 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:25.609643 (+242405us) raft_consensus.cc:1685] finished
0709 12:25:25.609665 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.609906 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61054,"raft.queue_time_us":105,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":12112,"spinlock_wait_cycles":10182016,"thread_start_us":457853,"threads_started":1,"wal-append.queue_time_us":543201}
I20260709 12:25:25.617004 16479 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.627821 16528 tablet_replica.cc:333] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:25:25.565572 16538 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:25.637333 16376 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.654664 16540 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:25.655128 16540 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.655493 16540 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.619104 16589 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:25.620265 12551 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2153) took 1450 ms (client timeout 1914 ms). Trace:
I20260709 12:25:25.621871 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 877) took 1563 ms. Trace:
I20260709 12:25:25.660218 13226 rpcz_store.cc:276] 0709 12:25:24.058440 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.620911 (+1562471us) service_pool.cc:224] Handling call
0709 12:25:25.621269 (+   358us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.621506 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.621537 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.621582 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:25.621619 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.621674 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.621785 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.592572 16448 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.618230 16585 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:25.644433 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.650270 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.663450 13228 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:25.652379 12630 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:25:25.664197 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 371709us
I20260709 12:25:25.662910 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:25.656523 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 71683.1us
I20260709 12:25:25.674501 16504 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:25.659997 12551 rpcz_store.cc:269] 0709 12:25:24.169751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.191456 (+ 21705us) service_pool.cc:224] Handling call
0709 12:25:25.620082 (+1428626us) spinlock_profiling.cc:243] Waited 348 ms on lock 0x7b540035fa54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:25.620201 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":799834880}
I20260709 12:25:25.665772 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:25.682169 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2151) took 1269 ms. Trace:
I20260709 12:25:25.682760 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.682621 12630 rpcz_store.cc:276] 0709 12:25:24.412757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.651366 (+1238609us) service_pool.cc:224] Handling call
0709 12:25:25.651902 (+   536us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.664344 (+ 12442us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.682085 (+ 17741us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.641628 16538 consensus_queue.cc:1243] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer a2a8d71f644447218c1afc3e5f7716cd log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:25.647795 16519 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.650676 16416 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.733542 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2153) took 1320 ms. Trace:
I20260709 12:25:25.749644 12630 rpcz_store.cc:276] 0709 12:25:24.413353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.684653 (+1271300us) service_pool.cc:224] Handling call
0709 12:25:25.732969 (+ 48316us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.733178 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.733209 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.733254 (+    45us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:25.733285 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.733345 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.733487 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:25.735194 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44716.7us
W20260709 12:25:25.754637 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 91795.6us
I20260709 12:25:25.737504 13235 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:25.747324 16380 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.729507 16404 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.732307 16494 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.746393 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2300) took 1506 ms. Trace:
I20260709 12:25:25.768213 12555 rpcz_store.cc:276] 0709 12:25:24.239696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.061736 (+822040us) service_pool.cc:224] Handling call
0709 12:25:25.073782 (+ 12046us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:25.187503 (+113721us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.187552 (+    49us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:25.208907 (+ 21355us) log.cc:844] Serialized 52 byte log entry
0709 12:25:25.405037 (+196130us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:25.405078 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.745979 (+340901us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400298454. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:25.746028 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:25.746076 (+    48us) raft_consensus.cc:1685] finished
0709 12:25:25.746092 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.746323 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6021,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":20152,"spinlock_wait_cycles":242575744,"thread_start_us":195683,"threads_started":1,"wal-append.queue_time_us":336876}
I20260709 12:25:25.746737 16538 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.746862 16593 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.732928 16572 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.682403 16448 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.647559 16544 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.747323 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:25.742266 16528 raft_consensus.cc:2243] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:25.667121 16561 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:25.648475 16418 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.767459 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.810256 12707 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:25.767712 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.773659 16531 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:25.771538 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 972) took 1087 ms. Trace:
I20260709 12:25:25.772239 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.775573 12708 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:25.813035 12705 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
I20260709 12:25:25.751550 16519 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:25.676218 16504 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.804626 12700 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:25.690930 16563 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.793483 12600 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:25.794236 13198 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:25.831605 16493 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.831977 16493 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.832327 16493 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.832461 16563 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.832686 16376 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.834589 16380 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.835350 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.835956 12700 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:25.836323 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:25.836843 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.838073 16479 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:25.838491 16479 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:25.839411 16418 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:25.838718 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44569.7us
I20260709 12:25:25.839414 16479 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.841020 16479 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.809147 16561 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.843317 16478 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.838100 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.784474 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.850054 16519 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.851284 16519 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.851231 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.852128 12704 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:25.803973 12699 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:25.814162 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:25.853830 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 60467.5us
I20260709 12:25:25.854131 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.854586 16595 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:25.855180 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.856033 12699 raft_consensus.cc:2410] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:25.856801 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.856930 16597 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.853144 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.857694 16528 raft_consensus.cc:2272] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:25.858903 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.773300 16593 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:25.860780 16528 ts_tablet_manager.cc:1916] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:25.812686 12630 rpcz_store.cc:276] 0709 12:25:24.684063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.761701 (+1077638us) service_pool.cc:224] Handling call
0709 12:25:25.771001 (+  9300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.771200 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.771229 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.771273 (+    44us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:25.771305 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.771376 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:25.771484 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.861627 16593 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.784247 16490 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.862615 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.862944 16593 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.863776 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.864010 16544 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.864796 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.822530 12703 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:25.824815 16531 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:25.866500 16531 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.823585 16552 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.807890 16585 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:25:25.868005 16585 consensus_queue.cc:1243] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 23740bafdb794232879a0bb6884f7a68 log is divergent from this leader: its last log entry 9.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:25.820904 16532 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.862959 16490 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.872139 16490 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.765905 16416 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.873167 12702 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:25.874398 16416 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:25.836913 12701 raft_consensus.cc:2376] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6. Re-sending same reply.
I20260709 12:25:25.848345 16493 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.876403 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.876967 12701 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:25.771386 16404 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:25.877314 16493 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:25.860244 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:25.879364 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.880100 12701 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:25.879449 16404 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.843329 16561 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:25.881582 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.683696 16589 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:25.789960 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 226220us
I20260709 12:25:25.784652 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.883561 16563 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.882892 12700 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:25.889256 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.890450 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.892328 12556 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:25.889922 12557 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:25.894610 13198 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:25.895494 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:25.902107 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:25.902623 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:25.902833 12554 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.903172 12700 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.896457 12552 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:25.904562 16590 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.904676 16173 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:25.905118 16590 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:25.905567 16590 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.905635 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:25.906013 12555 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:25:25.906345 12555 pending_rounds.cc:85] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
I20260709 12:25:25.904593 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:25.906697 12555 pending_rounds.cc:107] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260709 12:25:25.906942 12632 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:25.907302 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:25.907846 12558 raft_consensus.cc:2376] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10. Re-sending same reply.
I20260709 12:25:25.906947 12555 raft_consensus.cc:2889] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.912011 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:25.914029 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.914863 12556 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:25.917332 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:25.922499 12557 pending_rounds.cc:85] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 4
I20260709 12:25:25.922844 12557 pending_rounds.cc:107] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 9.5
I20260709 12:25:25.923099 12557 raft_consensus.cc:2889] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:25.951025 12553 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:25.953052 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:25.853296 16540 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:25.887058 16563 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:25.959604 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:25.958992 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:25.965631 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.967128 12551 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:25.973248 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:25.976588 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:25.893509 16490 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:25:25.978209 12555 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:25.981294 12630 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:25.981909 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2155) took 1295 ms. Trace:
I20260709 12:25:25.982211 12630 rpcz_store.cc:276] 0709 12:25:24.686372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.969421 (+1283049us) service_pool.cc:224] Handling call
0709 12:25:25.981007 (+ 11586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.981689 (+   682us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.981859 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.969947 16332 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:25.970357 16563 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:25.988464 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:25.994011 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.011229 12700 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:26.004985 12632 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:26.012477 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.012854 12632 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:26.014113 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 969) took 1887 ms. Trace:
I20260709 12:25:26.011523 12699 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:25.966675 16374 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:26.014534 12633 rpcz_store.cc:276] 0709 12:25:24.126893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.127046 (+   153us) service_pool.cc:224] Handling call
0709 12:25:24.150493 (+ 23447us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.151273 (+1000780us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:25.998511 (+847238us) spinlock_profiling.cc:243] Waited 978 ms on lock 0x7b54002111d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:26.014057 (+ 15546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2248521984}
I20260709 12:25:25.982157 16532 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:26.028510 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.041301 12551 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.033182 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.036748 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.024435 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2156) took 1245 ms. Trace:
I20260709 12:25:26.037652 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.042647 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.042917 12632 rpcz_store.cc:276] 0709 12:25:24.779142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.012287 (+1233145us) service_pool.cc:224] Handling call
0709 12:25:26.012605 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.022032 (+  9427us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.024353 (+  2321us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.969779 16404 consensus_queue.cc:1059] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:25:26.045055 12633 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:26.046625 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:26.050895 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 974) took 1148 ms. Trace:
I20260709 12:25:26.048170 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.047452 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.048544 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:26.051272 12633 rpcz_store.cc:276] 0709 12:25:24.902760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.034659 (+1131899us) service_pool.cc:224] Handling call
0709 12:25:26.044773 (+ 10114us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.050644 (+  5871us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.050840 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.997246 16332 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:26.046805 12630 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 11 index: 13. (index mismatch)
W20260709 12:25:26.032796 16566 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:26.044866 16094 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.090107 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.090512 16094 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.091591 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.092638 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.092806 16094 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:26.093384 16586 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.095072 16586 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.095772 16586 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:26.055716 16416 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.009476 16517 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.097259 16332 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.099530 16517 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:26.057695 16497 consensus_meta.cc:287] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.530s	user 0.004s	sys 0.004s
I20260709 12:25:26.100337 16497 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.049079 16418 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:26.101145 16418 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.101567 16418 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:26.103725 16569 consensus_meta.cc:287] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.848s	user 0.005s	sys 0.003s
I20260709 12:25:26.104209 16569 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.040728 16504 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:26.105656 16506 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.105944 16504 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.106227 16506 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.108458 16506 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.109316 13226 raft_consensus.cc:2393] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:26.055477 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 973) took 1358 ms. Trace:
I20260709 12:25:26.110430 12630 rpcz_store.cc:276] 0709 12:25:24.697086 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.023181 (+1326095us) service_pool.cc:224] Handling call
0709 12:25:26.046500 (+ 23319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.053190 (+  6690us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.055418 (+  2228us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:26.022244 15888 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:26.111157 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 64625.9us
I20260709 12:25:26.061902 16270 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.068928 12554 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:26.069990 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 976) took 1146 ms. Trace:
I20260709 12:25:26.112182 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:26.066427 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.075532 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 977) took 1132 ms. Trace:
I20260709 12:25:26.072492 16491 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.078958 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.078233 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.114259 13234 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.113648 12632 rpcz_store.cc:276] 0709 12:25:24.942995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.074648 (+1131653us) service_pool.cc:224] Handling call
0709 12:25:26.074984 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.075167 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:26.075199 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.075245 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:26.075285 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.075346 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.075460 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:26.114600 12556 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:26.082880 16589 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.097078 16586 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.137941 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:26.138908 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 159835us
I20260709 12:25:26.083518 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.116254 12552 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:26.117918 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:26.054275 16478 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:26.147776 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:26.148211 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 975) took 1231 ms. Trace:
I20260709 12:25:26.148756 12633 rpcz_store.cc:276] 0709 12:25:24.916785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.052090 (+1135305us) service_pool.cc:224] Handling call
0709 12:25:26.137574 (+ 85484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.147737 (+ 10163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:26.147783 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.147843 (+    60us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:26.147892 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.147987 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.148136 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:26.152590 12630 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:26.152583 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:26.151454 12600 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:26.127497 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.151424 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:26.125217 12551 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:26.133626 12704 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:26.112622 12634 rpcz_store.cc:276] 0709 12:25:24.923196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.069163 (+1145967us) service_pool.cc:224] Handling call
0709 12:25:26.069510 (+   347us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.069702 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:26.069726 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.069766 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:26.069796 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.069846 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.069938 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:26.083824 16540 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.136870 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:26.081269 16510 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.825s	user 0.007s	sys 0.000s
I20260709 12:25:26.138797 12553 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:26.120628 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.183321 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.139833 12552 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:26.183688 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 63170us
I20260709 12:25:26.144438 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.185262 12556 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:26.185631 13227 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.160984 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2163) took 1077 ms. Trace:
I20260709 12:25:26.186801 12630 rpcz_store.cc:276] 0709 12:25:25.083448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.111187 (+1027739us) service_pool.cc:224] Handling call
0709 12:25:26.152346 (+ 41159us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:26.160560 (+  8214us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.160896 (+   336us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:26.164412 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.165493 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.146380 16497 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.108415 16504 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.189158 16111 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.163192 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:26.189677 16111 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.190240 16111 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.190747 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:26.140161 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47590.5us
I20260709 12:25:26.191709 16259 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.191756 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.166378 16416 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.193670 16506 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.188328 16487 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.194407 16506 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.194528 16487 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:26.195946 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.196080 16487 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.197463 16494 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:26.167457 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.198040 16494 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.198640 12554 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:26.198714 16494 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.214847 12554 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: [6.8-8.9]
I20260709 12:25:26.194897 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:26.136870 16293 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.237306 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.049583 16532 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.247874 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.248693 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.249609 12700 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.250406 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.242954 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.244472 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.138532 16490 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:26.152154 15888 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:26.245535 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.184520 12552 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.155105 16517 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.258219 12552 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.259095 12708 raft_consensus.cc:2393] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 6: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:26.257375 12556 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:26.183233 16094 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:26.184870 16491 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:26.184528 16595 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.179096 16552 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:26.266453 12555 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:26.256718 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 983) took 1012 ms. Trace:
I20260709 12:25:26.267778 16094 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:26.242496 16293 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:26.250054 16416 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.276808 16448 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.287132 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.249629 16270 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:26.278721 12551 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:26.242894 16531 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:26.281167 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.242687 15839 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 12:25:26.152326 16592 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.109s
I20260709 12:25:26.286813 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.280634 16595 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.180300 16561 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
W20260709 12:25:26.326143 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 130297us
I20260709 12:25:26.260222 16599 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.155269 16589 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:25:26.301503 16531 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.264796 16586 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:26.281241 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.239921 16510 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.219798 16494 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.273034 16543 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.304795 16111 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.306164 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.310119 16569 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.310617 15888 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.314383 16595 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.290398 16416 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.292146 16293 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.315471 16409 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.318223 12559 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.381974 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36566 (request call id 988) took 1184 ms. Trace:
I20260709 12:25:26.382404 12559 rpcz_store.cc:276] 0709 12:25:25.197330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.426081 (+228751us) service_pool.cc:224] Handling call
0709 12:25:26.317756 (+891675us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b4c003d7480. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e92db7a20 00007f0e92dc8a29 00007f0e92dc913f 00007f0e92d8d2ab 00007f0e92dbaf3c 00007f0e92dbb3fe 00007f0e9304888b 00007f0e94a47495 00007f0e94a9830f 00007f0e94ae2a55 00007f0e99ab2cd0
0709 12:25:26.381874 (+ 64118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":623933696}
I20260709 12:25:26.264811 16490 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.319869 16590 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.320490 16532 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.284215 16552 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:26.288697 16094 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.295825 12552 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:26.336581 13227 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:26.337210 13234 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:26.357725 12700 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:26.367820 16111 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:26.399482 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.370745 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.379539 16491 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:26.330680 16448 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.387152 12627 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:26.359853 16531 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:26.361539 16479 consensus_meta.cc:287] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.520s	user 0.011s	sys 0.005s
I20260709 12:25:26.390986 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.410043 12705 raft_consensus.cc:2410] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 12 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:26.410953 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.412070 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.412657 12705 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:26.413547 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.413901 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 978) took 1914 ms. Trace:
I20260709 12:25:26.414325 12550 rpcz_store.cc:276] 0709 12:25:24.499230 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.072308 (+573078us) service_pool.cc:224] Handling call
0709 12:25:25.098891 (+ 26583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:25.240047 (+141156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:25.240080 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:25.240119 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:25.240151 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.413678 (+1173527us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54001a9354. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:26.413723 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.413842 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":324216704}
I20260709 12:25:26.414987 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.415890 16613 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:26.416368 16613 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:26.416769 16613 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.418001 16494 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.418298 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 1042) took 1014 ms. Trace:
I20260709 12:25:26.418732 13226 rpcz_store.cc:276] 0709 12:25:25.404300 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.682475 (+278175us) service_pool.cc:224] Handling call
0709 12:25:26.418101 (+735626us) spinlock_profiling.cc:243] Waited 426 ms on lock 0x7b54001b3854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:26.418239 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":978905472}
I20260709 12:25:26.419927 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.420480 13226 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.421370 16531 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.422613 12701 raft_consensus.cc:2368] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:26.398365 12597 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:26.424638 16532 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:26.424741 16531 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:26.425223 16532 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:26.426504 16532 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.398581 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.429134 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.430045 12700 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:26.400761 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.401754 12598 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.433780 13231 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:26.434015 16409 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.434432 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:26.435264 12699 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:26.435627 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.435974 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:26.402103 16487 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:25:26.436719 16111 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.437273 16111 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:26.434449 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.404883 16491 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.437896 16270 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:26.438320 16270 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:26.438448 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:26.438761 16270 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.438910 16409 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:26.439536 16409 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:26.440829 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:26.404417 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.441783 16479 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:26.442420 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.442332 16479 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.443203 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:26.444583 16479 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.446590 16545 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:26.396356 16552 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:26.405347 12631 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:26.383802 16416 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.449270 16545 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.449832 16545 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:26.404758 16404 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260709 12:25:26.407195 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.407091 16448 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.408358 16510 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.440527 16409 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.453191 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:26.454066 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.444593 12707 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.461467 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:26.475822 12705 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:26.361022 16586 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:26.464205 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 269357us
I20260709 12:25:26.464123 12553 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:26.476985 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.477645 12550 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.478543 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:26.460924 12446 maintenance_manager.cc:419] P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033356
I20260709 12:25:26.445188 16479 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:26.468408 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.469322 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.467202 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:26.483112 16586 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.388540 16563 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.485144 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.478736 16490 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:26.388087 16418 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.487706 12703 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:26.472111 16444 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:26.490316 12598 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.509292 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.486979 16486 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.419950 16590 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.450736 16545 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.523208 12598 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.476408 16332 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.486948 16617 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:26.531592 16616 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260709 12:25:26.532140 16418 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:26.500757 16599 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:25:26.541801 16599 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:26.493788 16493 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:26.491654 16446 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:26.472599 16569 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:26.521692 16561 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.583773 13227 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:26.583864 12550 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:26.502578 16479 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.487170 16494 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
W20260709 12:25:26.525554 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 81695.9us
I20260709 12:25:26.519382 16173 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.571334 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.571466 12702 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:26.491138 16620 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:26.511901 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 338889us
I20260709 12:25:26.525439 16612 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.527595 16522 consensus_queue.cc:1059] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:25:26.521821 16444 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:26.525552 15888 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
I20260709 12:25:26.526786 16111 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.609968 12598 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.638919 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.640692 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.611727 13226 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:26.543674 16618 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Stepping down as leader of term 11
W20260709 12:25:26.613920 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 106711us
I20260709 12:25:26.642026 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.609081 16173 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.610373 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.626081 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2463) took 1404 ms. Trace:
I20260709 12:25:26.700513 12702 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:26.699187 12632 rpcz_store.cc:276] 0709 12:25:25.222149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.137099 (+914950us) service_pool.cc:224] Handling call
0709 12:25:26.168665 (+ 31566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:26.458064 (+289399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:26.458105 (+    41us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:26.479808 (+ 21703us) log.cc:844] Serialized 26 byte log entry
0709 12:25:26.622180 (+142372us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:26.622221 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.622293 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:26.625878 (+  3585us) raft_consensus.cc:1685] finished
0709 12:25:26.625895 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.626027 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":59041,"raft.queue_time_us":73347,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":12441,"thread_start_us":334494,"threads_started":2,"wal-append.queue_time_us":123485}
W20260709 12:25:26.626245 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 132781us
I20260709 12:25:26.701826 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.522682 16490 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
I20260709 12:25:26.633208 16563 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.641286 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:26.694741 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 206927us
I20260709 12:25:26.642359 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.708765 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.696076 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.696242 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.709734 13226 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.710058 12559 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.710254 12552 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:26.609933 16479 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.657460 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:26.624382 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 109922us
I20260709 12:25:26.632977 15839 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.613198 16620 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:26.625084 16590 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.711696 12702 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:26.717231 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:26.641857 16561 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:26.722608 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:26.731360 12632 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:26.694232 16402 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.654035 16332 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:26.691735 16418 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.730374 12559 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
W20260709 12:25:26.725764 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 68409.3us
I20260709 12:25:26.731593 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:26.752521 12702 raft_consensus.cc:2368] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13.
I20260709 12:25:26.716801 16506 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.642063 16619 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:26.713939 16633 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:25:26.707108 16173 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.696985 16618 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:26.741047 16444 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.743700 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.773772 13229 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:26.774108 13229 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:26.774847 13229 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.775661 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:26.775914 13229 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.776706 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.746958 16629 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.707091 16617 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.697862 16535 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.747395 16592 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:25:26.760128 13226 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:26.724291 16517 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:26.779104 13199 leader_election.cc:400] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13.
I20260709 12:25:26.784744 13199 leader_election.cc:403] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:26.732054 16620 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.634531 16625 consensus_queue.cc:1059] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.115s
I20260709 12:25:26.783286 13227 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:26.719214 16270 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:26.790884 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 180583us
I20260709 12:25:26.752918 16561 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:26.761868 16111 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.813221 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:26.813882 12557 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:26.816275 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:26.820106 12632 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:26.829870 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:26.831004 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:26.832193 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:26.836377 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 120465us
I20260709 12:25:26.762835 16418 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.853214 13233 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260709 12:25:26.866510 12632 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:26.790676 16094 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.794622 16638 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13.
I20260709 12:25:26.873972 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.791873 16535 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.789448 16491 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.880734 12632 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:26.878958 13198 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:26.882833 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.883925 12632 raft_consensus.cc:2410] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260709 12:25:26.887939 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:26.894212 16173 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.842154 16478 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:25:26.788166 16617 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.896435 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.780393 16629 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.843271 16532 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260709 12:25:26.901139 12708 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:26.876413 16111 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:26.905874 12632 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:26.933367 13226 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:26.880584 16494 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:26.898285 12699 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:26.934978 13234 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.938860 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:26.941814 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.943226 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:26.945847 13229 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:26.937686 16444 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:26.949067 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:26.952664 12632 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:26.853351 16618 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:26.901067 16528 ts_tablet_manager.cc:1929] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 12:25:26.943486 16517 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:26.984664 16635 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:26.948367 16640 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:26.958312 16586 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:26.985255 16293 consensus_meta.cc:287] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 12:25:26.897396 16561 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.948127 16656 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.942691 16494 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:26.979923 16625 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:26.979890 16618 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:26.997159 16617 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:26.948408 16111 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.000281 16094 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:27.017437 16552 consensus_meta.cc:287] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.569s	user 0.012s	sys 0.007s
I20260709 12:25:27.015518 16528 log.cc:1199] T d9812250f15d4075a3c8831ca5f3ed41 P c6795b140b3247279a2231c6b9360d24: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/wals/d9812250f15d4075a3c8831ca5f3ed41
I20260709 12:25:27.017292 16625 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:27.038437 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 89070.3us
I20260709 12:25:27.015563 16293 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.023862 16173 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:26.998562 16640 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.049034 16625 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.049794 16528 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:45128 (request call id 89) took 3965 ms. Trace:
I20260709 12:25:27.032605 16552 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.067459 16535 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.069140 16552 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.069913 12556 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:27.023967 16270 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.021938 16657 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:27.055598 16642 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.018852 16656 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.071482 16642 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.069212 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 830) took 1259 ms. Trace:
I20260709 12:25:27.073581 16656 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.073699 16642 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.066469 16528 rpcz_store.cc:276] 0709 12:25:23.176445 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.227003 (+ 50558us) service_pool.cc:224] Handling call
0709 12:25:23.938291 (+711288us) ts_tablet_manager.cc:1151] Deleting tablet d9812250f15d4075a3c8831ca5f3ed41
0709 12:25:23.951428 (+ 13137us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:25:25.627294 (+1675866us) spinlock_profiling.cc:243] Waited 424 ms on lock 0x7b54003ec6d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94af3ff9 00007f0e99b01482 00007f0e99b322d0 00007f0e99b1883d 00007f0e99b187e9 00007f0e99b18779 00007f0e99b18741 00007f0e99b1796d 0000000000388634 0000000000388479
0709 12:25:26.366327 (+739033us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:26.884086 (+517759us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:27.049716 (+165630us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":136,"spinlock_wait_cycles":975196416,"tablet-delete.queue_time_us":179045,"thread_start_us":112062,"threads_started":1}
I20260709 12:25:27.075500 16640 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.075985 16651 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.041675 16418 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:27.073854 16416 consensus_meta.cc:287] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.625s	user 0.010s	sys 0.001s
I20260709 12:25:27.073724 12705 rpcz_store.cc:276] 0709 12:25:25.813895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.413302 (+599407us) service_pool.cc:224] Handling call
0709 12:25:26.475519 (+ 62217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.476200 (+   681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.069023 (+592823us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b54003ecbd0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.069154 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47973760}
I20260709 12:25:27.081599 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:27.082288 12705 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:27.081280 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:27.089927 12557 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:27.081225 16656 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.042321 16517 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.100826 12705 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
W20260709 12:25:27.101814 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 222965us
I20260709 12:25:27.103767 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:27.106575 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:27.102239 16613 consensus_meta.cc:287] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.685s	user 0.012s	sys 0.000s
I20260709 12:25:27.108433 16293 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.111064 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:27.107457 16659 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:27.117611 15839 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:27.122802 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:27.130811 12701 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.123793 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2110) took 1008 ms. Trace:
I20260709 12:25:27.126441 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2162) took 2043 ms. Trace:
I20260709 12:25:27.132092 12627 rpcz_store.cc:276] 0709 12:25:25.083115 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.079175 (+996060us) service_pool.cc:224] Handling call
0709 12:25:26.079494 (+   319us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:26.408160 (+328666us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.126194 (+718034us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b540025e9d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:27.126376 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":706944896}
I20260709 12:25:27.085598 16416 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.126394 12705 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:27.132006 12703 rpcz_store.cc:276] 0709 12:25:26.115549 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.413198 (+297649us) service_pool.cc:224] Handling call
0709 12:25:27.123614 (+710416us) spinlock_profiling.cc:243] Waited 73.3 ms on lock 0x7b54003eb2d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.123734 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":168570112}
I20260709 12:25:27.129109 12557 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.134887 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:27.135625 12703 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
W20260709 12:25:27.128253 16595 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.760s	user 0.005s	sys 0.011s
I20260709 12:25:27.106364 16657 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:27.147306 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:27.143343 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.147265 12632 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.088846 16651 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.151139 16576 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.152103 16448 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.153746 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:27.154572 16111 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.156095 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:27.158308 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:27.101754 16656 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.161118 16656 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.144181 16659 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:27.162923 16659 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.159080 12627 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:27.156538 16651 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.157768 16657 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.167737 13227 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:27.165987 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.172971 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.177976 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.178316 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.178998 12553 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:27.126812 16479 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.179523 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.186533 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.129868 16613 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.182260 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:27.189281 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.191555 16613 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.192042 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.192834 12550 raft_consensus.cc:2410] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 11 because replica has last-logged OpId of term: 8 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 12:25:27.193346 16479 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.164093 16595 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.188303 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.189574 12558 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.194748 12700 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:27.195052 12554 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:27.194665 12551 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:27.183255 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.180763 12598 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.182719 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:27.180176 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.180600 12701 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:27.179613 16648 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.197664 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:27.184743 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.202718 13227 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:27.203814 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.205075 12555 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:27.203780 12557 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:27.209460 12598 leader_election.cc:400] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:27.209774 12598 leader_election.cc:403] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:27.210683 13198 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:27.208645 16504 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:26.284927 12633 rpcz_store.cc:276] 0709 12:25:25.244758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.150027 (+905269us) service_pool.cc:224] Handling call
0709 12:25:26.181675 (+ 31648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.181955 (+   280us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:26.205541 (+ 23586us) log.cc:844] Serialized 14 byte log entry
0709 12:25:26.256347 (+ 50806us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.256402 (+    55us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:26.256462 (+    60us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:26.256527 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:26.256660 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45480,"prepare.queue_time_us":53051,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":50106,"raft.run_wall_time_us":11264,"spinlock_wait_cycles":12452224,"thread_start_us":28156,"threads_started":2,"wal-append.queue_time_us":63212}
I20260709 12:25:27.215083 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:27.215754 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:27.216481 12557 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:27.201934 16648 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.217325 12630 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: [6.9-6.9]
I20260709 12:25:27.220131 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.218225 16504 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:27.219043 16576 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:27.223649 16576 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.224032 16576 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.225143 16293 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:27.225694 16293 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:27.226554 16293 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.227442 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:27.228737 16404 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:27.218655 16522 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:27.229254 16404 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:27.229769 16522 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:27.229544 16572 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:27.230195 16522 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.232124 12701 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: [8.6-9.7]
I20260709 12:25:27.232017 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:27.208755 16561 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:27.257768 16661 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.258484 16661 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.260938 16661 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:27.236320 12626 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 2148) took 2821 ms (client timeout 1889 ms). Trace:
W20260709 12:25:27.262601 12626 rpcz_store.cc:269] 0709 12:25:24.411636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.411750 (+   114us) service_pool.cc:224] Handling call
0709 12:25:27.230906 (+2819156us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b540021f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.232873 (+  1967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2498499456}
I20260709 12:25:27.214052 16479 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:27.266192 12701 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:27.230376 16572 consensus_queue.cc:1243] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 11.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:27.269968 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:27.218973 16648 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.230381 16586 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.265343 16479 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:27.230355 16404 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.235248 16595 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.269851 16561 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:27.293113 16479 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.293200 16620 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.321651 16660 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.322432 16660 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.322899 16620 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.324775 16561 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.328133 16522 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.329527 16648 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.336941 16660 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.337275 16648 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.326932 16576 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.347409 16576 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.349812 16522 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.352847 16479 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.355355 16479 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:27.404460 16634 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
W20260709 12:25:27.529872 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:27.530671 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.531968 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 1058) took 1139 ms. Trace:
I20260709 12:25:27.532409 13234 rpcz_store.cc:276] 0709 12:25:26.392430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.513429 (+120999us) service_pool.cc:224] Handling call
0709 12:25:26.513823 (+   394us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.936865 (+423042us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.531697 (+594832us) spinlock_profiling.cc:243] Waited 421 ms on lock 0x7b5400133154. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:27.531904 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":968045824}
I20260709 12:25:27.531870 12445 maintenance_manager.cc:643] P 3f1cbd60b6244caaa2ca6d4aafd3dea2: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 0.995s	user 0.136s	sys 0.024s Metrics: {"bytes_written":28923,"cfile_init":1,"dirs.queue_time_us":1211,"dirs.run_cpu_time_us":709,"dirs.run_wall_time_us":1324,"drs_written":1,"lbm_read_time_us":386,"lbm_reads_lt_1ms":4,"lbm_write_time_us":19018,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":29,"peak_mem_usage":0,"rows_written":63,"thread_start_us":1766,"threads_started":2,"wal-append.queue_time_us":1402}
I20260709 12:25:27.534687 12446 maintenance_manager.cc:419] P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10540 bytes on disk
I20260709 12:25:27.535127 16416 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.536674 16416 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.537050 12445 maintenance_manager.cc:643] P 3f1cbd60b6244caaa2ca6d4aafd3dea2: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":303,"lbm_reads_lt_1ms":4}
I20260709 12:25:27.537115 16416 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.541294 16416 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.546089 16416 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.546753 16416 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.549243 16416 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.598578 16416 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.599167 16416 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.601449 16416 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.613008 16416 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:27.613675 16416 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.616036 16416 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:27.626226 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 1.01265e+06us
I20260709 12:25:27.634820 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:27.635412 12629 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.642230 12629 raft_consensus.cc:2468] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:27.643445 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:27.644809 12629 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:27.678560 16494 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.681804 16625 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.107926 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet d9812250f15d4075a3c8831ca5f3ed41 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
W20260709 12:25:27.699782 12442 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 607873us
I20260709 12:25:27.708508 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2119) took 1473 ms. Trace:
I20260709 12:25:27.708973 12705 rpcz_store.cc:276] 0709 12:25:26.235534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.164952 (+929418us) service_pool.cc:224] Handling call
0709 12:25:27.166118 (+  1166us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:27.182804 (+ 16686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.182839 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:27.186945 (+  4106us) log.cc:844] Serialized 52 byte log entry
0709 12:25:27.708149 (+521204us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:27.708187 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.708251 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.708295 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:27.708306 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:27.708447 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2417,"raft.queue_time_us":930,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":6282,"thread_start_us":477149,"threads_started":1,"wal-append.queue_time_us":95640}
I20260709 12:25:27.739686 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:27.740501 12559 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:27.737589 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:27.742529 12559 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:27.742892 12559 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:27.743451 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.743578 12559 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.746332 12559 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.746532 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.747175 12550 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:27.748792 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.749778 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:27.740819 16494 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.752274 16494 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.754082 12559 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 9. (term mismatch)
I20260709 12:25:27.754556 12559 pending_rounds.cc:85] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 8
I20260709 12:25:27.754699 16494 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.754848 12559 pending_rounds.cc:107] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 10.9
W20260709 12:25:27.755054 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.755355 12559 raft_consensus.cc:2889] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:27.755993 16494 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:27.756734 12631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40560 (request call id 992) took 1878 ms (client timeout 1816 ms). Trace:
I20260709 12:25:27.756503 16494 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.756939 12634 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:27.757043 12631 rpcz_store.cc:269] 0709 12:25:25.878520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.889610 (+ 11090us) service_pool.cc:224] Handling call
0709 12:25:27.756427 (+1866817us) spinlock_profiling.cc:243] Waited 497 ms on lock 0x7b54002139d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.756640 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1142475520}
W20260709 12:25:27.758559 16658 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.654s	user 0.005s	sys 0.000s
I20260709 12:25:27.758615 16625 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:27.759140 16494 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.759435 16625 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:27.759747 16494 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:27.760535 16494 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.764886 16506 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:27.759882 16625 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:27.765309 16506 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:27.767531 16506 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.768942 16416 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.769359 16416 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:27.769780 16416 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.766100 16625 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.778467 16506 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:27.780139 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 846) took 1323 ms. Trace:
I20260709 12:25:27.766419 16494 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.785538 12705 rpcz_store.cc:276] 0709 12:25:26.456362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.710307 (+1253945us) service_pool.cc:224] Handling call
0709 12:25:27.710742 (+   435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.711591 (+   849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.711620 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.712075 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.765529 (+ 53454us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:27.765567 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.765635 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.779889 (+ 14254us) raft_consensus.cc:1685] finished
0709 12:25:27.779913 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:27.780073 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":345,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":53104,"threads_started":1,"wal-append.queue_time_us":63816}
W20260709 12:25:27.794095 16592 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:25:27.794112 16416 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.797461 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1010) took 1342 ms. Trace:
I20260709 12:25:27.797601 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:27.798136 12552 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:27.799299 12708 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2112) took 1683 ms (client timeout 1842 ms). Trace:
I20260709 12:25:27.800820 12707 raft_consensus.cc:1240] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:27.801972 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 839) took 1772 ms. Trace:
I20260709 12:25:27.802281 12707 rpcz_store.cc:276] 0709 12:25:26.029252 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.474243 (+444991us) service_pool.cc:224] Handling call
0709 12:25:27.800651 (+1326408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.801219 (+   568us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.801781 (+   562us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b5400440050. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.801895 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3049684352}
I20260709 12:25:27.803546 12707 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:27.804979 12552 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:27.806190 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 843) took 1651 ms. Trace:
I20260709 12:25:27.806546 12699 rpcz_store.cc:276] 0709 12:25:26.154713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.836021 (+681308us) service_pool.cc:224] Handling call
0709 12:25:26.850414 (+ 14393us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.937157 (+ 86743us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.805985 (+868828us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b540004fbd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:27.806139 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":109055232}
I20260709 12:25:27.807114 16416 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.807904 12699 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:27.808866 12699 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:27.799669 12708 rpcz_store.cc:269] 0709 12:25:26.116216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.266313 (+150097us) service_pool.cc:224] Handling call
0709 12:25:27.799115 (+1532802us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400440054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.799246 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1405534464}
I20260709 12:25:27.797873 12556 rpcz_store.cc:276] 0709 12:25:26.454892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.455121 (+   229us) service_pool.cc:224] Handling call
0709 12:25:26.455502 (+   381us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.070339 (+614837us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.797222 (+726883us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b540033f254. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:27.797386 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1412565888}
I20260709 12:25:27.818518 16625 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.820278 16374 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:27.826161 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:27.826476 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 889) took 1743 ms (client timeout 1717 ms). Trace:
I20260709 12:25:27.826764 12556 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:27.826932 13235 rpcz_store.cc:269] 0709 12:25:26.082770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.179009 (+ 96239us) service_pool.cc:224] Handling call
0709 12:25:27.826077 (+1647068us) spinlock_profiling.cc:243] Waited 254 ms on lock 0x7b54006f63d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.826405 (+   328us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":583903616}
I20260709 12:25:27.828259 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.828326 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.829479 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.830009 13233 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:27.830255 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.831485 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.833083 16656 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:27.834699 12556 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:27.835201 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.836879 13231 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 886) took 2275 ms. Trace:
I20260709 12:25:27.837285 13231 rpcz_store.cc:276] 0709 12:25:25.561187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.744512 (+183325us) service_pool.cc:224] Handling call
0709 12:25:26.433545 (+689033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:26.434197 (+   652us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.836686 (+1402489us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54001b3850. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:27.836819 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1583813888}
I20260709 12:25:27.838248 16625 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:27.839536 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 990) took 2029 ms. Trace:
I20260709 12:25:27.839898 12630 rpcz_store.cc:276] 0709 12:25:25.811068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.193238 (+382170us) service_pool.cc:224] Handling call
0709 12:25:26.193515 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.219126 (+1025611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.839272 (+620146us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54001310d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:27.839478 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2335096576}
I20260709 12:25:27.840498 13235 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:27.842430 16374 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:27.845269 12558 consensus_meta.cc:287] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.001s
I20260709 12:25:27.845739 12558 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:27.845974 13229 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:27.848889 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.850690 16374 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:27.878363 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.883170 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.886550 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.892725 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.893553 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:27.894245 13232 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:27.895344 12674 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.895459 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.896445 12551 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:27.896576 16640 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:27.897116 16640 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:27.898191 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:27.899163 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.901057 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:27.899801 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.902210 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 848) took 1113 ms. Trace:
I20260709 12:25:27.905867 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.905063 12705 rpcz_store.cc:276] 0709 12:25:26.789211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.788190 (+998979us) service_pool.cc:224] Handling call
0709 12:25:27.788522 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:27.788724 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:27.896397 (+107673us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.901715 (+  5318us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.901913 (+   198us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:27.901958 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:27.901996 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.902055 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:27.902158 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59132,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"thread_start_us":38565,"threads_started":1}
I20260709 12:25:27.900353 16656 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:27.902782 16625 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.909140 16625 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:27.902631 16416 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:27.911546 16416 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:27.907943 16656 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:27.909925 16640 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.909875 13198 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:27.917138 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:27.913897 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.919008 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.920960 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:27.922367 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:27.923779 16660 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:27.912456 16416 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.926465 16660 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:27.926888 16660 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:27.927877 16660 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.928351 16656 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.929328 16660 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:27.931926 12701 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.006s	sys 0.006s
W20260709 12:25:27.932251 12701 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.007s	sys 0.007s
I20260709 12:25:27.932894 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2314) took 1570 ms. Trace:
I20260709 12:25:27.933208 12701 rpcz_store.cc:276] 0709 12:25:26.362487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.267974 (+905487us) service_pool.cc:224] Handling call
0709 12:25:27.268363 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.268779 (+   416us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.268826 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.272252 (+  3426us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.932576 (+660324us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:27.932615 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.932682 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.932727 (+    45us) raft_consensus.cc:1685] finished
0709 12:25:27.932738 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:27.932844 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2455,"raft.queue_time_us":100,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":12248,"thread_start_us":650272,"threads_started":1,"wal-append.queue_time_us":66388}
I20260709 12:25:27.943459 16628 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:27.944120 16628 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.948913 12699 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:27.949059 16416 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:27.951112 16531 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:27.952739 16531 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:27.954308 16479 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:27.912722 16625 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:27.955025 16625 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:27.954789 16479 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:27.938601 16374 raft_consensus.cc:2804] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:27.967125 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:27.967949 12551 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:27.957518 16531 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:27.972049 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 53080.8us
I20260709 12:25:27.973477 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:27.977392 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.977778 12674 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:27.952751 16522 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:25:27.949692 16416 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:27.973664 16374 raft_consensus.cc:697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:27.969550 16628 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.972270 16479 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:27.981544 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.978492 16656 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:27.984910 16690 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.993635 16687 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:27.994150 16687 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:27.980742 16416 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.997247 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.999375 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:27.992412 16531 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:28.002424 16531 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.002826 16531 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.991605 16656 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.005131 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.005568 13235 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:28.004463 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:28.003355 16479 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.009954 16626 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:28.010510 16626 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.012682 16626 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.015681 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:28.015084 16517 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.017213 16517 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.017717 16664 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:28.017827 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:28.018314 16664 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.018704 16664 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.020666 16625 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.017668 16517 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:28.022244 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.005708 16656 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.023983 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.025722 16667 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:28.026211 16667 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.027058 16667 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.028199 16517 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:28.021651 16687 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:28.008867 16690 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.028978 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.029608 12551 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:28.032099 16517 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:28.049957 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2106) took 2255 ms. Trace:
I20260709 12:25:28.049063 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.050390 12706 rpcz_store.cc:276] 0709 12:25:25.794803 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.056681 (+261878us) service_pool.cc:224] Handling call
0709 12:25:26.056955 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:26.111687 (+ 54732us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:26.278389 (+166702us) log.cc:844] Serialized 14 byte log entry
0709 12:25:26.510527 (+232138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:26.510590 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:26.510671 (+    81us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.049729 (+1539058us) spinlock_profiling.cc:243] Waited 54.5 ms on lock 0x7b540042b154. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:28.049775 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.049898 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":265219,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":4613,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7500,"spinlock_wait_cycles":125353856,"thread_start_us":341280,"threads_started":2,"wal-append.queue_time_us":240175}
I20260709 12:25:28.052821 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:28.033368 16374 consensus_queue.cc:237] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.059466 16692 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:25:28.059926 16687 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.066139 16486 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:28.066504 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.066874 15839 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.067279 16638 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:28.067533 16486 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:28.067389 15839 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.068076 16486 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.068205 16638 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:28.068609 16638 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.069348 16638 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.070683 16638 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.071671 16625 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.071913 16506 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.072088 16628 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:28.072431 16506 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.072939 16628 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:28.073796 16628 consensus_queue.cc:1059] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:28.074564 16506 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.076150 16628 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:28.076551 16628 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:28.077351 16648 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:28.077848 16648 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:28.068948 16486 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:28.063827 12673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.010s	sys 0.016s
W20260709 12:25:28.078974 12673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.233s	user 0.011s	sys 0.016s
I20260709 12:25:28.078713 16648 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.080032 16648 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.081573 16404 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:28.082042 16404 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:28.082712 16625 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.082932 16404 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.084297 16404 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.084595 12699 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:25:28.084964 12699 pending_rounds.cc:85] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 9
I20260709 12:25:28.085180 12699 pending_rounds.cc:107] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 12:25:28.032210 16479 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:28.085397 12699 raft_consensus.cc:2889] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.086653 16628 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.087821 16478 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.088354 16478 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.090380 16478 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.083319 16625 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:28.091640 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 200707us
I20260709 12:25:28.096902 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:28.098063 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 471046us
I20260709 12:25:28.103750 12708 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:28.109382 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:28.110126 12558 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:28.110420 12556 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:28.111202 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.111625 12550 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: [9.7-11.8]
I20260709 12:25:28.116328 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.112802 12550 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:28.113644 12632 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:28.118266 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.144855 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.116683 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.117725 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.145777 12628 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:28.050416 16517 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:28.145429 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.112565 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.069080 16531 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.126055 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.149348 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.149938 12551 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.145066 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.151031 13230 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.151131 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.028638 16664 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.113937 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.162081 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:28.162258 12522 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Timed out: RequestConsensusVote RPC to 127.11.32.2:34669 timed out after 1.624s (SENT)
I20260709 12:25:28.155372 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.162873 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.154784 12552 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:28.156875 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.166914 12550 raft_consensus.cc:2393] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 3: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:28.087837 16628 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.169770 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.146325 12630 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.168757 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.170262 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.171294 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.172084 12634 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:28.172624 12632 raft_consensus.cc:2368] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:28.173117 12699 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:28.143878 16479 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.173049 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.188490 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.104568 16561 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:25:28.101347 16259 consensus_queue.cc:1059] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:25:28.190528 12554 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:28.199923 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:28.190872 12705 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:28.168604 16494 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.169862 16540 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.101071 16270 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 12:25:28.103870 16522 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.085s
I20260709 12:25:28.167008 16576 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:28.182520 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.208367 12708 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:28.208477 12671 leader_election.cc:400] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:28.166615 16667 consensus_queue.cc:1059] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:28.219233 12671 leader_election.cc:403] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:28.234969 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.217903 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.235963 12632 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.236397 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.192135 16418 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.282271 13228 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:28.250259 16446 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 12:25:28.288079 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:28.336534 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 171999us
I20260709 12:25:28.337702 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.339157 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.234422 16561 consensus_queue.cc:1243] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:28.235179 16506 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.341346 16506 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.340405 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.197654 16479 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.194242 16657 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:25:28.287755 16259 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:28.352078 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.220038 16540 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.214841 16690 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:28.345872 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.347324 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.327478 16625 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.282284 16576 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.330181 16692 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.199977 16517 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.335925 16586 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.358837 12626 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 996) took 1248 ms. Trace:
I20260709 12:25:28.363090 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.366286 12551 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:28.282024 16662 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9.
I20260709 12:25:28.352137 16259 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.377950 16664 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.378141 16259 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.378978 16540 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.379611 16259 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.380962 16416 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.383169 16416 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:28.381435 12558 raft_consensus.cc:2410] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:28.383324 16531 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.360817 16690 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:28.372812 12626 rpcz_store.cc:276] 0709 12:25:27.110098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.264091 (+153993us) service_pool.cc:224] Handling call
0709 12:25:27.264526 (+   435us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:27.895301 (+630775us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:27.942148 (+ 46847us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.113971 (+171823us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:28.114484 (+   513us) log.cc:844] Serialized 52 byte log entry
0709 12:25:28.114647 (+   163us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:28.114681 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.114737 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.358622 (+243885us) raft_consensus.cc:1685] finished
0709 12:25:28.358647 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.358780 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":763832,"prepare.queue_time_us":70989,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":44,"raft.queue_time_us":946138,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":9373,"thread_start_us":71850,"threads_started":2,"wal-append.queue_time_us":52417}
I20260709 12:25:28.359189 16656 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.389792 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.390558 12626 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:28.391238 16656 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.391618 12626 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:28.391144 16479 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.376616 16586 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.414171 16586 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.372723 16692 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.416285 16692 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.393213 16576 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.397251 12634 raft_consensus.cc:2393] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:28.419209 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.420352 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.388774 16690 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:28.375654 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.399901 12626 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:28.396869 16506 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.364686 16657 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:28.373199 16667 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.449833 12626 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:28.450778 12626 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.366273 16625 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.451195 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.455013 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.421300 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.455787 12699 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:28.456246 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.457623 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.452555 16667 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.458705 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.459699 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.460472 16667 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.461517 12626 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.465886 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.466454 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.466868 12631 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:28.467620 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.467856 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.468703 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:28.439006 12729 debug-util.cc:398] Leaking SignalData structure 0x7b08001d57c0 after lost signal to thread 11395
W20260709 12:25:28.471124 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.436663 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.472645 12557 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
W20260709 12:25:28.397199 16693 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260709 12:25:28.474673 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2125) took 1469 ms. Trace:
I20260709 12:25:28.474992 12707 rpcz_store.cc:276] 0709 12:25:27.005422 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.805201 (+799779us) service_pool.cc:224] Handling call
0709 12:25:27.813636 (+  8435us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.814050 (+   414us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:27.963773 (+149723us) log.cc:844] Serialized 14 byte log entry
0709 12:25:27.998337 (+ 34564us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.998847 (+   510us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.998967 (+   120us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:27.998997 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.999067 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:28.474494 (+475427us) raft_consensus.cc:1685] finished
0709 12:25:28.474513 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.474621 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13056,"prepare.queue_time_us":33963,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":13996,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":3716,"thread_start_us":157691,"threads_started":2,"wal-append.queue_time_us":64502}
I20260709 12:25:28.476631 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.478091 13234 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:28.479936 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.480525 12558 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:28.438622 16687 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:28.435781 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.481357 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.483922 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.421155 15839 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.481506 16687 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:28.485769 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.482556 12556 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:28.482860 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.482721 12704 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:28.488574 12630 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:28.486388 16687 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.490934 16687 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.490312 16690 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.493960 16690 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:28.494365 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:28.481918 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.495494 16563 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.496026 12551 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.497884 16634 consensus_queue.cc:1059] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:28.498811 16626 raft_consensus.cc:3055] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:28.499181 16626 raft_consensus.cc:740] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.499437 16634 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.499992 16626 consensus_queue.cc:260] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.486366 12634 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.501160 16626 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.539314 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.504285 12557 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:25:28.540441 12557 pending_rounds.cc:85] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 8
I20260709 12:25:28.540402 16494 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:28.540839 12557 pending_rounds.cc:107] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260709 12:25:28.541107 12557 raft_consensus.cc:2889] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.505153 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:28.506016 12558 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:28.505353 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.545053 16652 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:28.545492 16652 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.545850 16652 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.546706 12627 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:28.547338 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 998) took 1436 ms. Trace:
I20260709 12:25:28.547629 12627 rpcz_store.cc:276] 0709 12:25:27.110645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.266891 (+156246us) service_pool.cc:224] Handling call
0709 12:25:28.546499 (+1279608us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.547110 (+   611us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.547287 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:28.548584 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.550488 12556 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:28.551141 16418 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.553045 12558 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:28.553956 16569 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:28.555217 16487 raft_consensus.cc:3055] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:28.555564 16487 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.556340 16487 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.557319 12556 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:28.557618 16487 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.535948 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:28.559496 12700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 2316) took 2105 ms (client timeout 1829 ms). Trace:
W20260709 12:25:28.559849 12700 rpcz_store.cc:269] 0709 12:25:26.454262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.469021 (+ 14759us) service_pool.cc:224] Handling call
0709 12:25:28.559279 (+2090258us) spinlock_profiling.cc:243] Waited 691 ms on lock 0x7b5400041ad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:28.559397 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1590389504}
I20260709 12:25:28.560873 12703 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.562115 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2117) took 2377 ms. Trace:
I20260709 12:25:28.562539 16690 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:28.563424 16661 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:28.564940 16690 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:28.512073 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1026) took 1266 ms. Trace:
I20260709 12:25:28.514643 12551 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:28.570607 16418 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:28.570828 12555 rpcz_store.cc:276] 0709 12:25:27.246137 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.246314 (+   177us) service_pool.cc:224] Handling call
0709 12:25:28.511576 (+1265262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.511751 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.511781 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:28.511827 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:28.511860 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.511916 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.512019 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:28.572960 12557 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:28.515682 16486 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:25:28.574203 12729 debug-util.cc:398] Leaking SignalData structure 0x7b08000c2440 after lost signal to thread 12491
I20260709 12:25:28.574153 16486 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:25:28.575533 12729 debug-util.cc:398] Leaking SignalData structure 0x7b08003881a0 after lost signal to thread 12583
I20260709 12:25:28.575215 16486 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:28.576748 12729 debug-util.cc:398] Leaking SignalData structure 0x7b080039f9a0 after lost signal to thread 12658
I20260709 12:25:28.518572 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:28.522365 16629 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.577870 12674 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:28.578701 16687 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:28.579802 16660 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.580813 16446 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:28.581197 16446 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:28.582495 16446 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.583765 16446 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:28.584689 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.519119 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.522936 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:28.523005 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.526206 12634 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:28.522220 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:28.528510 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 842) took 2391 ms. Trace:
I20260709 12:25:28.587298 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.526621 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:28.587594 12701 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.528277 16634 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:25:28.588325 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 61793.1us
I20260709 12:25:28.533340 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:28.589715 16337 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:28.590212 12729 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5e20 after lost signal to thread 12732
I20260709 12:25:28.590379 16337 consensus_queue.cc:1059] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:25:28.590667 12729 debug-util.cc:398] Leaking SignalData structure 0x7b08003aef40 after lost signal to thread 12733
W20260709 12:25:28.592216 12729 debug-util.cc:398] Leaking SignalData structure 0x7b080009d480 after lost signal to thread 13259
W20260709 12:25:28.593024 12729 debug-util.cc:398] Leaking SignalData structure 0x7b080035bb00 after lost signal to thread 13260
I20260709 12:25:28.587527 12702 rpcz_store.cc:276] 0709 12:25:26.137142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.754015 (+616873us) service_pool.cc:224] Handling call
0709 12:25:27.123750 (+369735us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:27.124092 (+   342us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:27.124118 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:27.124517 (+   399us) log.cc:844] Serialized 26 byte log entry
0709 12:25:27.205504 (+ 80987us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:27.205540 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:27.205601 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:27.280932 (+ 75331us) raft_consensus.cc:1685] finished
0709 12:25:27.280959 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:28.528280 (+1247321us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54003eb2d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:28.528453 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1071,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":849577856,"thread_start_us":80594,"threads_started":1,"wal-append.queue_time_us":150203,"wal-append.run_cpu_time_us":3348,"wal-append.run_wall_time_us":1010202}
I20260709 12:25:28.593065 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.534682 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:28.535046 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.594321 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.594863 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.595450 12629 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:28.592103 16594 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:28.481103 16491 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:28.535923 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.598182 12633 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:28.598461 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:28.597198 16594 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:28.599208 12633 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:28.599742 16594 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.600728 16594 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.536298 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:28.536860 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.537001 15839 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:28.554251 12558 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.562415 12703 rpcz_store.cc:276] 0709 12:25:26.184864 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.143818 (+958954us) service_pool.cc:224] Handling call
0709 12:25:28.560715 (+1416897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:28.561235 (+   520us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.561946 (+   711us) spinlock_profiling.cc:243] Waited 1.42 s on lock 0x7b5400041ad0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:28.562068 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3257872128}
I20260709 12:25:28.469193 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.568420 16493 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:28.449590 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.601902 12628 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:28.601374 12629 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.569548 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.606223 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.605296 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.508800 16657 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:28.604772 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:28.506369 12632 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:28.608179 12703 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:28.589355 13229 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.576710 16486 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:28.611322 12628 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.611742 13199 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:28.613051 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 86967.8us
I20260709 12:25:28.567199 16506 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.602911 16270 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:25:28.602166 16595 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:28.618077 16569 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:28.619192 16478 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:28.617622 16660 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.619621 16478 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:28.621167 16478 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.622375 16478 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:28.622031 16506 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.622607 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:28.624784 16506 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:28.627019 12625 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:28.628563 12625 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:28.628820 13229 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:28.629719 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.630946 16545 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.631314 16493 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.632427 16652 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:28.635784 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:28.636119 12625 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:28.637065 16493 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:28.611544 16657 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.640103 16657 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:28.640292 16545 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.645680 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.645820 12552 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:25:28.646840 12552 pending_rounds.cc:85] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 6
I20260709 12:25:28.647086 12552 pending_rounds.cc:107] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:28.647302 12552 raft_consensus.cc:2889] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.651726 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.652056 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.652297 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.654762 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.655505 13227 raft_consensus.cc:2410] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:28.656936 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.657792 12707 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:28.659251 12702 raft_consensus.cc:2393] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:28.672410 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.674221 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.677850 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.684983 12701 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:28.690954 12626 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:28.699600 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.675909 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.706522 12702 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:28.707374 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.709296 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.711544 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:28.714905 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:28.720501 12630 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:28.721267 12701 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:28.725455 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 49590.6us
I20260709 12:25:28.726217 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.731670 13232 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.731734 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:28.732201 13199 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.732671 12706 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:28.733099 12632 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:28.733580 12632 pending_rounds.cc:85] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 7
I20260709 12:25:28.733888 12632 pending_rounds.cc:107] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:28.734170 12632 raft_consensus.cc:2889] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:28.735016 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.581192 16687 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:28.737001 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.743965 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.757093 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:28.759795 12706 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:28.760356 12699 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:28.669039 16259 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:28.727358 16504 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:25:28.707386 16629 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:28.768940 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:28.719514 16491 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.721714 16418 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:28.787696 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.811844 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:28.814262 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:28.758497 16628 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.816836 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:28.759003 16494 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:28.758302 16618 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.670013 16506 consensus_queue.cc:1059] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260709 12:25:28.830955 13228 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:28.780287 16487 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.835661 12629 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:28.737814 16593 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 12:25:28.823694 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:28.833030 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:28.848644 12559 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:28.851234 12550 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.010s	sys 0.009s
W20260709 12:25:28.851676 12550 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.010s	sys 0.009s
I20260709 12:25:28.815883 16692 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.830390 16664 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:28.835069 16531 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:28.830171 16667 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.857221 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:28.868301 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 44711.6us
I20260709 12:25:28.779270 16259 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.829253 16519 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 11.13, Next index: 14, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:25:28.820663 16625 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:28.855744 16293 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.854909 16506 consensus_queue.cc:1243] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:28.869112 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:28.828207 16418 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.835628 16639 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
W20260709 12:25:28.880242 16659 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.673s	user 0.004s	sys 0.015s
I20260709 12:25:28.851902 16620 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:28.852291 16540 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:28.882194 16593 consensus_queue.cc:1243] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:25:28.912508 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 43485.1us
I20260709 12:25:28.883731 16687 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.880141 16667 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:28.851459 16487 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:28.913095 16659 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.004s	sys 0.016s
I20260709 12:25:28.859798 16270 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:25:28.912578 16402 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.045s
I20260709 12:25:28.916419 16479 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:29.006553 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 248084us
W20260709 12:25:29.017445 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 248597us
W20260709 12:25:28.952947 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.025055 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.029731 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:29.093506 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 63878.5us
W20260709 12:25:29.039752 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.055202 13232 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:29.023612 16638 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.089481 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:29.090293 16402 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.013s	sys 0.045s
I20260709 12:25:29.042689 16517 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:29.169126 16716 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
W20260709 12:25:29.170190 16719 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
W20260709 12:25:29.171622 16712 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:25:29.173220 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2192) took 1062 ms. Trace:
W20260709 12:25:29.173990 16714 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:25:29.178267 16418 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:29.181607 12555 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:29.183014 12555 raft_consensus.cc:3055] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.183370 12555 raft_consensus.cc:740] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:29.184563 16446 consensus_meta.cc:287] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.600s	user 0.010s	sys 0.001s
I20260709 12:25:29.173746 12553 rpcz_store.cc:276] 0709 12:25:28.110780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.110912 (+   132us) service_pool.cc:224] Handling call
0709 12:25:28.111206 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.114298 (+  3092us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:28.289356 (+175058us) log.cc:844] Serialized 14 byte log entry
0709 12:25:28.443560 (+154204us) spinlock_profiling.cc:243] Waited 4.44 ms on lock 0x7b4800080358. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e99a14aa1 00007f0e99a0bb37 00007f0e99a0b9ca 00007f0e99b0326f 00007f0e99b02f37 00007f0e99b1755c 00007f0e99b17508 00007f0e99b17488 00007f0e99b17443 00007f0e99b166ec 00007f0e98a40a96
0709 12:25:28.725093 (+281533us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.725643 (+   550us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.725762 (+   119us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:28.725791 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.725852 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.172848 (+446996us) raft_consensus.cc:1685] finished
0709 12:25:29.172995 (+   147us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.173161 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2702,"prepare.queue_time_us":237636,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":32112,"raft.run_cpu_time_us":2497,"raft.run_wall_time_us":302689,"spinlock_wait_cycles":10209664,"thread_start_us":479274,"threads_started":2,"wal-append.queue_time_us":537339}
I20260709 12:25:29.120719 16479 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:29.181247 16486 consensus_meta.cc:287] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.565s	user 0.003s	sys 0.004s
I20260709 12:25:29.184511 12555 consensus_queue.cc:260] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.202972 12558 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:29.144039 16659 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:29.212321 12555 raft_consensus.cc:3060] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.223476 13234 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
W20260709 12:25:29.228318 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 203358us
I20260709 12:25:29.229188 12523 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.230283 13230 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:29.188796 16628 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.238075 13235 raft_consensus.cc:1240] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:29.238850 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.241559 12523 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.249523 12555 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:29.253638 12631 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:29.228508 16629 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:29.235877 16487 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.244565 16659 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:29.244627 16628 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.242965 16741 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.270354 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:29.272013 16723 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:25:29.274472 13226 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:29.255276 16667 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:29.279362 12552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.013s	sys 0.010s
W20260709 12:25:29.280017 12552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.013s	sys 0.010s
W20260709 12:25:29.290405 16715 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.169s	user 0.000s	sys 0.001s
W20260709 12:25:29.297751 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 56323.5us
W20260709 12:25:29.302085 16729 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:29.302876 16692 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.293591 16741 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.306458 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:29.291035 16745 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.281239 16479 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.297749 16738 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:29.313696 16738 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.315541 16402 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:29.315930 16402 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:29.315984 16738 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:29.288302 16656 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:29.319505 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:29.317337 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.328361 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:29.329267 16494 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:29.339934 16755 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:29.316800 16402 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.319911 16738 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:29.322974 16741 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.321012 16750 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:29.349191 16750 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:29.349270 16638 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:29.349690 16750 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:29.348080 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.333962 16486 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:29.350979 16599 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
W20260709 12:25:29.351488 16725 log.cc:927] Time spent T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:29.352262 16478 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:29.352645 12634 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1016) took 1204 ms. Trace:
I20260709 12:25:29.354444 16738 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.357467 16486 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.359649 16486 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.343180 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1032) took 1168 ms. Trace:
I20260709 12:25:29.360275 12550 rpcz_store.cc:276] 0709 12:25:28.174347 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.175164 (+   817us) service_pool.cc:224] Handling call
0709 12:25:28.175475 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.189927 (+ 14452us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.189959 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.200194 (+ 10235us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.852082 (+651888us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:28.852119 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.852185 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.342671 (+490486us) raft_consensus.cc:1685] finished
0709 12:25:29.342691 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.342827 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":691,"raft.queue_time_us":16449,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":4615,"thread_start_us":564271,"threads_started":1,"wal-append.queue_time_us":778102}
I20260709 12:25:29.362728 16707 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.363255 16707 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:29.363499 16628 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.364609 16402 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:29.366813 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 275433us
I20260709 12:25:29.368490 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:29.310027 16659 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.369758 16376 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:29.370414 16738 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.353012 12634 rpcz_store.cc:276] 0709 12:25:28.148079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.595100 (+447021us) service_pool.cc:224] Handling call
0709 12:25:28.595380 (+   280us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.595703 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.595728 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.596181 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.989979 (+393798us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:28.990040 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.990138 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.352436 (+362298us) raft_consensus.cc:1685] finished
0709 12:25:29.352458 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:29.352588 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":97,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":104,"thread_start_us":393328,"threads_started":1,"wal-append.queue_time_us":662512}
I20260709 12:25:29.349745 16638 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:29.338486 16657 consensus_meta.cc:287] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.698s	user 0.006s	sys 0.007s
W20260709 12:25:29.384790 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 295342us
W20260709 12:25:29.375279 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.379483 16293 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:29.374204 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.352645 16478 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:29.394462 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 71078.4us
W20260709 12:25:29.403600 16752 log.cc:927] Time spent T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:25:29.407126 16734 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.407518 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:29.403638 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 163069us
I20260709 12:25:29.409112 16594 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.409871 16478 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.410504 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:29.411264 16734 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.411389 16478 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:29.412171 12600 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:29.412911 16734 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.386247 16494 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:29.413362 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:29.390273 16585 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.414062 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:29.398880 16270 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.430579 12701 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:25:29.430675 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 85643.7us
I20260709 12:25:29.431164 12700 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:29.431707 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.390477 16657 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.432646 12707 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:29.434511 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:29.420107 16376 raft_consensus.cc:2764] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:29.439738 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:29.426960 16594 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.426620 16270 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:29.449288 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:29.393294 16707 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.424279 16561 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:29.432374 15839 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.018s
I20260709 12:25:29.454546 16504 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:29.454953 16734 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.455595 16738 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:29.456658 16692 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:29.458828 16657 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.440552 16639 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.471268 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:29.478560 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.450263 16270 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.441712 16656 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:25:29.424947 16494 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.482136 16755 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.479336 16376 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:25:29.517066 12634 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:29.512017 16491 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.704s	user 0.013s	sys 0.000s
I20260709 12:25:29.518038 12634 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:29.495133 16532 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:25:29.518363 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 71976.8us
I20260709 12:25:29.521840 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.520113 12634 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:29.522970 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 69609.6us
I20260709 12:25:29.492358 16734 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.527837 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.521456 16491 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:29.570811 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.573285 16734 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:29.573746 16754 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:29.574517 16762 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.575496 12629 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:25:29.575845 12629 pending_rounds.cc:85] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 7
I20260709 12:25:29.576052 12629 pending_rounds.cc:107] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:29.576257 12629 raft_consensus.cc:2889] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:29.578729 12627 raft_consensus.cc:1275] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:25:29.573503 16753 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:25:29.579905 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.584394 12627 raft_consensus.cc:2410] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:29.584889 16757 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.580528 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.567364 16708 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:29.611929 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:29.612639 13228 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:29.612761 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.588038 12630 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:29.617769 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:29.618678 12630 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:29.629061 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:29.632294 12630 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:29.577590 16402 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.639143 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.640736 12630 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:29.642755 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:29.647228 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:29.648128 12701 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:29.651894 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.582615 16486 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:29.656051 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.655030 12522 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.658906 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:29.663439 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:29.662425 12708 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:29.640545 16491 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.640246 16639 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.589546 16374 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:25:29.673077 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:29.673553 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:29.681643 16755 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:29.681593 16639 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.683768 16639 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.683876 16755 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:29.684507 16755 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.684967 16755 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:29.690043 16756 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:29.690830 16756 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.693609 16745 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:29.694380 16745 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.661353 16618 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:29.652153 16293 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:25:29.710492 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:29.711961 12630 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:29.675572 16569 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.660939 16332 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:25:29.680476 16659 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:29.657953 16402 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.713243 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:29.585572 16757 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:29.728055 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 73048.5us
I20260709 12:25:29.709829 16639 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:29.734045 12522 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.661818 16486 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:29.739591 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 70630.8us
I20260709 12:25:29.740684 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:29.742970 16778 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.743589 16778 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.744316 16778 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:29.744630 16765 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:25:29.697335 16491 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:29.745296 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.716610 16569 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:29.761806 16569 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.764722 16768 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.765281 16768 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.768847 16756 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:29.770143 16771 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:29.772086 16540 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.772611 16540 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:29.772473 16569 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.773660 16540 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.758064 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:25:29.927686 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 169730us
I20260709 12:25:29.928985 16494 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:29.791415 16569 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.749027 16659 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.797134 12702 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:29.745616 16639 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:29.761672 16618 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:29.813247 16764 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.240s	user 0.001s	sys 0.000s
W20260709 12:25:29.813750 16763 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260709 12:25:29.814581 16772 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:25:29.815943 16270 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.816349 16486 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.747539 16742 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.220s
I20260709 12:25:29.818619 16491 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:29.812104 16761 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:25:29.811316 16745 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:29.824745 16755 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:29.833746 16721 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.682s	user 0.004s	sys 0.000s
I20260709 12:25:29.834254 16402 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.818871 16757 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:29.838798 16750 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.854641 16638 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.929391 16494 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:29.951092 16494 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.951718 16750 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.951869 16638 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.858764 16778 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.933763 16659 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.954634 16659 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.943585 16270 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.868431 16593 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.955482 16593 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:29.945195 16618 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.954252 13235 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:29.956342 16593 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.957213 16625 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:29.957383 16593 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.957767 16625 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:29.961436 16625 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:29.947580 16755 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.935118 16639 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.954069 16778 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.873168 16707 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.877374 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 2329) took 1226 ms. Trace:
I20260709 12:25:29.973584 12703 rpcz_store.cc:276] 0709 12:25:28.651220 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.651354 (+   134us) service_pool.cc:224] Handling call
0709 12:25:29.877162 (+1225808us) spinlock_profiling.cc:243] Waited 678 ms on lock 0x7b54003eb7d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:29.877309 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1558674304}
I20260709 12:25:29.895275 16652 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:29.899011 13230 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 914) took 1377 ms (client timeout 1635 ms). Trace:
I20260709 12:25:29.974680 16659 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:29.974908 13230 rpcz_store.cc:269] 0709 12:25:28.521877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.534430 (+ 12553us) service_pool.cc:224] Handling call
0709 12:25:29.898823 (+1364393us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b54006beed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:29.898943 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353373440}
I20260709 12:25:29.897106 16517 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:29.900452 16664 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.905721 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:29.906781 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 1069) took 1236 ms. Trace:
I20260709 12:25:29.922174 16259 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:29.974130 16540 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.979111 16517 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.981220 16517 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.977600 13234 rpcz_store.cc:276] 0709 12:25:28.670572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.677610 (+  7038us) service_pool.cc:224] Handling call
0709 12:25:29.906635 (+1229025us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b540063f1d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:29.906728 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1251673472}
I20260709 12:25:29.977927 12707 raft_consensus.cc:2410] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
W20260709 12:25:29.978317 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 49543.8us
I20260709 12:25:29.978401 16664 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.985873 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:29.986780 16664 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:29.988755 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:29.977350 16659 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:29.989104 16599 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:29.989581 16259 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:29.990298 16755 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:29.990679 16755 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:29.991472 16755 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:29.993283 16755 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:29.997323 12634 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.001289 16506 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:30.001588 16618 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:30.002456 16506 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:30.002616 12631 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2507) took 1334 ms (client timeout 1762 ms). Trace:
I20260709 12:25:30.002884 16506 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:30.003191 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1042) took 1387 ms. Trace:
W20260709 12:25:30.003085 12631 rpcz_store.cc:269] 0709 12:25:28.667858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.707075 (+ 39217us) service_pool.cc:224] Handling call
0709 12:25:30.002411 (+1295336us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b540012fa54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:30.002551 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1248258816}
I20260709 12:25:30.003782 16506 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.003856 12554 rpcz_store.cc:276] 0709 12:25:28.615708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.990881 (+375173us) service_pool.cc:224] Handling call
0709 12:25:29.023208 (+ 32327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.574421 (+551213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.574468 (+    47us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.574942 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.611901 (+ 36959us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:29.611965 (+    64us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.002690 (+390725us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54001d0bd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:30.002735 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.002853 (+   118us) raft_consensus.cc:1685] finished
0709 12:25:30.002872 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.003134 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2791,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":6433,"spinlock_wait_cycles":1260996992,"thread_start_us":26668,"threads_started":1,"wal-append.queue_time_us":131006}
I20260709 12:25:30.005434 16506 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:30.010673 16576 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:25:30.014669 16741 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:30.015059 16741 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:30.015810 16741 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.017092 16741 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:30.019230 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.022305 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.022964 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.024132 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.032493 16735 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:30.033080 16735 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.036978 16735 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:30.057542 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.064296 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.065565 16576 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.066110 16576 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.066717 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.067550 12629 raft_consensus.cc:2410] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:25:30.068166 16576 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.068365 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.069034 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.069630 12703 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.071199 16576 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.071703 16576 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.072855 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.073246 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.073966 12626 raft_consensus.cc:2368] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13.
I20260709 12:25:30.075589 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.077301 16750 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.077490 12702 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:30.077896 16750 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.079083 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.079628 12707 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:30.079902 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.080506 16750 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.081348 16757 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.081984 16757 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.083088 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:30.083884 16757 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.084319 16532 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:30.084619 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:30.084702 16532 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.084841 16745 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:30.084347 16757 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:30.085938 16757 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.087942 16664 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.088032 16757 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.081379 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.088810 12629 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.088524 16664 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.090740 16664 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.091725 16664 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:30.092422 12703 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:30.085274 16532 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.094623 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.096454 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.101725 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.103338 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.105527 13230 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:30.109812 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.112308 12629 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:30.112757 16667 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.112800 16402 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.113641 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.114580 12632 raft_consensus.cc:2393] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:30.114915 16708 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:30.115379 16708 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.115712 16708 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:30.114270 16777 consensus_queue.cc:1059] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:25:30.114276 16402 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.117036 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.113253 16667 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.121042 16595 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:30.121285 16734 consensus_queue.cc:1059] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:30.122058 15839 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:30.122437 16734 raft_consensus.cc:3055] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:30.122856 16734 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:30.122994 16504 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:30.123427 16504 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:30.124239 16734 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.124575 16504 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.125742 16734 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.128003 16402 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.130453 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:30.132014 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.136816 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.143573 13199 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:30.150321 12671 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.4:37323 timed out after 1.635s (SENT) [suppressed 12 similar messages]
I20260709 12:25:30.151733 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.152343 12700 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:30.153185 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2358) took 1569 ms. Trace:
I20260709 12:25:30.153846 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:30.157437 12707 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:30.156980 16519 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:30.153679 12559 rpcz_store.cc:276] 0709 12:25:28.583378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.880709 (+297331us) service_pool.cc:224] Handling call
0709 12:25:28.881097 (+   388us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:28.881603 (+   506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.881646 (+    43us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:30.111628 (+1229982us) spinlock_profiling.cc:243] Waited 2.18 ms on lock 0x7b2c00033668. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:25:30.112132 (+   504us) log.cc:844] Serialized 52 byte log entry
0709 12:25:30.151276 (+ 39144us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:30.151322 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.151402 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.152896 (+  1494us) raft_consensus.cc:1685] finished
0709 12:25:30.152920 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.153127 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":995,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":2833,"spinlock_wait_cycles":5024640,"thread_start_us":32473,"threads_started":1,"wal-append.queue_time_us":32793}
I20260709 12:25:30.161634 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:30.162531 12703 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:30.164232 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.165504 12634 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:30.166349 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1028) took 1586 ms. Trace:
I20260709 12:25:30.167613 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.169234 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:30.170754 12522 leader_election.cc:400] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13.
I20260709 12:25:30.171741 12522 leader_election.cc:403] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.174695 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.154260 16762 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:30.167742 16519 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:30.176867 12626 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:30.167079 12625 rpcz_store.cc:276] 0709 12:25:28.580106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.713857 (+133751us) service_pool.cc:224] Handling call
0709 12:25:28.714386 (+   529us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:28.733283 (+ 18897us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:28.768408 (+ 35125us) log.cc:844] Serialized 14 byte log entry
0709 12:25:29.346638 (+578230us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b180049bbe0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919cc2a6 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1
0709 12:25:29.348082 (+  1444us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b180049bbe0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:29.385089 (+ 37007us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b180049bbe0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:25:29.496346 (+111257us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:30.098656 (+602310us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b2c00000238. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:25:30.099141 (+   485us) log.cc:844] Serialized 52 byte log entry
0709 12:25:30.110844 (+ 11703us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:30.157084 (+ 46240us) log.cc:844] Serialized 14 byte log entry
0709 12:25:30.166077 (+  8993us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.166144 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.166183 (+    39us) raft_consensus.cc:1685] finished
0709 12:25:30.166196 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.166301 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":96924,"prepare.queue_time_us":74739,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":72,"raft.queue_time_us":81285,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":20976,"spinlock_wait_cycles":63570944,"thread_start_us":125702,"threads_started":2,"wal-append.queue_time_us":696657}
I20260709 12:25:30.193833 16519 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.146485 16494 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.203073 12700 raft_consensus.cc:1240] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:30.174611 16755 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:30.189661 16757 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.192534 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1041) took 1625 ms. Trace:
I20260709 12:25:30.192236 16532 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.212554 16494 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.209172 16593 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.215560 16504 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.209051 16540 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:30.217882 16540 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:30.165555 16506 consensus_queue.cc:1059] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:30.218746 16540 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.219620 16506 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:30.219954 16506 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:30.221132 16506 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.222295 16506 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.222128 16757 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.197010 16620 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.224895 16620 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.231290 16576 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:30.232142 16786 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.054s	user 0.003s	sys 0.000s
W20260709 12:25:30.232671 16747 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.932s	user 0.004s	sys 0.000s
I20260709 12:25:30.238344 16593 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.240687 16593 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.202419 16750 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.200565 16745 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:30.242553 16745 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.244637 16745 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.196738 16741 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.245447 16741 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.246496 16259 consensus_queue.cc:1048] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:30.247515 16741 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.247972 16620 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.248616 16620 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:30.198748 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:30.162151 16486 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:30.161598 16707 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:30.203155 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.169508 16735 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.207204 12556 rpcz_store.cc:276] 0709 12:25:28.566928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.568415 (+  1487us) service_pool.cc:224] Handling call
0709 12:25:28.568735 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.569068 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.569101 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.569564 (+   463us) log.cc:844] Serialized 26 byte log entry
0709 12:25:28.888454 (+318890us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:28.888531 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:28.888633 (+   102us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:29.833008 (+944375us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:30.192254 (+359246us) raft_consensus.cc:1685] finished
0709 12:25:30.192281 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.192480 (+   199us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":170,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":71,"spinlock_wait_cycles":27666816,"thread_start_us":318551,"threads_started":1,"wal-append.queue_time_us":468278}
I20260709 12:25:30.177898 16777 raft_consensus.cc:3055] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:30.597798 16777 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:30.598778 16777 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.599982 16777 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.165367 16595 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:30.349961 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:30.352936 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.735623 16595 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:30.736558 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.737090 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:30.467070 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 268364us
I20260709 12:25:30.737980 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:30.185813 16667 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:30.476313 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.741865 12632 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:30.477312 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.481591 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.743881 12634 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:30.224421 16757 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.826514 16768 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.492662 16783 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:30.516911 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 313201us
I20260709 12:25:30.532909 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.827922 12628 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:30.552627 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.828904 12627 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.570757 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:30.571907 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.590706 16707 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.605926 16735 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.608150 16777 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.614952 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2357) took 2031 ms. Trace:
I20260709 12:25:29.360375 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:30.683881 12671 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.038s	sys 0.077s
W20260709 12:25:30.834007 12671 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.039s	sys 0.078s
W20260709 12:25:30.834322 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 683984us
I20260709 12:25:30.713335 16745 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.836500 16735 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.836390 16745 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.837123 16777 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.838475 16745 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.755982 16595 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.839342 16777 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:30.757052 16561 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.011s	sys 0.023s
I20260709 12:25:30.774716 16750 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13.
I20260709 12:25:30.779721 16486 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.839890 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:30.840420 16486 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.780961 16569 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:30.842950 16569 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:30.790007 16506 consensus_meta.cc:287] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.567s	user 0.011s	sys 0.000s
W20260709 12:25:30.811591 16708 consensus_meta.cc:287] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.695s	user 0.011s	sys 0.000s
I20260709 12:25:30.832933 12626 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
W20260709 12:25:30.840008 16561 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.011s	sys 0.023s
I20260709 12:25:30.840591 13235 raft_consensus.cc:2376] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8. Re-sending same reply.
I20260709 12:25:30.848779 16707 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.846807 16569 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.849643 16708 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.833760 12552 rpcz_store.cc:276] 0709 12:25:28.583090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.648719 (+ 65629us) service_pool.cc:224] Handling call
0709 12:25:28.649018 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:28.649333 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:28.649358 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:28.650265 (+   907us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.280444 (+630179us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:29.280499 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.280587 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.232092 (+951505us) spinlock_profiling.cc:243] Waited 5.64 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:30.614623 (+382531us) raft_consensus.cc:1685] finished
0709 12:25:30.614655 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.614885 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3701,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":46762,"spinlock_wait_cycles":12972288,"thread_start_us":629778,"threads_started":1,"wal-append.queue_time_us":650188}
I20260709 12:25:30.855450 16486 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.857666 16486 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.855520 16708 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.858259 16486 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.856876 12629 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:30.862321 16486 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.864979 12627 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:30.865540 16486 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:30.855767 12453 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:30.884802 16734 consensus_meta.cc:287] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.759s	user 0.008s	sys 0.005s
W20260709 12:25:30.905689 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 653522us
I20260709 12:25:30.914391 16639 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.914948 16639 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.916970 16639 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.918883 16446 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:30.919620 16446 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:30.931161 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 95037.5us
I20260709 12:25:30.935555 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:30.936303 16735 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.936695 13227 raft_consensus.cc:2393] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:30.938879 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.939524 12708 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.940514 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.937009 16735 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.941706 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.943425 16735 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.939631 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.944541 12706 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:30.945770 16599 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:30.946357 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.946432 16599 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.947781 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.949265 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.950345 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.952015 12671 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:30.952852 16531 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:30.953380 16531 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:30.954303 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:30.941807 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:30.954373 16531 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.949293 12706 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:30.957396 16599 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.954293 16664 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:30.969988 16664 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:30.970046 12453 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 6 to 8, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 8 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:30.972615 16664 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:30.971887 12453 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 5 to 9, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 9 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:30.953256 12633 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.016s	sys 0.019s
I20260709 12:25:30.933139 16741 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:30.973740 12633 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.018s	sys 0.019s
I20260709 12:25:30.974037 16741 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:30.974493 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2511) took 1455 ms. Trace:
I20260709 12:25:30.974867 12633 rpcz_store.cc:276] 0709 12:25:29.518757 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.518879 (+   122us) service_pool.cc:224] Handling call
0709 12:25:29.519197 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.520320 (+  1123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.520350 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.520792 (+   442us) log.cc:844] Serialized 26 byte log entry
0709 12:25:30.974147 (+1453355us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:30.974189 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:30.974256 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.974293 (+    37us) raft_consensus.cc:1685] finished
0709 12:25:30.974304 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.974423 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":762,"raft.queue_time_us":1444,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3084,"thread_start_us":1391407,"threads_started":1,"wal-append.queue_time_us":295320,"wal-append.run_cpu_time_us":2278,"wal-append.run_wall_time_us":1017059}
I20260709 12:25:30.961516 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:30.976344 16741 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:30.978264 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:30.979858 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:31.013768 12633 raft_consensus.cc:3060] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.986071 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:31.014986 12707 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:30.981832 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:30.987424 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.016577 12628 raft_consensus.cc:2410] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:31.026782 12629 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:31.028232 12627 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260709 12:25:31.028317 12708 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:31.028710 12627 pending_rounds.cc:85] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 7
I20260709 12:25:31.028945 12627 pending_rounds.cc:107] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260709 12:25:31.029183 12627 raft_consensus.cc:2889] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:31.032083 12629 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:31.032197 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.029492 13199 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:31.034215 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.035456 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.051469 12706 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 14: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:31.034032 16640 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:31.096012 16640 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:31.023660 16708 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:31.030272 16479 raft_consensus.cc:2764] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:25:31.057723 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.092839 16517 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.099557 12707 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:25:31.122442 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.096611 16640 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:31.103592 16446 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.138393 12598 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:31.120605 16293 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.100593 16738 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
W20260709 12:25:31.157608 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58992.5us
W20260709 12:25:31.170647 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.103992 16708 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.176869 16293 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.192070 16708 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.182116 16620 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:31.176421 15839 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.193181 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.192965 16620 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.193807 15839 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.195585 16620 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.195863 15839 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.173887 16446 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:31.182508 16776 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:31.122269 16517 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.141920 16735 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:25:31.196553 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.197284 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.198820 15839 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.199481 15839 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.203043 12633 raft_consensus.cc:2468] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:31.235466 15839 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:31.204985 16796 log.cc:927] Time spent T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 12:25:31.236577 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.239679 12700 raft_consensus.cc:2393] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:25:31.244256 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 214846us
I20260709 12:25:31.244364 16812 raft_consensus.cc:2804] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:31.251322 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.255903 16825 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.256772 16825 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.259752 16825 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.218904 16545 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.219169 16661 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:31.263926 16545 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.264349 16661 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.266163 16545 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.266387 16661 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:31.193250 16293 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.229117 16735 consensus_queue.cc:1243] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer a2a8d71f644447218c1afc3e5f7716cd log is divergent from this leader: its last log entry 10.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 12:25:31.228437 16776 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:31.196805 16446 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.281375 16640 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.292548 16812 raft_consensus.cc:697] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:31.315933 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.292594 16517 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:31.317762 16446 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:25:31.317981 13227 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:31.319418 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.321112 13227 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:31.322697 13227 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:31.327490 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.328080 13235 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:31.326413 16585 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:31.329344 16585 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:31.330220 16585 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.334785 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:31.337997 16659 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:31.344833 16532 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:31.346484 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.335397 16808 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.101s	user 0.001s	sys 0.001s
I20260709 12:25:31.376580 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:31.377502 13235 raft_consensus.cc:606] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:31.377970 13235 raft_consensus.cc:614] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:31.373669 16659 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.369084 16652 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:31.371904 16585 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:31.390003 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 64291.5us
I20260709 12:25:31.337466 16690 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:31.391798 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.392460 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.336835 16661 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:25:31.314455 16776 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.388751 16652 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.387066 16829 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:31.398658 16517 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.389917 16659 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.407980 16652 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.411602 16838 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.413736 16829 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.425068 16517 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:31.471879 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08001bdd00 after lost signal to thread 11395
I20260709 12:25:31.411962 16661 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:31.474071 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 94076.4us
I20260709 12:25:31.392796 16812 consensus_queue.cc:237] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:31.475070 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6d00 after lost signal to thread 12491
W20260709 12:25:31.476083 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08000eb160 after lost signal to thread 12583
W20260709 12:25:31.476330 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08000f6de0 after lost signal to thread 12584
W20260709 12:25:31.477119 12655 debug-util.cc:398] Leaking SignalData structure 0x7b0800355f00 after lost signal to thread 12658
W20260709 12:25:31.477380 12655 debug-util.cc:398] Leaking SignalData structure 0x7b080037aac0 after lost signal to thread 12659
I20260709 12:25:31.472883 16799 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:31.496608 16517 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:31.482244 16640 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:31.506352 16846 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.479651 16661 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.507709 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:31.508314 13234 raft_consensus.cc:606] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:31.508594 13234 raft_consensus.cc:614] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:31.494654 16799 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.509537 16846 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.479110 16838 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.516691 16838 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.509135 16659 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:31.526082 16799 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.523851 16652 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.529887 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:31.530663 13234 raft_consensus.cc:606] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:31.531020 13234 raft_consensus.cc:614] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:31.531808 16618 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:31.547390 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:31.547982 13234 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:31.548311 13234 raft_consensus.cc:614] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:31.560189 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.564493 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.563891 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.565425 13227 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:31.569626 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.566329 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.569589 16517 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.578604 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:31.579356 13232 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.572885 16517 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.591502 16517 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.592724 16661 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.596500 13232 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:25:31.591459 16652 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.614434 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.620281 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.622052 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:31.622154 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 199380us
I20260709 12:25:31.631012 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.631206 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.631850 13235 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:31.632217 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.633111 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.633765 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:31.633791 13228 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:31.635685 16838 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:31.636215 16838 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.636610 16838 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.641153 13227 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 3.
I20260709 12:25:31.648187 16838 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.651098 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:31.652576 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:31.652987 16855 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.654534 16856 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:31.655439 16856 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:31.655891 16856 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.660411 16838 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:31.666033 16856 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.668113 16856 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:31.697113 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 69417.7us
I20260709 12:25:31.713176 12625 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1042) took 1237 ms. Trace:
I20260709 12:25:31.714802 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:31.706151 16531 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:31.716596 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.717128 16531 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.713912 12625 rpcz_store.cc:276] 0709 12:25:30.475134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.482330 (+  7196us) service_pool.cc:224] Handling call
0709 12:25:30.482755 (+   425us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:30.842423 (+359668us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:30.842453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:30.843022 (+   569us) log.cc:844] Serialized 52 byte log entry
0709 12:25:30.979124 (+136102us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:31.034532 (+ 55408us) log.cc:844] Serialized 14 byte log entry
0709 12:25:31.036148 (+  1616us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:31.549485 (+513337us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b1800244720. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919cc2a6 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419
0709 12:25:31.711993 (+162508us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b5400455454. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:31.712103 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:31.712222 (+   119us) raft_consensus.cc:1685] finished
0709 12:25:31.712245 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:31.712870 (+   625us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2537,"prepare.queue_time_us":54627,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":1857,"raft.queue_time_us":15375,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":3123,"spinlock_wait_cycles":851468416,"thread_start_us":135689,"threads_started":1,"wal-append.queue_time_us":250529}
I20260709 12:25:31.730736 16531 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.730782 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.732200 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 930) took 1168 ms. Trace:
I20260709 12:25:31.732654 13230 rpcz_store.cc:276] 0709 12:25:30.563588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:31.730090 (+1166502us) service_pool.cc:224] Handling call
0709 12:25:31.732058 (+  1968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:31.724689 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.737761 12699 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:31.774941 16487 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:31.775876 16487 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:31.777324 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 59919.2us
I20260709 12:25:31.777810 16487 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:31.781046 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:31.782661 12453 catalog_manager.cc:5697] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 3 to 7, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 7 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:31.782665 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:31.787528 16209 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:31.782647 16402 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:31.789671 16402 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:31.791651 16402 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.803509 16755 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.804651 16755 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:31.807979 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba180 after lost signal to thread 12732
W20260709 12:25:31.808496 12655 debug-util.cc:398] Leaking SignalData structure 0x7b080038a0c0 after lost signal to thread 12733
W20260709 12:25:31.822758 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.825286 16755 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:31.849746 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:31.873257 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 90848.5us
I20260709 12:25:31.875993 16337 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.877068 16337 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.880138 16337 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.881320 16293 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.882252 16293 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.882745 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.883692 12705 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:31.903211 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:31.904232 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:31.904284 13234 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:31.911269 16270 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.911978 16593 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.912091 16270 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.912811 16593 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.898885 16293 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.922224 16618 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.922953 16618 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.923635 16829 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.924461 16540 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.925544 16783 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:31.926388 16783 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.927976 16494 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:31.928759 16494 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.925240 16540 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.931367 16506 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.931516 16792 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.932312 16599 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.933012 16756 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.933095 16757 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.933974 16805 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:31.934309 16270 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.934785 12628 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:25:31.936045 12626 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:31.936596 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.938283 16755 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.939096 16858 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:31.939816 15839 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.939756 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:31.935833 16750 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:31.947157 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:31.947664 16494 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.948328 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.940349 16545 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.974177 16478 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.978286 16478 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.978753 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.979043 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.947686 16620 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:31.980784 16478 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.980849 16620 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.976933 16545 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.984340 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:31.956786 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:31.974113 12631 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.974413 16599 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.988166 16506 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.989662 16599 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.974869 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.990411 16506 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.990792 12626 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:31.991467 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.991662 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.992129 12625 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:31.992830 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:31.975646 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:31.993886 16532 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.994627 16532 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.995213 16734 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:31.995991 16734 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:31.997035 16532 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.976135 16531 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:31.961316 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 1.61125e+06us
I20260709 12:25:31.929807 16618 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:31.985994 16545 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:31.975328 16756 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.986919 12628 raft_consensus.cc:606] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:31.998288 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:31.999778 16757 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.001673 16755 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.003978 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:32.005033 16792 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.005990 16846 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:32.006518 12453 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 6 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 7 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.010185 12626 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:32.010824 16734 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.010968 16708 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:32.013121 16540 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.013610 15839 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:31.957377 16293 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.014441 16858 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.001295 16593 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.029915 12631 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:31.930559 16487 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.053854 12632 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.014765 16783 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.061219 13234 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:32.061829 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.062898 15839 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.066272 12631 pending_rounds.cc:85] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 5
I20260709 12:25:32.066875 16756 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.068396 12552 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:32.068553 12655 debug-util.cc:398] Leaking SignalData structure 0x7b0800365f20 after lost signal to thread 13259
I20260709 12:25:32.069126 16746 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:32.070192 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 66683.7us
I20260709 12:25:32.070925 16652 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.071367 16531 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.071842 12627 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:32.074517 12453 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 8 to 9, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 9 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:32.070919 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 1.33281e+06us
I20260709 12:25:32.078121 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.079170 16755 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.081070 16792 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.059194 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:32.087128 12655 debug-util.cc:398] Leaking SignalData structure 0x7b0800374a20 after lost signal to thread 13260
I20260709 12:25:32.082957 12631 pending_rounds.cc:107] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:32.092013 12626 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:25:32.093971 12631 raft_consensus.cc:2889] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.065227 16858 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.060883 16620 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.102780 13198 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.116874 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.117206 15839 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:32.101099 16618 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:32.102568 16755 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:32.104692 16293 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.142403 12632 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:32.128592 16792 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.152146 12627 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:25:32.154595 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08002d3ac0 after lost signal to thread 16656
W20260709 12:25:32.155324 12655 debug-util.cc:398] Leaking SignalData structure 0x7b0800411e80 after lost signal to thread 16712
W20260709 12:25:32.155629 12655 debug-util.cc:398] Leaking SignalData structure 0x7b080032ade0 after lost signal to thread 16714
I20260709 12:25:32.154733 12453 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:32.155889 12655 debug-util.cc:398] Leaking SignalData structure 0x7b08003a3300 after lost signal to thread 16716
W20260709 12:25:32.156412 12655 debug-util.cc:398] Leaking SignalData structure 0x7b080037d940 after lost signal to thread 16728
I20260709 12:25:32.156087 16618 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.129987 16750 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:32.158084 16864 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:25:32.157821 16750 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.159543 16865 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:32.160439 16750 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.160326 16865 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.162910 16865 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:32.163084 12456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 345) took 30913 ms (client timeout 15000 ms). Trace:
W20260709 12:25:32.163892 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45232.4us
I20260709 12:25:32.165033 16757 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.165861 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:32.167126 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 124701us
I20260709 12:25:32.176184 16487 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:32.176468 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:32.177438 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 118394us
I20260709 12:25:32.178234 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.179526 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.179796 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:32.180241 12554 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:32.180691 16824 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.181495 16824 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.156983 12453 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 3 to 4, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 4 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.140594 16858 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.163134 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:32.144888 16708 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.187714 12626 raft_consensus.cc:2410] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:32.182156 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.191175 12555 raft_consensus.cc:2410] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:32.143657 16756 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.195675 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.207315 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:32.207929 13234 raft_consensus.cc:606] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.208268 13234 raft_consensus.cc:614] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:32.209690 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.189951 16750 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.217921 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.218317 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:32.218822 12559 raft_consensus.cc:2410] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:32.219513 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.219628 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.220368 12633 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:32.220899 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:32.192636 16708 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:32.198763 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.221359 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.221784 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.229835 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:32.241242 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 78312.9us
W20260709 12:25:32.243251 16871 log.cc:927] Time spent T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:32.226480 16750 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.244228 13230 raft_consensus.cc:2368] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10.
I20260709 12:25:32.224902 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.223744 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.223956 16856 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:32.227525 16866 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.199487 16755 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:32.264344 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.237224 16865 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:32.222774 16618 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.315629 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.223573 16593 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:32.338388 15839 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.226039 16563 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:25:32.338879 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 117204us
I20260709 12:25:32.246140 16757 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:32.246248 16506 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:32.339809 16757 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.339982 16506 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.342315 16506 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.245877 16531 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:32.341907 12453 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 6 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 7 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.343250 16531 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.226836 16634 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.091s
I20260709 12:25:32.344024 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.344419 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.330837 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.326082 16599 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:32.339169 16563 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:32.352067 16531 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.352689 16563 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:32.354702 16531 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:32.355430 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:32.339274 16750 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.229923 16756 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.357609 12556 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:32.357860 12633 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:32.337258 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.359506 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.358728 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.239465 16792 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.368741 12633 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:32.365787 16866 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.371555 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.371289 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.375525 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.372786 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.372956 12626 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 3.
W20260709 12:25:32.163666 12456 rpcz_store.cc:269] 0709 12:25:01.249507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.249776 (+   269us) service_pool.cc:224] Handling call
0709 12:25:32.162802 (+30913026us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:22.895677 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:22.972439 (+ 76762us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:22.972513 (+    74us) write_op.cc:435] Acquired schema lock
0709 12:25:22.972532 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:22.973611 (+  1079us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:22.973709 (+    98us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:22.973747 (+    38us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:25:22.974529 (+   782us) tablet.cc:701] Row locks acquired
0709 12:25:22.974648 (+   119us) write_op.cc:260] PREPARE: finished
0709 12:25:22.974860 (+   212us) write_op.cc:270] Start()
0709 12:25:22.975031 (+   171us) write_op.cc:276] Timestamp: P: 1783599922974772 usec, L: 0
0709 12:25:22.975050 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:22.975838 (+   788us) log.cc:844] Serialized 2446 byte log entry
0709 12:25:23.939922 (+964084us) op_driver.cc:464] REPLICATION: finished
0709 12:25:24.199967 (+260045us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e919e10ac 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e98521ef0
0709 12:25:25.047324 (+847357us) write_op.cc:301] APPLY: starting
0709 12:25:25.047416 (+    92us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:25.047639 (+   223us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:25.047682 (+    43us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:25.048619 (+   937us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:25.048815 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:25:25.048869 (+    54us) write_op.cc:312] APPLY: finished
0709 12:25:25.049535 (+   666us) log.cc:844] Serialized 53 byte log entry
0709 12:25:25.120092 (+ 70557us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:25.120203 (+   111us) write_op.cc:454] Released schema lock
0709 12:25:25.120250 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:25.153068 (+ 32818us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:25.155898 (+  2830us) write_op.cc:454] Released schema lock
0709 12:25:25.397068 (+241170us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b54000361d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94ae832a 00007f0e94a6df14 00007f0e94a6dec3 00007f0e94a6de38 00007f0e94a6ddf3 00007f0e94a6d0dc 00007f0e94a96e16 00007f0e94a7ecbb 00007f0e94a6939d 00007f0e94a6cd75
Metrics: {"mutex_wait_us":717612,"reported_tablets":45,"child_traces":[["op",{"apply.queue_time_us":1041596,"apply.run_cpu_time_us":19732,"apply.run_wall_time_us":73410,"num_ops":6,"prepare.queue_time_us":234793,"prepare.run_cpu_time_us":38951,"prepare.run_wall_time_us":306693,"raft.queue_time_us":166788,"raft.run_cpu_time_us":25727,"raft.run_wall_time_us":1494353,"replication_time_us":934232,"spinlock_wait_cycles":5643392,"thread_start_us":1635504,"threads_started":5,"wal-append.queue_time_us":360944,"wal-append.run_cpu_time_us":28948,"wal-append.run_wall_time_us":2725234}]]}
I20260709 12:25:32.378165 13228 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:32.375133 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.376308 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.245978 16858 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.385128 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.375905 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.373567 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.373469 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:32.388190 12554 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:32.398538 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:32.399245 12633 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.380476 16563 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.400748 12627 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:32.401662 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.401769 16563 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:32.402276 12627 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:32.403286 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.403541 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:32.403713 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 213786us
I20260709 12:25:32.404305 12627 raft_consensus.cc:2410] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:32.377298 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.388895 13199 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.361893 16487 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:32.406947 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 86023us
I20260709 12:25:32.364809 16856 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:32.376739 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.412173 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:32.412333 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.413880 13230 raft_consensus.cc:2393] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 4: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:32.370339 12453 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 5 to 6, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.373286 16866 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.417093 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.415385 12557 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:32.408736 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:32.423352 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:32.424120 12625 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:32.373217 16865 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:32.407310 16756 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:32.437228 12634 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:32.442586 12626 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:25:32.442967 12626 pending_rounds.cc:85] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 5
I20260709 12:25:32.443190 12626 pending_rounds.cc:107] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:32.443415 12626 raft_consensus.cc:2889] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:32.436548 16337 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:32.436796 16487 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:32.438861 16652 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:32.446607 16866 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:32.445894 16842 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:32.458225 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:32.462282 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.445890 16877 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:32.473250 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.471800 12559 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:32.451236 16293 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:32.518129 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 133195us
I20260709 12:25:32.522042 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:32.523320 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:32.523598 12626 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:32.524210 16652 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:32.526657 16652 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:32.534787 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50987.3us
I20260709 12:25:32.532640 12453 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 2 to 6, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 6 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:32.669605 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:32.937428 12634 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:32.931887 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.755522 12633 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:32.639982 12704 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:25:32.941778 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 413497us
I20260709 12:25:32.871977 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:32.542416 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 135283us
I20260709 12:25:32.714665 12522 leader_election.cc:400] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10.
W20260709 12:25:33.007580 12628 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.031s	sys 0.035s
I20260709 12:25:33.008141 12522 leader_election.cc:403] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:32.578102 16872 log.cc:927] Time spent T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.245s	user 0.001s	sys 0.001s
W20260709 12:25:33.008248 12628 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.031s	sys 0.035s
I20260709 12:25:32.916494 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:32.516738 16877 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:32.923842 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:32.936673 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:32.942683 16883 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.188s	user 0.001s	sys 0.000s
I20260709 12:25:33.010948 12631 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2539) took 1070 ms. Trace:
I20260709 12:25:33.029106 12557 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
W20260709 12:25:32.546258 16882 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:25:32.547219 16869 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260709 12:25:32.765846 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:32.642108 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:32.670182 16858 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.035741 12702 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
W20260709 12:25:33.047691 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.026288 12703 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:32.640635 16479 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:32.819686 16337 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:33.023990 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 541346us
I20260709 12:25:32.924538 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:32.580533 16792 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.033496 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.024271 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:32.952256 16757 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:32.582818 16755 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.028429 12631 rpcz_store.cc:276] 0709 12:25:31.940184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.065496 (+125312us) service_pool.cc:224] Handling call
0709 12:25:32.065933 (+   437us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:25:32.205499 (+139566us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.205540 (+    41us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:25:32.215843 (+ 10303us) log.cc:844] Serialized 78 byte log entry
0709 12:25:32.408575 (+192732us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:32.408617 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:32.408680 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.010642 (+601962us) raft_consensus.cc:1685] finished
0709 12:25:33.010672 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.010870 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13906,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":6901,"thread_start_us":108321,"threads_started":1,"wal-append.queue_time_us":446769}
I20260709 12:25:33.056663 16479 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.004878 16865 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.037873 12634 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:33.058939 16880 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.571s	user 0.005s	sys 0.000s
I20260709 12:25:33.061647 12699 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:33.063745 12597 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.064859 16337 raft_consensus.cc:2764] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:33.065726 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:33.068598 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:32.931972 16885 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260709 12:25:33.070735 16885 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:33.071296 16885 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.071836 16479 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:32.546753 16856 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.072881 16479 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:33.038959 12707 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:33.033536 16620 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.085057 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:33.069276 16708 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.822s	user 0.003s	sys 0.004s
W20260709 12:25:33.087900 12625 consensus_meta.cc:287] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.654s	user 0.007s	sys 0.002s
I20260709 12:25:33.088274 12625 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
W20260709 12:25:33.090445 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.091156 16337 raft_consensus.cc:2764] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:25:33.095103 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.058449 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.092142 12552 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:33.087268 16708 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.098421 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.098933 13232 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:33.099335 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.099771 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:32.841969 16487 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.035746 16652 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:33.103253 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.083354 16885 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:33.087785 16858 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:33.087962 16620 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.107607 16569 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:33.121433 12557 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
W20260709 12:25:33.107585 16817 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.023s	sys 0.057s
I20260709 12:25:33.122530 16885 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.131845 16783 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:25:33.135682 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.119087 16620 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.136533 12557 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 3.
I20260709 12:25:33.138837 12629 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:33.135644 16885 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.139761 16881 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:33.140328 16881 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:33.141947 16885 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.141532 16881 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.120589 16792 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:33.136864 16817 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.024s	sys 0.059s
W20260709 12:25:33.162596 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 111566us
I20260709 12:25:33.143579 16652 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.148571 16569 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:33.174691 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:33.175537 12557 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.169800 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.125030 16877 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 11.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.190815 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.189061 12701 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:33.198366 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:33.199151 12554 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.201766 16865 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.207115 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.207741 12559 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:33.214489 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.206557 16792 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:33.217999 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:33.224727 12559 raft_consensus.cc:2410] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:33.231943 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.232825 12556 raft_consensus.cc:2410] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:33.222144 16865 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.243373 16652 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.247659 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.215513 16569 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.294811 16856 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.295555 16856 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.299121 16856 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:33.307826 16866 consensus_meta.cc:287] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.815s	user 0.006s	sys 0.006s
I20260709 12:25:33.323369 16866 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.559743 16901 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:33.560456 16901 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:33.561859 12674 connection.cc:256] RPC call timeout handler was delayed by -1.0983490120001989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1728s for a response
W20260709 12:25:33.562328 12674 connection.cc:256] RPC call timeout handler was delayed by -1.0433209470002112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
I20260709 12:25:33.562701 16901 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:33.563267 16901 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:33.563726 16901 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.565687 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.567103 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.567778 12707 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:33.569802 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.570586 12707 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:33.571540 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.575284 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.576294 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.576833 12707 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:33.578140 12707 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:33.571846 16858 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10.
I20260709 12:25:33.570586 16901 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.598757 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.599463 12708 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
W20260709 12:25:33.642427 12599 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.012s	sys 0.005s
W20260709 12:25:33.642840 12599 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.012s	sys 0.005s
I20260709 12:25:33.646970 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:33.648001 12673 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.005s	sys 0.007s
W20260709 12:25:33.648379 12673 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.005s	sys 0.007s
I20260709 12:25:33.651990 12707 raft_consensus.cc:1275] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:33.662132 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.662792 12702 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:33.671160 12600 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.006s	sys 0.011s
W20260709 12:25:33.671583 12600 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.006s	sys 0.011s
W20260709 12:25:33.671872 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 638703us
W20260709 12:25:33.672362 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:33.672778 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.673866 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.674448 12630 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:33.675290 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.676038 12630 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:33.676725 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.677759 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.678941 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.677258 12630 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:33.682212 16812 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:33.682744 16812 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.684823 16812 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.685842 16812 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:33.687050 12552 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.003s	sys 0.011s
W20260709 12:25:33.687403 12552 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.003s	sys 0.011s
I20260709 12:25:33.687477 16812 consensus_queue.cc:1048] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:33.688829 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.691424 12630 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:33.694571 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.694842 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.695533 12634 raft_consensus.cc:2410] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:25:33.697118 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:33.697935 12633 raft_consensus.cc:2410] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 5.
W20260709 12:25:33.698931 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 464485us
I20260709 12:25:33.700316 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:33.704144 16858 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:33.705296 16858 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:33.705647 16858 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:33.705978 16858 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.709868 16897 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:33.710412 16897 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:33.711325 16897 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.712787 16897 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:33.715116 12674 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.539s (SENT)
I20260709 12:25:33.727849 16858 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:33.730381 12674 leader_election.cc:336] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.695s (SENT)
I20260709 12:25:33.730870 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:33.731511 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.731737 16877 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:33.733251 16858 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.734472 16918 raft_consensus.cc:993] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:33.734936 16918 raft_consensus.cc:1081] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:33.736097 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.737185 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.737179 16918 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:33.737962 16918 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.738318 16918 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:33.753837 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.749027 16918 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.762652 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1071) took 1533 ms. Trace:
I20260709 12:25:33.763302 12632 rpcz_store.cc:276] 0709 12:25:32.229678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.551407 (+321729us) service_pool.cc:224] Handling call
0709 12:25:32.551795 (+   388us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:32.552275 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:32.552314 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:32.938293 (+385979us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.179665 (+241372us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:33.179705 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.179771 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.762328 (+582557us) raft_consensus.cc:1685] finished
0709 12:25:33.762357 (+    29us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.762554 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3671,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":240868,"threads_started":1,"wal-append.queue_time_us":379616}
I20260709 12:25:33.764070 16918 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.766419 16918 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.766904 16918 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.767388 16918 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.769683 16337 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:33.773840 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52021.6us
I20260709 12:25:33.775939 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.777585 12706 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:33.778831 16337 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:33.779333 16337 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.779564 12598 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.779693 16337 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:33.781324 12628 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.024s	sys 0.034s
W20260709 12:25:33.781708 12628 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.024s	sys 0.034s
W20260709 12:25:33.786919 12671 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.000s	sys 0.016s
W20260709 12:25:33.787246 12671 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.000s	sys 0.016s
W20260709 12:25:33.787508 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 751338us
I20260709 12:25:33.790171 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.791046 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.791185 16918 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.791857 12523 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.794057 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:33.794314 13201 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.014s
W20260709 12:25:33.794656 13201 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.018s	sys 0.014s
I20260709 12:25:33.794993 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.795053 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.796427 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.797437 16866 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:33.797722 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.797828 16866 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:33.798365 16866 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:33.798436 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1073) took 1441 ms. Trace:
I20260709 12:25:33.798926 12627 rpcz_store.cc:276] 0709 12:25:32.356905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.950476 (+593571us) service_pool.cc:224] Handling call
0709 12:25:32.950934 (+   458us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:33.019555 (+ 68621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:33.019588 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:33.040695 (+ 21107us) log.cc:844] Serialized 26 byte log entry
0709 12:25:33.218566 (+177871us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:33.218624 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.218700 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:33.798243 (+579543us) raft_consensus.cc:1685] finished
0709 12:25:33.798261 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.798385 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":18046,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":7381,"thread_start_us":147285,"threads_started":1,"wal-append.queue_time_us":271060}
I20260709 12:25:33.792379 16858 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:33.792809 16897 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:33.794916 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 680860us
I20260709 12:25:33.803045 16921 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:33.804662 16921 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:33.804992 16921 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.805341 16921 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.801856 16858 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.809913 16858 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.801870 16897 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.811604 16897 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.813097 16877 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:33.813681 16877 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.814015 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:33.816123 16877 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:33.817297 16858 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.818305 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2542) took 1762 ms. Trace:
W20260709 12:25:33.817308 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.818689 12629 rpcz_store.cc:276] 0709 12:25:32.056352 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.413120 (+356768us) service_pool.cc:224] Handling call
0709 12:25:32.428233 (+ 15113us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.139456 (+711223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.818098 (+678642us) spinlock_profiling.cc:243] Waited 653 ms on lock 0x7b5400344ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:33.818247 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1501572480}
I20260709 12:25:33.821741 16877 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.822266 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.789214 16337 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.824313 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.824687 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.825049 16923 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:33.825529 16923 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.824313 16877 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.828949 12701 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:33.829730 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.826061 16923 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:33.348286 16593 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.001s	sys 0.010s
W20260709 12:25:33.833691 16593 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.005s	sys 0.011s
W20260709 12:25:33.835530 12600 leader_election.cc:336] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.560s (SENT)
I20260709 12:25:33.836030 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:33.836228 16337 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.837322 16337 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.839288 16877 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:33.837239 12600 leader_election.cc:336] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.584s (SENT)
I20260709 12:25:33.839903 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:33.841310 12600 leader_election.cc:336] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.633s (SENT)
I20260709 12:25:33.842334 16897 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.844115 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1064) took 1856 ms. Trace:
I20260709 12:25:33.844589 16897 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:33.846091 12554 consensus_meta.cc:287] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.000s
I20260709 12:25:33.846436 12554 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:33.827740 12706 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
W20260709 12:25:33.847534 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51195.5us
I20260709 12:25:33.832908 16866 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.844468 12628 rpcz_store.cc:276] 0709 12:25:31.988081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.068922 (+ 80841us) service_pool.cc:224] Handling call
0709 12:25:32.069243 (+   321us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:32.078429 (+  9186us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:33.024572 (+946143us) log.cc:844] Serialized 14 byte log entry
0709 12:25:33.843794 (+819222us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:33.843844 (+    50us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:33.843892 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.843952 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:33.844063 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18846,"prepare.queue_time_us":138876,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":54916,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":87,"thread_start_us":1693638,"threads_started":3,"wal-append.queue_time_us":361683}
I20260709 12:25:33.845278 16897 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:33.856895 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:33.857362 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 76970us
I20260709 12:25:33.858438 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.858928 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.859555 12706 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:33.853675 16337 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:33.861760 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.861954 16858 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.862519 16858 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.863791 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.864369 12706 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:33.865691 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.867028 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:33.868355 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:33.868868 12706 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.870456 16918 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.873986 16337 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:33.874928 16337 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.875057 16866 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.875314 16337 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:33.876102 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:33.876940 16620 consensus_meta.cc:287] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.719s	user 0.009s	sys 0.005s
I20260709 12:25:33.877609 16817 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.878132 16817 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.880223 16817 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:33.880625 12674 leader_election.cc:336] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.002s (SENT)
I20260709 12:25:33.877372 16620 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.881100 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:33.882432 16817 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.884780 16620 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.886833 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:33.889544 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:33.922844 12556 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:33.890214 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:33.923834 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50436.8us
I20260709 12:25:33.924274 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:33.890300 16921 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.926127 16924 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:33.887140 16923 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.894506 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:33.894575 12555 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:33.895738 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.896531 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.897426 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.898069 16866 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:33.928174 16866 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:33.929013 12551 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:33.893101 16337 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:33.903461 12706 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:33.904752 16919 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:33.910092 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:33.910691 12628 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:33.932607 12704 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:33.915040 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:33.918097 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:33.901948 12522 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.003s	sys 0.010s
W20260709 12:25:33.922372 12600 leader_election.cc:336] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.745s (SENT)
I20260709 12:25:33.929442 12705 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:33.901788 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.930136 12555 pending_rounds.cc:85] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 7
I20260709 12:25:33.929952 12553 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:33.908375 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:33.933559 12522 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.004s	sys 0.010s
W20260709 12:25:33.983577 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 68631.2us
I20260709 12:25:33.985087 12555 pending_rounds.cc:107] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 6.8
W20260709 12:25:33.985035 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 83646.9us
I20260709 12:25:33.985677 12555 raft_consensus.cc:2889] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:33.984455 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 1.44875e+06us
I20260709 12:25:33.933693 12600 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:34.021792 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.931725 16921 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:33.933825 12558 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:34.048573 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.049719 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.053723 12558 raft_consensus.cc:2368] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13.
I20260709 12:25:34.054742 16337 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:34.055194 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.055898 12553 raft_consensus.cc:2368] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13.
I20260709 12:25:34.056651 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:33.983928 16479 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.057734 16479 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.057929 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:34.058179 16479 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.058825 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:34.057731 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.053596 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:34.059964 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:34.061381 12554 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:34.054689 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.063979 12556 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4.
I20260709 12:25:34.065267 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.060719 12553 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
W20260709 12:25:34.061146 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.729s (SENT)
I20260709 12:25:34.066524 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.068840 12553 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.064915 16817 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.069470 16817 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.069625 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.069870 16817 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.070510 12553 raft_consensus.cc:2410] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:34.071298 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.071877 12553 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:34.072661 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.067562 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.073843 12550 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:34.067996 12551 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.074330 16901 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:34.074756 16901 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:34.075145 16901 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.075452 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:34.075920 12558 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
W20260709 12:25:34.080907 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 158571us
I20260709 12:25:34.081288 12552 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:34.082274 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.082986 12552 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:34.086288 16866 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:34.086424 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.079826 16877 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:34.087201 12552 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.088055 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.088701 12552 raft_consensus.cc:2368] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8.
I20260709 12:25:34.089427 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.090018 12552 raft_consensus.cc:2368] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8.
I20260709 12:25:34.090687 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.091321 12552 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.092298 16901 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:34.094458 16901 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:34.095072 16901 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.097606 16842 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:34.102551 12628 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:34.102281 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.107085 12554 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:34.079375 16783 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.108222 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.065446 16856 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:34.108800 12554 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:34.108915 16856 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:34.109712 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.110289 12554 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:34.109906 16856 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:34.116518 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 55396.3us
I20260709 12:25:34.117576 12559 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
W20260709 12:25:34.119994 12557 consensus_meta.cc:287] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.928s	user 0.007s	sys 0.004s
I20260709 12:25:34.120814 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.121688 12554 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:34.121351 12557 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:34.123152 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.123718 12557 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:34.123785 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.124575 12559 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.083710 16755 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.125265 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.126526 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.126879 16923 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:34.132344 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.135649 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.139147 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.142753 12557 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.142915 12555 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:34.143095 12551 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:34.132747 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.139851 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.144042 12559 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
W20260709 12:25:34.144454 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.142302 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45018.8us
I20260709 12:25:34.145241 12558 raft_consensus.cc:2368] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:34.149964 12704 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:34.151456 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:34.153103 12554 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:34.153429 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.154163 12627 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:34.154191 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.155625 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.156028 12597 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:34.156692 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.156867 16922 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.157351 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:34.158713 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.159330 16783 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.159885 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:34.162853 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.163110 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.163506 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:34.164031 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.164808 12555 raft_consensus.cc:2410] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 11 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:34.165354 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:34.166118 12627 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:34.166574 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.167135 12555 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:34.157529 12557 raft_consensus.cc:2410] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:34.156147 12554 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:34.151456 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.174290 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:34.182370 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.181051 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.183341 12559 raft_consensus.cc:2410] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:34.186647 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:34.092047 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.138104 16479 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.196525 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:34.434442 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080032cc80 after lost signal to thread 11395
W20260709 12:25:34.448122 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.213879 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:34.338245 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.452111 12488 debug-util.cc:398] Leaking SignalData structure 0x7b0800347940 after lost signal to thread 12491
I20260709 12:25:34.214433 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:34.390302 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 311373us
W20260709 12:25:34.344023 13230 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.300s	user 0.001s	sys 0.013s
I20260709 12:25:34.214032 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:34.225613 12558 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:34.262183 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 74401us
I20260709 12:25:34.453157 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.213652 12554 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:34.456605 12551 raft_consensus.cc:2410] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:34.196615 12552 raft_consensus.cc:2368] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:25:34.460134 12630 raft_consensus.cc:2393] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:34.461318 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:34.461328 12559 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:34.455958 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.841s (SENT)
W20260709 12:25:34.464533 13201 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.849s (SENT)
I20260709 12:25:34.229732 16841 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.499325 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.500381 12554 raft_consensus.cc:2368] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13.
I20260709 12:25:34.492578 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.492755 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.493265 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.412284 16337 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:34.251775 16904 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.502568 12551 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:34.504667 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:34.390414 16877 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:34.449204 16881 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.502601 12559 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:34.502892 12558 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:34.498219 16885 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:25:34.507012 16755 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.231860 16822 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.276s
I20260709 12:25:34.456020 16708 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:34.508944 16923 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:34.504946 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 45757.5us
I20260709 12:25:34.514108 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.525836 12554 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:34.519448 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.493528 16792 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:34.521243 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.531435 12552 raft_consensus.cc:2410] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:34.525305 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:34.528324 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.529266 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:34.532155 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.532316 12559 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:34.532446 12558 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:34.532938 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:34.527323 13201 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.933s (SENT)
I20260709 12:25:34.371915 16817 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.536043 16817 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:34.536782 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:34.538036 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.538769 12552 raft_consensus.cc:2393] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.526329 16904 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.539634 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.540464 12552 raft_consensus.cc:2376] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11. Re-sending same reply.
I20260709 12:25:34.541688 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.541905 12631 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:34.542548 12552 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:34.544090 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.545517 12552 raft_consensus.cc:2393] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:34.546089 16593 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:34.546684 16593 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:34.547194 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.548928 16593 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:34.549903 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.550793 12552 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:34.552110 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.553016 12552 raft_consensus.cc:2368] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:25:34.556520 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.556851 12631 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:34.557209 12554 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:34.560664 13230 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.517s	user 0.001s	sys 0.027s
I20260709 12:25:34.564837 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.565275 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.565547 12559 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:34.565913 12558 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:34.571192 16812 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:34.509570 16841 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:34.576809 12554 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:34.611261 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.560257 16866 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.524108 16337 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.623435 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.527463 16755 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.644963 12558 raft_consensus.cc:2410] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:34.755834 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:34.555084 16923 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:34.765537 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.767663 12554 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260709 12:25:34.768071 12554 pending_rounds.cc:85] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
I20260709 12:25:34.768316 12554 pending_rounds.cc:107] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:34.768626 12554 raft_consensus.cc:2889] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.759506 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:34.772578 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 266966us
I20260709 12:25:34.774793 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:34.772522 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.778218 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:34.779707 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 115025us
I20260709 12:25:34.619998 16708 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:34.627720 16593 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:34.781283 12600 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.171s (SENT)
I20260709 12:25:34.783877 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.827127 12551 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.827507 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.614558 16792 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.764889 16947 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:34.861739 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:34.865562 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:34.880110 12555 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:25:34.884428 12558 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 8. Ops: []
I20260709 12:25:34.880692 12555 pending_rounds.cc:85] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 7
I20260709 12:25:34.885144 12555 pending_rounds.cc:107] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:25:34.885442 12555 raft_consensus.cc:2889] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:34.887663 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.888298 12554 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:34.888932 12701 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:34.889776 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:34.890165 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45144 (request call id 2364) took 1033 ms. Trace:
I20260709 12:25:34.893426 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:34.894345 12700 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.891731 12701 rpcz_store.cc:276] 0709 12:25:33.857528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.858295 (+   767us) service_pool.cc:224] Handling call
0709 12:25:34.437863 (+579568us) spinlock_profiling.cc:243] Waited 900 us on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:34.833552 (+395689us) spinlock_profiling.cc:243] Waited 2.84 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6e9c 00007f0e919c6a5b 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:34.890086 (+ 56534us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8609920}
I20260709 12:25:34.868245 16947 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.897360 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:34.829171 16708 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:34.902048 16337 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:34.902838 16932 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.279s	user 0.000s	sys 0.000s
W20260709 12:25:34.903522 16930 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:25:34.877970 16904 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:34.915817 16755 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:34.917313 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080008a840 after lost signal to thread 12583
I20260709 12:25:34.773270 16877 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:34.893476 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 360588us
I20260709 12:25:34.884647 16817 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:34.931649 12674 leader_election.cc:336] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.073s (SENT)
I20260709 12:25:34.918155 16479 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:34.938488 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:34.939482 16935 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.078s	user 0.003s	sys 0.000s
I20260709 12:25:34.898000 16866 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.868041 16593 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:34.942750 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 161498us
I20260709 12:25:34.983919 12699 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:34.968931 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:34.969340 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:34.970124 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:34.938186 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080008a860 after lost signal to thread 12584
I20260709 12:25:34.938685 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:34.932564 16947 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:34.981853 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:34.986056 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:34.987993 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080008a780 after lost signal to thread 12658
W20260709 12:25:35.010131 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080008a740 after lost signal to thread 12659
W20260709 12:25:35.011549 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080022b0e0 after lost signal to thread 12732
W20260709 12:25:35.011906 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08003078c0 after lost signal to thread 12733
W20260709 12:25:34.989356 16937 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:25:34.999378 16812 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:35.001096 16792 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.002013 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:35.002871 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:35.003218 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:34.994234 16936 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260709 12:25:34.997012 16746 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:34.998140 16934 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:25:35.002898 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:35.013393 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08001237e0 after lost signal to thread 13259
I20260709 12:25:35.050174 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:34.941202 16841 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.049343 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:35.050487 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08000dd720 after lost signal to thread 13260
I20260709 12:25:35.051645 12558 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:34.992640 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 953) took 1992 ms. Trace:
I20260709 12:25:35.052278 13230 rpcz_store.cc:276] 0709 12:25:33.000358 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:33.009566 (+  9208us) service_pool.cc:224] Handling call
0709 12:25:33.028039 (+ 18473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.028289 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:34.561232 (+1532943us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.860601 (+299369us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.992138 (+131537us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b1800394240. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e91a00a40 00007f0e919fb4e4 00007f0e919fb455 00007f0e94ae3060 00007f0e94af5716 00007f0e94b06287 00007f0e94b06208
0709 12:25:34.992276 (+   138us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:34.992328 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:34.992373 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.992442 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:34.992558 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3720,"prepare.queue_time_us":537553,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":76,"raft.queue_time_us":133067,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":4535040,"thread_start_us":1788477,"threads_started":2,"wal-append.queue_time_us":352279}
W20260709 12:25:35.051704 12488 debug-util.cc:398] Leaking SignalData structure 0x7b0800323cc0 after lost signal to thread 16446
W20260709 12:25:35.055464 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6dc0 after lost signal to thread 16796
W20260709 12:25:35.055817 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08003ea0e0 after lost signal to thread 16816
W20260709 12:25:35.056196 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7060 after lost signal to thread 16830
W20260709 12:25:35.056469 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080034c7a0 after lost signal to thread 16831
W20260709 12:25:35.056878 12488 debug-util.cc:398] Leaking SignalData structure 0x7b0800193080 after lost signal to thread 16864
W20260709 12:25:35.057224 12488 debug-util.cc:398] Leaking SignalData structure 0x7b0800279520 after lost signal to thread 16871
W20260709 12:25:35.057518 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080034f400 after lost signal to thread 16873
W20260709 12:25:35.057888 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08003d9c80 after lost signal to thread 16886
I20260709 12:25:34.991405 16522 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:25:35.065483 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 96187.8us
I20260709 12:25:35.066213 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:35.068189 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:35.069252 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 294575us
W20260709 12:25:35.069998 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.072849 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:35.073168 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 141547us
I20260709 12:25:35.073678 12633 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:35.084046 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:35.071048 16935 log.cc:927] Time spent T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:25:35.088625 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 119772us
W20260709 12:25:35.090620 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 94017.8us
I20260709 12:25:35.091145 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2379) took 1174 ms. Trace:
I20260709 12:25:35.093310 12627 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260709 12:25:35.072556 16522 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:35.093995 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.091522 12559 rpcz_store.cc:276] 0709 12:25:33.917046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.566239 (+649193us) service_pool.cc:224] Handling call
0709 12:25:34.588948 (+ 22709us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.620345 (+ 31397us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:34.777831 (+157486us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.083327 (+305496us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.083373 (+    46us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:35.090916 (+  7543us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.090993 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.091091 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":149745,"prepare.run_cpu_time_us":6984,"prepare.run_wall_time_us":40118,"thread_start_us":189376,"threads_started":1}
I20260709 12:25:35.073098 16792 raft_consensus.cc:2764] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:25:35.072748 16901 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:35.099087 13230 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:25:35.100162 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:35.101869 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.092625 16866 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.049326 16812 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.065263 16746 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.112128 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.098912 16923 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:35.100994 16755 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:35.154065 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:35.154771 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:35.155606 12702 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:35.158701 13201 leader_election.cc:336] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.041s (SENT)
I20260709 12:25:35.159842 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:35.160969 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 59166.6us
I20260709 12:25:35.107874 16593 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:35.165150 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.165313 12708 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:35.129149 16522 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.166633 16522 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:35.167572 16944 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:25:35.168226 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:35.169483 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:35.170070 12704 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:35.173529 12701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:45130
I20260709 12:25:35.174420 12701 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:35.174863 12701 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.177500 16955 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:35.107895 16950 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:25:35.110546 16942 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.130260 16792 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:35.185971 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 86015.9us
W20260709 12:25:35.195502 12674 leader_election.cc:336] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.210s (SENT)
I20260709 12:25:35.196466 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.191951 12704 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:35.185091 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.193809 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1091) took 1055 ms. Trace:
W20260709 12:25:35.181857 16939 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.242s	user 0.001s	sys 0.001s
W20260709 12:25:35.215118 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 96454.7us
I20260709 12:25:35.162374 16923 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.217098 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:35.247148 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 88486.6us
I20260709 12:25:35.247418 12626 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 15
W20260709 12:25:35.247856 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.060s (SENT)
I20260709 12:25:35.240451 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 915) took 1055 ms. Trace:
I20260709 12:25:35.219805 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:35.252925 12704 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:35.243582 12628 rpcz_store.cc:276] 0709 12:25:34.138520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.138670 (+   150us) service_pool.cc:224] Handling call
0709 12:25:34.138995 (+   325us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:34.139644 (+   649us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.139676 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:34.140270 (+   594us) log.cc:844] Serialized 52 byte log entry
0709 12:25:34.528411 (+388141us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:34.560275 (+ 31864us) log.cc:844] Serialized 14 byte log entry
0709 12:25:34.561840 (+  1565us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.561916 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:34.904241 (+342325us) spinlock_profiling.cc:243] Waited 10.1 ms on lock 0x7b18004a9bc0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:35.184869 (+280628us) raft_consensus.cc:1685] finished
0709 12:25:35.193604 (+  8735us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.193754 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1302,"prepare.queue_time_us":36025,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":1516,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":3862,"spinlock_wait_cycles":23166720,"thread_start_us":387743,"threads_started":1,"wal-append.queue_time_us":643823}
W20260709 12:25:35.255740 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 60317.1us
I20260709 12:25:35.257088 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:35.259115 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 159008us
W20260709 12:25:35.260617 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 96323us
I20260709 12:25:35.262049 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.255110 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.181334 16746 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.264123 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.198380 16593 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.218485 16817 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:35.281764 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.283309 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:35.278061 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.250259 12703 rpcz_store.cc:276] 0709 12:25:34.161567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.164426 (+  2859us) service_pool.cc:224] Handling call
0709 12:25:34.164756 (+   330us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:34.165180 (+   424us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.165207 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:34.165840 (+   633us) log.cc:844] Serialized 52 byte log entry
0709 12:25:34.534677 (+368837us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:34.534725 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:34.535876 (+  1151us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.216270 (+680394us) raft_consensus.cc:1685] finished
0709 12:25:35.216301 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.216488 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1435,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":15920,"thread_start_us":368411,"threads_started":1,"wal-append.queue_time_us":592901}
I20260709 12:25:35.284335 12559 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:35.271677 12523 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.285377 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.288025 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:35.282346 13201 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.177s (SENT) [suppressed 53 similar messages]
I20260709 12:25:35.423893 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.286266 16955 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:35.305006 16486 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:25:35.425818 12600 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.518s (SENT)
I20260709 12:25:35.469071 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:35.314220 16966 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:35.305976 16949 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:35.491932 16965 log.cc:927] Time spent T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:35.493289 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2214) took 1437 ms. Trace:
I20260709 12:25:35.493552 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 920) took 1330 ms. Trace:
I20260709 12:25:35.493836 12554 rpcz_store.cc:276] 0709 12:25:34.056186 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.897397 (+841211us) service_pool.cc:224] Handling call
0709 12:25:34.934668 (+ 37271us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:34.934892 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:34.934915 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:34.939129 (+  4214us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.126669 (+187540us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:35.126726 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.126821 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.493019 (+366198us) raft_consensus.cc:1685] finished
0709 12:25:35.493046 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.493217 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":104445,"threads_started":1,"wal-append.queue_time_us":331143}
I20260709 12:25:35.494074 12707 rpcz_store.cc:276] 0709 12:25:34.163033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.187293 (+ 24260us) service_pool.cc:224] Handling call
0709 12:25:34.986587 (+799294us) spinlock_profiling.cc:243] Waited 4.34 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:25:34.986711 (+   124us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.028727 (+ 42016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.028759 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.065942 (+ 37183us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.160364 (+ 94422us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:35.160422 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.160529 (+   107us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.493196 (+332667us) raft_consensus.cc:1685] finished
0709 12:25:35.493223 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.493485 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25896,"raft.queue_time_us":42700,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":14302,"spinlock_wait_cycles":9979136,"thread_start_us":63552,"threads_started":1,"wal-append.queue_time_us":160449}
I20260709 12:25:35.496318 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:35.420786 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 134906us
I20260709 12:25:35.425909 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.439724 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.440503 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.291672 16923 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:35.498589 16955 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:35.500492 16923 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:35.442844 16942 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:35.501309 16923 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.501209 16955 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.444598 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.504066 12704 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:35.313653 16812 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.256757 16708 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.446658 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2368) took 1531 ms. Trace:
I20260709 12:25:35.449673 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.517882 12556 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:35.458106 12551 consensus_meta.cc:287] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.598s	user 0.008s	sys 0.000s
W20260709 12:25:35.458642 12700 consensus_meta.cc:287] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.530s	user 0.006s	sys 0.002s
I20260709 12:25:35.518497 12551 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:35.518569 12700 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:35.461256 12701 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.519380 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.425626 16841 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:35.287837 16593 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.489624 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.426688 16950 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:35.490456 16970 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:35.289665 16817 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.533265 12701 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:35.364624 12628 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:35.499962 12550 raft_consensus.cc:2410] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:35.499264 12522 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.497366 12554 raft_consensus.cc:2393] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:35.505795 12558 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
W20260709 12:25:35.508121 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 82357.1us
W20260709 12:25:35.535756 12600 leader_election.cc:336] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.686s (SENT)
I20260709 12:25:35.515811 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.515971 12702 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:35.537730 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.538893 12522 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.530970 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.540490 12551 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:35.530306 12556 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38728 (request call id 2396) took 1596 ms (client timeout 1731 ms). Trace:
I20260709 12:25:35.510706 16783 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:35.543053 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.533291 12559 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
W20260709 12:25:35.543185 12550 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2226) took 1472 ms (client timeout 1745 ms). Trace:
I20260709 12:25:35.536149 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:35.541713 12556 rpcz_store.cc:269] 0709 12:25:33.922266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.064492 (+142226us) service_pool.cc:224] Handling call
0709 12:25:34.445194 (+380702us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b5800010298. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:35.436452 (+991258us) spinlock_profiling.cc:243] Waited 3.28 ms on lock 0x7b5800010298. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6e9c 00007f0e919c6a5b 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:35.518244 (+ 81792us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":11001088}
I20260709 12:25:35.543236 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.520249 16792 raft_consensus.cc:2764] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:25:35.547657 12550 rpcz_store.cc:269] 0709 12:25:34.070819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.441025 (+370206us) service_pool.cc:224] Handling call
0709 12:25:35.439575 (+998550us) spinlock_profiling.cc:243] Waited 3.3 ms on lock 0x7b5800010298. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:35.543132 (+103557us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":7591808}
I20260709 12:25:35.561879 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.564581 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:35.522647 16885 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:35.570753 16953 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.269s	user 0.007s	sys 0.001s
I20260709 12:25:35.572718 12629 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:35.590101 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:35.590646 16957 log.cc:927] Time spent T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.320s	user 0.001s	sys 0.013s
I20260709 12:25:35.590802 12701 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:35.537352 16755 raft_consensus.cc:2764] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260709 12:25:35.609911 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:35.571441 16969 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:35.619735 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2221) took 1550 ms. Trace:
I20260709 12:25:35.620905 12554 rpcz_store.cc:276] 0709 12:25:34.069340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.563259 (+1493919us) service_pool.cc:224] Handling call
0709 12:25:35.619029 (+ 55770us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.619222 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.619250 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.619294 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:35.619332 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.619383 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.619670 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.517107 12557 rpcz_store.cc:276] 0709 12:25:33.899189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.182073 (+282884us) service_pool.cc:224] Handling call
0709 12:25:34.978080 (+796007us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5800010298. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:25:34.978210 (+   130us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.984196 (+  5986us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:35.190978 (+206782us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.430187 (+239209us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.430261 (+    74us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:35.430345 (+    84us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.430442 (+    97us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.430607 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":77343,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":31752,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":27363,"spinlock_wait_cycles":6967040,"thread_start_us":309262,"threads_started":2,"wal-append.queue_time_us":298059}
I20260709 12:25:35.629153 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:35.532591 16841 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.555547 16970 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.639163 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.641911 12626 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:25:35.608035 16904 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.662886 12558 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:35.670663 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:35.641530 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.674607 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:35.681620 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 145899us
I20260709 12:25:35.555054 16950 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.661772 16337 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:35.687023 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 148239us
I20260709 12:25:35.670058 16969 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.640811 16970 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:35.675343 16708 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.694497 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:35.696151 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.698297 12554 raft_consensus.cc:2393] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 8: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:35.698997 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 44443.3us
I20260709 12:25:35.689752 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:35.704733 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 422376us
W20260709 12:25:35.736656 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47000.2us
I20260709 12:25:35.737452 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.737962 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:35.681770 16904 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:35.702302 16881 consensus_meta.cc:287] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 1.180s	user 0.006s	sys 0.013s
I20260709 12:25:35.746129 12554 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 12:25:35.694214 16969 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.761052 16969 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.764118 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2224) took 1693 ms. Trace:
I20260709 12:25:35.764572 12554 rpcz_store.cc:276] 0709 12:25:34.070258 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.726188 (+1655930us) service_pool.cc:224] Handling call
0709 12:25:35.745832 (+ 19644us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.763848 (+ 18016us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.764065 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:35.766198 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2217) took 1709 ms. Trace:
I20260709 12:25:35.768147 12705 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:35.766700 12551 rpcz_store.cc:276] 0709 12:25:34.057025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.560503 (+1503478us) service_pool.cc:224] Handling call
0709 12:25:35.560812 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:35.561030 (+   218us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:35.569533 (+  8503us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.765753 (+196220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.765820 (+    67us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:35.765903 (+    83us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.765986 (+    83us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.766131 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72305,"prepare.queue_time_us":3825,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":123455,"threads_started":1,"wal-append.queue_time_us":188326}
I20260709 12:25:35.773381 16841 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.810825 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.815109 16593 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:35.812711 16817 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:35.741248 16966 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.815342 12554 raft_consensus.cc:2393] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:35.822054 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 84190.3us
I20260709 12:25:35.822795 12600 leader_election.cc:400] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 3 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 3. Current term is 4.
I20260709 12:25:35.769855 16877 raft_consensus.cc:2764] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:35.774416 16983 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.777427 16969 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:35.747555 16975 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:35.774083 16946 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:35.812944 16986 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:35.774758 16479 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:35.704465 16708 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.822666 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:35.825379 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 100273us
I20260709 12:25:35.824468 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.817200 16593 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:35.821808 16974 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:35.835021 12600 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:35.839068 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 912) took 1678 ms. Trace:
I20260709 12:25:35.839438 16982 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:35.840142 16964 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.343s	user 0.000s	sys 0.001s
I20260709 12:25:35.848212 16904 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:35.848634 16977 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:25:35.834085 16983 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.848758 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:35.849783 16973 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
I20260709 12:25:35.849680 16950 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.828296 16955 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.828864 16969 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:35.831126 16975 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.878333 16975 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.862329 12705 rpcz_store.cc:276] 0709 12:25:34.160655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.167231 (+  6576us) service_pool.cc:224] Handling call
0709 12:25:35.440373 (+1273142us) spinlock_profiling.cc:243] Waited 4.13 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ab10a0 00007f0e99ab0984 00007f0e9302b6d4 00007f0e9302b662
0709 12:25:35.838877 (+398504us) spinlock_profiling.cc:243] Waited 268 ms on lock 0x7b54001d6fd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:35.838989 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625405952}
I20260709 12:25:35.864490 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.882108 12708 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:35.832151 16946 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:35.883067 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.883895 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.884505 12557 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:25:35.884586 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.854624 16966 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.886855 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.886987 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.887655 12559 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:35.887698 16966 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.888492 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.889055 12559 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:35.890403 16746 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:35.894574 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2216) took 1837 ms. Trace:
I20260709 12:25:35.894953 12555 rpcz_store.cc:276] 0709 12:25:34.056766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.939394 (+882628us) service_pool.cc:224] Handling call
0709 12:25:34.972478 (+ 33084us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.026723 (+ 54245us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:35.026767 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.072919 (+ 46152us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.189651 (+116732us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:35.189707 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.584579 (+394872us) spinlock_profiling.cc:243] Waited 36.6 ms on lock 0x7b54001d1ad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:35.584632 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:35.839870 (+255238us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b2400179ee8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e918849c4 00007f0e91882acb 00007f0e91a3ddc9 00007f0e91a3da55 00007f0e91a3d09d 00007f0e9466f10e 00007f0e9468688c 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221
0709 12:25:35.894347 (+ 54477us) raft_consensus.cc:1685] finished
0709 12:25:35.894368 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.894512 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2989,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":6699,"spinlock_wait_cycles":143188992,"thread_start_us":90817,"threads_started":1,"wal-append.queue_time_us":226150}
I20260709 12:25:35.896771 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.863775 16986 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:35.883467 16946 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.867944 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:35.898233 12552 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2375) took 1996 ms. Trace:
I20260709 12:25:35.898418 16986 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.898690 12552 rpcz_store.cc:276] 0709 12:25:33.901318 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.553979 (+652661us) service_pool.cc:224] Handling call
0709 12:25:34.554414 (+   435us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.916515 (+362101us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:34.943124 (+ 26609us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.219624 (+276500us) log.cc:844] Serialized 14 byte log entry
0709 12:25:35.231135 (+ 11511us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:35.231187 (+    52us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:35.231240 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.590321 (+359081us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b2400179ee8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e918849c4 00007f0e91882acb 00007f0e91a3ddc9 00007f0e91a3da55 00007f0e91a3d09d 00007f0e9466f10e 00007f0e9468688c 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221
0709 12:25:35.897994 (+307673us) spinlock_profiling.cc:243] Waited 338 ms on lock 0x7b5400375854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:35.898059 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:35.898180 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54206,"prepare.queue_time_us":48096,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":8755,"raft.queue_time_us":19949,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":40655,"spinlock_wait_cycles":877376512,"thread_start_us":195525,"threads_started":2,"wal-append.queue_time_us":201157}
I20260709 12:25:35.900655 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.869851 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:35.868186 12551 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 6.
I20260709 12:25:35.902209 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.864184 16982 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:35.902742 12551 raft_consensus.cc:2376] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8. Re-sending same reply.
I20260709 12:25:35.903614 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.904377 16904 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:35.904510 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.905112 12551 raft_consensus.cc:2376] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 4. Re-sending same reply.
I20260709 12:25:35.902819 16982 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:35.859184 16866 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:35.861196 16479 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.882309 16708 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:35.901230 12552 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:35.906493 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.911715 12554 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 6: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:35.912678 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.900436 16975 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:35.913472 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46173.7us
I20260709 12:25:35.939474 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:35.939615 16966 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:35.939944 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:35.885300 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.915278 12555 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:35.940232 16966 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:35.941190 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.923022 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.941195 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.905381 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:35.924055 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.927872 16971 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:35.928448 16992 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:35.943601 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.944223 16992 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:35.944393 16989 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:35.944641 16992 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:35.945026 16989 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:35.929591 16955 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:35.948930 16955 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:35.949893 16955 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.950928 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.930685 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.951942 16970 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.952458 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.909302 16841 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:25:35.953238 12556 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 12. Ops: [10.6-10.6]
I20260709 12:25:35.954025 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:35.954357 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:35.954954 12559 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:35.932034 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.905903 16969 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:35.933702 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:35.934368 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:35.935233 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:35.940555 13234 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:35.939644 12702 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:35.973202 12558 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:35.941097 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:35.975124 16856 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:35.942335 12555 raft_consensus.cc:2368] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:35.929303 12705 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:35.981570 16975 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:35.983242 12454 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 8, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:35.988642 16856 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:35.989313 16856 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:35.922087 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 184718us
I20260709 12:25:35.945144 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.988723 16969 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:35.992338 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47260.8us
I20260709 12:25:35.993057 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.945379 16877 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:25:35.947283 16966 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:35.945116 16992 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:35.947556 16989 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:35.955682 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:35.955803 16812 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:35.956517 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:35.927310 16947 consensus_meta.cc:287] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.876s	user 0.010s	sys 0.002s
I20260709 12:25:35.911298 16983 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:35.962589 16946 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:35.961010 16593 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:35.967615 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 79748.7us
I20260709 12:25:35.968001 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:35.970549 12552 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:35.971505 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.012408 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:36.012725 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.013226 12552 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
W20260709 12:25:35.922325 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 280843us
I20260709 12:25:35.989928 12454 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 6, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:35.994079 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:35.994975 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:35.995496 16997 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 12:25:36.002414 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46800.5us
I20260709 12:25:36.002671 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:36.001456 16975 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:36.011245 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:36.018286 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.021170 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.021581 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.022506 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.026257 12598 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:36.027729 13229 raft_consensus.cc:2410] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:36.028565 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.023391 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:36.024520 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:36.025177 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.031225 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:36.023660 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.032665 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:36.036034 16486 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:36.036144 16708 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:36.036588 16486 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.036657 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.037129 16486 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:36.038221 16968 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:36.038620 16968 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.038745 16652 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.039001 16968 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:36.039285 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.035989 16841 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:36.042199 16841 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:36.042395 16904 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:36.042567 16841 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:36.035980 16337 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:36.043373 16337 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:36.043747 16337 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.024103 16993 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:36.045825 16993 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:36.046175 16993 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:36.006680 16877 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:36.007266 16947 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.050750 12553 raft_consensus.cc:2368] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 14. Current term is 15.
I20260709 12:25:36.051875 16947 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.052577 16992 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.004419 16812 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.055194 12554 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 13. Ops: []
I20260709 12:25:36.055537 16812 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:36.056059 12555 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:36.056866 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2235) took 1831 ms. Trace:
I20260709 12:25:36.057752 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.058527 12559 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:36.059782 12559 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:36.059937 16877 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:36.060957 12559 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:36.022400 16955 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:36.054765 16971 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:36.062043 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.062459 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:36.063110 16940 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:36.064007 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.065620 12558 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:36.054914 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.056010 12554 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2231) took 1983 ms. Trace:
I20260709 12:25:36.066475 12554 rpcz_store.cc:276] 0709 12:25:34.072201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.054725 (+1982524us) service_pool.cc:224] Handling call
0709 12:25:36.055012 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.055725 (+   713us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.055940 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.060817 16877 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:36.067404 12551 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:36.024055 16966 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:36.070701 12557 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:36.074200 12552 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
W20260709 12:25:36.075124 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 51549.5us
I20260709 12:25:36.076174 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.057224 12555 rpcz_store.cc:276] 0709 12:25:34.225048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.055461 (+1830413us) service_pool.cc:224] Handling call
0709 12:25:36.055750 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.056648 (+   898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.056816 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.053009 16841 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.077634 12522 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:36.087970 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 61768.3us
I20260709 12:25:36.078951 16978 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:36.089957 12553 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:38720 (request call id 2228) took 2018 ms (client timeout 1686 ms). Trace:
I20260709 12:25:36.093063 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.094254 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:36.096271 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:36.097015 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.090431 12553 rpcz_store.cc:269] 0709 12:25:34.071431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.897109 (+825678us) service_pool.cc:224] Handling call
0709 12:25:36.089769 (+1192660us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400373f54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:36.089891 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2577381632}
I20260709 12:25:36.099282 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:36.099853 12702 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:36.100667 12700 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 15: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:36.090744 16708 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:36.079315 16866 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:36.092294 16995 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260709 12:25:36.115947 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2227) took 2044 ms. Trace:
I20260709 12:25:36.119117 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.118996 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.080283 16947 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:36.079954 16955 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:36.124719 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.123240 12556 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2218) took 2065 ms. Trace:
I20260709 12:25:36.135414 12556 rpcz_store.cc:276] 0709 12:25:34.057313 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.563874 (+1506561us) service_pool.cc:224] Handling call
0709 12:25:35.886597 (+322723us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.953645 (+ 67048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.009000 (+ 55355us) spinlock_profiling.cc:243] Waited 66.4 ms on lock 0x7b5400102554. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:36.117293 (+108293us) spinlock_profiling.cc:243] Waited 322 ms on lock 0x7b5400102550. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:36.117496 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":894136448}
I20260709 12:25:36.123603 12558 rpcz_store.cc:276] 0709 12:25:34.071097 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.052962 (+1981865us) service_pool.cc:224] Handling call
0709 12:25:36.053252 (+   290us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.065996 (+ 12744us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.115648 (+ 49652us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54001d2ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:36.115868 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":28012800}
I20260709 12:25:36.102847 16209 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:36.090535 16982 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.102909 16975 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:36.142851 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.151238 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.098765 16983 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 12:25:36.128650 16755 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:36.107692 16966 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.120581 16994 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:36.173906 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48382.6us
I20260709 12:25:36.148283 16961 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:36.171517 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 55767us
I20260709 12:25:36.174671 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:36.165845 16708 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:36.178104 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44500us
I20260709 12:25:36.126454 16942 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:36.159003 16988 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:36.224599 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 87481.1us
I20260709 12:25:36.184303 12600 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.150308 16792 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:36.183542 16904 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:36.185091 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 48049.1us
I20260709 12:25:36.181869 16961 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:36.233932 13201 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.232017 16898 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:25:36.220239 16817 raft_consensus.cc:2764] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:25:36.236480 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2220) took 2167 ms. Trace:
I20260709 12:25:36.177654 16593 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.058s
I20260709 12:25:36.244611 12550 rpcz_store.cc:276] 0709 12:25:34.069078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.561654 (+1492576us) service_pool.cc:224] Handling call
0709 12:25:35.569855 (+  8201us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.696873 (+127018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:35.696894 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:35.724435 (+ 27541us) log.cc:844] Serialized 26 byte log entry
0709 12:25:35.854854 (+130419us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:35.854886 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.854977 (+    91us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.233118 (+378141us) raft_consensus.cc:1685] finished
0709 12:25:36.233140 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:36.236387 (+  3247us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70720,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":7634,"thread_start_us":205061,"threads_started":2,"wal-append.queue_time_us":183237}
I20260709 12:25:36.233675 16904 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.221211 16652 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 12:25:36.224089 16885 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.032s
W20260709 12:25:36.278821 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 94593.4us
W20260709 12:25:36.280503 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 55147.5us
I20260709 12:25:36.228355 16881 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 12:25:36.277261 16986 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.240291 16961 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.258312 16971 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:36.282912 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.288650 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:36.277633 16593 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:36.278321 16904 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:36.278002 16969 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.287977 16792 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.300257 12627 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.304926 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:36.233362 16988 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.296530 16986 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.309633 16842 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:36.313707 16917 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:36.314222 16917 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.254356 16975 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:36.318094 17000 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:25:36.319789 17001 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:36.324672 16942 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:36.326067 16593 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:36.326512 16593 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:36.327467 16593 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.329494 16866 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.329916 16866 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:36.331166 17006 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:36.330880 16866 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.331624 17006 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.331944 16479 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.332122 17006 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:36.332278 16866 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:36.336020 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:36.353120 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.293184 16971 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.362087 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.328886 16593 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:36.330750 16927 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:36.313166 16486 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.366227 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:36.366285 16337 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:36.370064 17005 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:36.370793 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:36.298139 16992 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.375869 16993 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:36.378677 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 71621.7us
I20260709 12:25:36.355187 16982 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.355543 16917 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:36.296162 16708 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.337258 16792 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.383687 16949 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:36.301363 16877 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.083s
W20260709 12:25:36.384841 17003 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.160s	user 0.003s	sys 0.000s
I20260709 12:25:36.299463 16746 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:25:36.362746 16968 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.385684 16856 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.387483 16841 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.394840 16986 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:36.401937 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 181520us
I20260709 12:25:36.404196 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.452713 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:36.458329 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:36.401716 16971 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:36.470103 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 187294us
W20260709 12:25:36.472925 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 106794us
I20260709 12:25:36.473042 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:36.473591 16983 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:36.475349 12550 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:36.751343 12559 raft_consensus.cc:2376] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10. Re-sending same reply.
I20260709 12:25:36.760174 13234 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:36.476353 12557 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:36.446668 16927 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:36.325294 16942 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.450657 16783 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:36.481446 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 101707us
I20260709 12:25:36.363057 16812 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.469017 16967 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:36.599421 16970 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.546106 16966 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.478718 16652 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:36.754631 12705 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:36.798072 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:36.795202 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 250633us
I20260709 12:25:36.799075 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.799412 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:36.763849 13227 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:36.800099 17018 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:36.836562 12708 raft_consensus.cc:2393] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:36.806850 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 56041.2us
I20260709 12:25:36.806896 16983 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.759171 16947 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.808540 12700 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:36.812942 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.814826 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:36.822597 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:36.748646 17006 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.806049 16783 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:36.826187 16961 consensus_meta.cc:287] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 12:25:36.808588 12702 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 4. (index mismatch)
I20260709 12:25:36.759260 16986 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:36.842276 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:36.808614 16792 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.842876 12628 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:36.845940 12626 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:36.840029 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:36.838569 12631 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:36.844972 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:36.846582 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:36.863008 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:36.855140 12634 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:36.842218 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:36.796741 16994 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:36.861259 12629 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:36.867439 12627 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:36.867550 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:36.865605 12629 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:36.815275 16904 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:36.883569 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:36.907809 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:36.912020 12633 raft_consensus.cc:2376] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15. Re-sending same reply.
I20260709 12:25:36.875898 16989 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:36.896250 16982 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:36.833102 16967 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.852888 16947 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.870204 16881 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:36.891177 16783 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.903379 16885 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:36.861867 16986 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.894192 16992 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:36.909983 16997 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:25:36.849972 17018 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.856259 16961 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.874161 17010 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.064s
I20260709 12:25:36.893229 16917 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:36.967211 17006 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.951714 16856 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.968410 16942 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.968853 16917 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
W20260709 12:25:36.971464 16593 consensus_meta.cc:287] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260709 12:25:36.972865 16904 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.973783 16988 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.928648 16337 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.975620 16967 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.977320 16961 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:36.979360 16947 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.981595 16983 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.983585 16986 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.862608 16927 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:36.985386 16812 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:36.939965 16881 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:36.941145 16993 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.941181 16885 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:36.995489 16970 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.041898 16970 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.044214 16970 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.958464 17019 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:36.965826 16954 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.865733 16994 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.048204 16994 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:36.952325 16783 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:37.048940 16783 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.051272 16783 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:37.002072 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 107785us
I20260709 12:25:36.997967 16792 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:37.072213 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.072785 16652 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:37.073501 16792 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.075577 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.060266 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:37.076187 12558 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.075730 16792 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.041348 13232 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:37.077540 17013 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.684s	user 0.009s	sys 0.004s
I20260709 12:25:37.060382 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.078507 12557 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:37.059545 16927 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:37.040483 16881 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:37.082193 12629 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.083333 12629 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.056793 16885 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:37.024333 16961 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.088620 16961 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.086468 12553 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:37.090572 16961 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:37.091482 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 977) took 1005 ms. Trace:
I20260709 12:25:37.092303 17018 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:37.095641 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 976) took 1009 ms. Trace:
I20260709 12:25:37.100059 12558 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:37.045436 16954 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.106423 16954 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:37.100234 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.099190 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.092021 13234 rpcz_store.cc:276] 0709 12:25:36.086495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.087501 (+  1006us) service_pool.cc:224] Handling call
0709 12:25:36.087793 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:36.770238 (+682445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.091205 (+320967us) spinlock_profiling.cc:243] Waited 482 ms on lock 0x7b540080acd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:37.091411 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1109191040}
I20260709 12:25:37.109896 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.112713 12555 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:37.112608 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:37.113220 12554 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:37.111377 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.117980 12553 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:37.109258 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.119190 13234 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:37.092470 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:37.120071 12552 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:37.096176 13229 rpcz_store.cc:276] 0709 12:25:36.086096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.086738 (+   642us) service_pool.cc:224] Handling call
0709 12:25:36.087128 (+   390us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.144963 (+ 57835us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.144993 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.161330 (+ 16337us) log.cc:844] Serialized 26 byte log entry
0709 12:25:36.280249 (+118919us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:36.280308 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:36.280394 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:36.604654 (+324260us) spinlock_profiling.cc:243] Waited 52.7 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:37.077246 (+472592us) spinlock_profiling.cc:243] Waited 3.35 ms on lock 0x7b24003692d8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e918849c4 00007f0e91882acb 00007f0e91a3ddc9 00007f0e91a3da55 00007f0e91a3d09d 00007f0e9466f10e 00007f0e9468688c 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221
0709 12:25:37.095369 (+ 18123us) raft_consensus.cc:1685] finished
0709 12:25:37.095402 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.095571 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":67438,"raft.queue_time_us":57819,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":13443,"spinlock_wait_cycles":128994432,"thread_start_us":61040,"threads_started":1,"wal-append.queue_time_us":125521}
I20260709 12:25:37.122236 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.123478 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.125576 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:37.129367 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.131276 12634 raft_consensus.cc:2410] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:37.135143 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.135517 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.145784 12705 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:37.146209 12557 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:37.147644 12625 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:37.138064 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.148523 12627 raft_consensus.cc:2410] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:37.121219 16877 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:37.155236 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 315963us
I20260709 12:25:37.158030 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:37.163863 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.223462 12558 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.224646 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:37.167543 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 232540us
W20260709 12:25:37.225551 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.225744 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:37.231595 12626 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:37.233253 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:37.239477 12558 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:37.251843 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.263578 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:37.275951 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.288861 13227 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:37.289906 13229 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:37.153569 16755 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:37.294436 16999 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.294610 16755 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.295020 16999 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.297014 16755 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:37.220853 16967 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:37.291322 16842 consensus_queue.cc:1059] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:37.301278 16999 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.308561 16982 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:37.308830 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.314972 12555 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.139124 16971 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.318008 16842 raft_consensus.cc:3055] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:37.318429 16842 raft_consensus.cc:740] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:37.307201 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:37.319253 16842 consensus_queue.cc:260] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.320258 13230 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:37.319723 16971 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.320547 16842 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.319765 12557 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:37.322417 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.322912 12557 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.323230 16652 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:37.324095 16652 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:37.324630 16652 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:37.251132 16877 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.327307 16877 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:37.330725 12553 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:37.341913 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:37.342770 12626 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 15: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:37.349849 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.313759 16982 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.300313 17029 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:25:37.477855 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.391157 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:37.472632 12674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.009s	sys 0.021s
I20260709 12:25:37.403563 12626 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 4. (term mismatch)
I20260709 12:25:37.381865 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.481523 12626 pending_rounds.cc:85] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 3
I20260709 12:25:37.481841 12626 pending_rounds.cc:107] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 12:25:37.480779 12553 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.482128 12626 raft_consensus.cc:2889] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:37.482190 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:37.472832 13198 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.006s	sys 0.026s
W20260709 12:25:37.482861 13198 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.006s	sys 0.026s
I20260709 12:25:37.482910 12631 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
W20260709 12:25:37.483170 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 618703us
W20260709 12:25:37.436848 12551 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.023s	sys 0.072s
I20260709 12:25:37.362571 16994 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.402990 16652 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:37.362121 16708 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.007s	sys 0.014s
I20260709 12:25:37.387897 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:37.366110 16978 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.017s	sys 0.020s
W20260709 12:25:37.471402 12523 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.004s	sys 0.025s
W20260709 12:25:37.612942 12523 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.005s	sys 0.025s
I20260709 12:25:37.390779 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:37.390362 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:37.427968 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.389091 12557 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:37.496450 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:37.497676 12551 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.027s	sys 0.072s
W20260709 12:25:37.498871 12674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.021s
I20260709 12:25:37.506799 12629 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:37.487435 16968 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.492815 16885 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.333130 16792 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:37.618119 12628 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:37.618814 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 230992us
I20260709 12:25:37.619199 12631 raft_consensus.cc:2368] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10.
I20260709 12:25:37.492851 12553 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:37.608213 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.623757 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.315579 16967 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.362021 16986 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.629618 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.632655 16486 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:37.654281 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 791280us
I20260709 12:25:37.655189 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:37.634469 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.630262 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:37.632230 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.632488 12634 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:37.632947 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.658021 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:37.658883 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 424303us
I20260709 12:25:37.659263 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:37.612555 16708 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.008s	sys 0.014s
I20260709 12:25:37.657923 12625 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
W20260709 12:25:37.616698 16978 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.219s	user 0.018s	sys 0.021s
I20260709 12:25:37.649585 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:37.364650 16881 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.664760 12699 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:37.651902 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:37.665694 12627 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:37.631685 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:37.654496 13227 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 6.
I20260709 12:25:37.660511 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.659281 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:37.629392 16997 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 12:25:37.656278 12708 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:37.669163 12625 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:37.631301 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:37.633086 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.493664 17036 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.157s
I20260709 12:25:37.629480 16945 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:37.618885 17033 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.663343 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:37.637168 16993 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.630292 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.630241 17041 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.612512 16994 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.631963 16954 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
W20260709 12:25:37.684271 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 53054.8us
I20260709 12:25:37.633163 16969 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 12:25:37.687711 12633 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260709 12:25:37.687719 12626 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:37.625953 17015 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.687028 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:37.665597 16955 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:37.677609 16945 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.687572 12707 raft_consensus.cc:1240] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:37.697849 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:37.638105 16569 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:25:37.696967 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.692137 13201 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:37.633852 16792 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.706077 12704 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
W20260709 12:25:37.711258 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.664248 16986 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.693481 16522 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:37.691084 16486 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:37.637295 16755 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 12:25:37.724857 12600 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:37.746461 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:37.740702 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:37.691386 17029 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:37.747998 17029 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.748492 17029 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:37.742936 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 50904.6us
I20260709 12:25:37.745337 12559 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:37.742470 17032 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:37.754050 16989 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:37.754437 17032 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:37.754736 16989 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:37.692866 16993 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.755939 16989 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.757323 16993 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:37.699894 16927 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.704496 16982 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:37.765952 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 110844us
I20260709 12:25:37.704041 16945 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:37.725360 16708 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:37.790501 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:37.791725 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:37.778757 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.793352 12555 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:37.794718 12559 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
W20260709 12:25:37.768287 16975 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.340s	user 0.029s	sys 0.035s
I20260709 12:25:37.803011 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:37.803694 12555 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:37.807065 17046 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:37.809908 16967 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:37.745169 16522 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:37.810552 17035 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.196s	user 0.000s	sys 0.001s
I20260709 12:25:37.811919 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1105) took 1349 ms. Trace:
I20260709 12:25:37.812256 16522 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:37.812786 17048 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
W20260709 12:25:37.812964 17040 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.349s	user 0.001s	sys 0.000s
I20260709 12:25:37.797111 16486 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:37.814428 16486 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:37.818166 17045 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
I20260709 12:25:37.812250 12551 rpcz_store.cc:276] 0709 12:25:36.462490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.464612 (+  2122us) service_pool.cc:224] Handling call
0709 12:25:36.464882 (+   270us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.471138 (+  6256us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.471172 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.471581 (+   409us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.069264 (+597683us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4800080358. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e99a14aa1 00007f0e99a0bb37 00007f0e99a0b9ca 00007f0e99b0326f 00007f0e99b02f37 00007f0e99b1755c 00007f0e99b17508 00007f0e99b17488 00007f0e99b17443 00007f0e99b166ec 00007f0e98a40a96
0709 12:25:37.617122 (+547858us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:37.617169 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.617238 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.811636 (+194398us) raft_consensus.cc:1685] finished
0709 12:25:37.811655 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.811851 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":132,"raft.run_cpu_time_us":5357,"raft.run_wall_time_us":602345,"spinlock_wait_cycles":7877376,"thread_start_us":861707,"threads_started":1,"wal-append.queue_time_us":944395}
I20260709 12:25:37.796681 16841 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:37.823930 12551 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:37.825486 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 155366us
I20260709 12:25:37.802125 17042 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:37.822808 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 163613us
I20260709 12:25:37.801477 16955 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:37.801080 16975 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.414s	user 0.029s	sys 0.036s
I20260709 12:25:37.826148 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:37.799328 16927 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.836647 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:37.838456 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 206920us
I20260709 12:25:37.841566 12555 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:37.832213 16841 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:37.853556 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:37.853821 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:37.854226 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.834116 16479 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.855280 12631 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:37.862095 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.858903 12627 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:37.855005 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:37.862950 12632 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:37.836243 16969 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:37.862411 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:37.859434 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:37.862848 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 176211us
I20260709 12:25:37.869448 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.848837 16885 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:37.871680 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:37.872659 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:37.873903 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:37.862278 16898 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:37.866148 16955 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:37.884317 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 137874us
I20260709 12:25:37.885986 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:37.895597 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:37.903579 12600 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:37.695518 17041 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.876560 16898 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:37.680240 17033 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.883427 16479 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:37.894749 16885 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:37.696643 17015 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.910018 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.904644 16993 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:37.905426 16975 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:37.912281 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.913208 12700 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:37.903232 16792 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:37.918725 12701 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:37.908241 17051 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:37.915932 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.909619 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.910108 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:37.905995 17054 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:37.912667 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:37.914489 16993 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:37.923364 16993 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:37.911572 16479 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:37.913636 16955 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:37.911839 16994 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.928414 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:37.982879 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 70339.5us
I20260709 12:25:37.927822 12699 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:37.914042 17036 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:37.932821 17031 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260709 12:25:37.900739 16841 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:37.934569 16792 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:37.908844 17057 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:37.983867 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:37.926048 16986 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.018957 17036 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.019501 17036 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:38.020437 17036 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.021860 16950 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:38.022253 16950 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.023130 17033 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:37.992198 17043 log.cc:927] Time spent T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260709 12:25:38.023064 16950 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.024113 16950 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:37.926285 17061 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.025604 17061 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.027736 17061 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.928462 16479 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:38.029697 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:37.932971 17038 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
I20260709 12:25:37.916225 16885 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.007066 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:38.032213 16997 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:38.032691 16997 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:38.032951 16885 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:38.033850 16999 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:38.034236 16999 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.010680 17053 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.137s
W20260709 12:25:38.012596 17047 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:25:38.052563 12708 raft_consensus.cc:2410] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 12 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:37.984591 17051 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:38.013582 17049 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:25:37.992379 17052 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:38.019609 16842 consensus_meta.cc:287] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.699s	user 0.011s	sys 0.011s
I20260709 12:25:37.975093 16982 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:38.001962 17050 log.cc:927] Time spent T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:25:37.915690 17056 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:25:38.064388 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.066010 16885 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.067544 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.068171 12699 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:38.057082 16993 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.071012 16993 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.055286 17033 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.072423 17033 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.074497 17033 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.053833 16708 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.055845 16927 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.074285 17058 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:38.005038 16898 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.082199 17015 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.075099 16708 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.085394 16708 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.086252 17041 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.087303 17051 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.090799 12703 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:38.063020 16997 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.035077 16999 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.099431 16999 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.106437 16982 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:38.107632 16982 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.124748 16945 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.080972 17029 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.164302 17029 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.157918 16945 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:38.182868 17015 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.183168 17019 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.183723 17015 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.184814 16993 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.185444 16993 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.186800 17015 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.183821 17019 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.187747 16993 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.189396 17019 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:38.192803 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.197286 16842 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:38.197860 16842 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.200229 16842 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:37.093938 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:38.202829 12454 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 10 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.204417 12454 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 8, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 8 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:38.209102 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.231266 12632 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2572) took 1412 ms. Trace:
I20260709 12:25:38.235416 17073 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.236263 12632 rpcz_store.cc:276] 0709 12:25:36.819326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.819512 (+   186us) service_pool.cc:224] Handling call
0709 12:25:36.825692 (+  6180us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.863397 (+1037705us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.230998 (+367601us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002107d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.231196 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2385071872}
I20260709 12:25:38.236007 17056 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.237851 17056 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.238749 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.238988 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:38.239707 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.239951 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.240252 17056 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.241251 13229 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:38.236600 17073 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.242632 13199 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.243008 17042 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.243393 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.243477 16842 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:38.245105 16842 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.245986 17073 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.246675 16842 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.256541 16927 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:38.259186 12558 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.007s	sys 0.006s
W20260709 12:25:38.259564 12558 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.007s	sys 0.006s
I20260709 12:25:38.259434 16927 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:38.260406 16927 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.261617 16927 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.264268 12454 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 11, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.266499 12454 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.268081 12454 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:38.277658 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.279346 16755 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.279929 16755 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.282032 16755 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.282532 16755 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.283004 16755 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.285065 16755 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.287751 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.288465 12556 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:38.290097 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.292289 12556 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:38.292883 12703 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:38.245203 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.294031 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:38.294410 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49270us
I20260709 12:25:38.295097 16917 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:38.296550 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 232328us
I20260709 12:25:38.296880 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.297497 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.297636 17080 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:38.298952 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.299017 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.321543 12556 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:25:38.300390 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:38.303300 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:38.304801 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2575) took 1483 ms. Trace:
I20260709 12:25:38.309392 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.310608 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.311059 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:38.312711 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.316392 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.296774 16917 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:38.334856 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.335999 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.338964 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:38.340745 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.341265 17056 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:38.346063 17056 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:38.346571 17056 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:38.352293 12674 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.000s	sys 0.014s
I20260709 12:25:38.322546 12630 rpcz_store.cc:276] 0709 12:25:36.820968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:36.821076 (+   108us) service_pool.cc:224] Handling call
0709 12:25:36.826099 (+  5023us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:36.866180 (+ 40081us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:36.866215 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:36.873888 (+  7673us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.158202 (+284314us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:37.158261 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.302300 (+1144039us) spinlock_profiling.cc:243] Waited 39.9 ms on lock 0x7b5400343fd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.302357 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:38.302416 (+    59us) raft_consensus.cc:1685] finished
0709 12:25:38.302431 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.304734 (+  2303us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":91681536,"thread_start_us":266356,"threads_started":1,"wal-append.queue_time_us":503842}
I20260709 12:25:38.342451 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:38.353024 12674 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.000s	sys 0.014s
I20260709 12:25:38.344465 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:38.341436 16755 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:38.353797 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 562114us
I20260709 12:25:38.354461 12558 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:38.351682 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 477812us
I20260709 12:25:38.355365 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.356594 12522 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.359223 17079 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.364532 12597 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:38.366698 12522 leader_election.cc:400] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10.
I20260709 12:25:38.367027 12522 leader_election.cc:403] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:38.337688 16917 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.337606 16989 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:38.334000 16812 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:38.381443 16812 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.382730 16812 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.372390 12557 pending_rounds.cc:85] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 5
I20260709 12:25:38.384537 12674 leader_election.cc:400] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:25:38.384542 12557 pending_rounds.cc:107] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:38.386588 12557 raft_consensus.cc:2889] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:38.386888 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.385876 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.387655 12704 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.373098 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.375030 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.341147 16970 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.378180 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.388898 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.355710 17073 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.389616 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.390594 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.356120 16708 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.394773 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.339934 16993 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:25:38.397610 12704 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:38.369514 16652 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.372924 17037 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 9. Current term is 10.
I20260709 12:25:38.402096 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.400934 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.379374 16989 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.408226 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.407032 12707 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:38.387933 16982 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.410395 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.410652 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.411278 12631 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.411399 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.412791 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.373267 17076 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.413491 12706 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:38.401803 17051 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:38.374233 16792 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:25:38.392383 16970 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.398043 17057 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.415385 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.404651 16994 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.417510 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.417760 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.430907 13235 raft_consensus.cc:2393] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:38.418263 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.418437 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.418874 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.419217 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.404570 16842 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:25:38.419524 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.404570 16927 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.420207 17064 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.422565 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.426329 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36566 (request call id 1111) took 1122 ms. Trace:
I20260709 12:25:38.427297 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.439599 12632 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:38.431897 13233 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:38.436429 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.411929 16989 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.439522 12559 rpcz_store.cc:276] 0709 12:25:37.304255 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.309778 (+  5523us) service_pool.cc:224] Handling call
0709 12:25:38.426168 (+1116390us) spinlock_profiling.cc:243] Waited 382 ms on lock 0x7b5400373a54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:38.426272 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":878340992}
I20260709 12:25:38.402248 17080 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 12:25:38.444219 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 57410us
I20260709 12:25:38.392246 17015 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:25:38.444756 12522 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:38.416411 16522 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.417047 17054 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.453296 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.454432 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.413950 17085 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.430102 16970 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.416846 17051 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:38.429569 16856 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:38.460597 12632 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:38.443764 17076 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:38.466167 16971 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:38.461190 17037 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:38.471082 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.479023 12631 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:38.453281 16994 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:38.482417 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:25:38.489333 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.490952 17055 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:38.491111 16975 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:38.499459 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 45065.7us
I20260709 12:25:38.459084 17054 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:38.492264 16961 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:38.493117 13230 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 981) took 1459 ms. Trace:
I20260709 12:25:38.504273 13230 rpcz_store.cc:276] 0709 12:25:37.033548 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.033739 (+   191us) service_pool.cc:224] Handling call
0709 12:25:37.041678 (+  7939us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.320669 (+278991us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.492914 (+1172245us) spinlock_profiling.cc:243] Waited 278 ms on lock 0x7b54006beed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.493064 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":640206080}
I20260709 12:25:38.463078 17057 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:38.489101 16898 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.437879 17052 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:38.468389 17051 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.469394 16982 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.477494 16971 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.474249 17076 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:38.482417 17037 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:38.514858 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 43844.7us
I20260709 12:25:38.482082 16856 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.530706 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.501430 16975 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.502300 17080 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:38.537110 17081 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:25:38.469120 17085 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.503865 17054 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.543705 16856 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.534762 16982 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.504115 16961 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:38.516776 17029 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.530426 17076 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.529953 16842 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:25:38.551745 16970 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.532130 17037 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.560667 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:38.610646 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.564280 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.553316 16927 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.532514 17052 consensus_queue.cc:1243] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer a2a8d71f644447218c1afc3e5f7716cd log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:38.619028 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.620844 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:38.623214 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62617.5us
I20260709 12:25:38.627682 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.630594 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.570389 17029 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:38.633630 17029 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.633723 16970 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.630015 16522 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:38.634420 16522 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.635306 16522 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.636358 16522 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.638687 16917 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.640568 16917 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.643918 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.627545 17052 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.628050 17096 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:38.648524 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.651494 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.652058 12703 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.654086 16961 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.655259 16982 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.655369 16961 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.626963 16971 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.662084 16971 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.663020 12707 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:38.654093 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.664253 12707 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:38.664414 16927 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.664640 12707 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:38.664881 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.665516 17052 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.666199 17052 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:38.666383 17093 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.097s	user 0.000s	sys 0.001s
I20260709 12:25:38.666460 17030 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:38.667078 17030 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.670064 17085 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.668159 17096 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:38.674203 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.674162 17096 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.648622 17056 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.678664 16989 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:38.680789 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 56845.4us
I20260709 12:25:38.681815 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.682469 12699 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:38.682680 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.669100 17030 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.690150 12552 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260709 12:25:38.690940 16975 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.691442 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.692027 12552 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.691128 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.693712 12558 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:38.694111 12551 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: [6.8-9.10]
W20260709 12:25:38.694859 17091 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.197s	user 0.001s	sys 0.000s
I20260709 12:25:38.693583 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.695179 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.696120 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.696321 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.698041 12554 raft_consensus.cc:1240] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:38.694764 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.699992 12554 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:38.668249 12707 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.702664 12554 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:38.705493 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.706338 12700 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.709910 12558 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:38.712131 12707 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.713704 12552 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:38.672895 17076 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.720350 12557 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:38.720767 12699 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:38.727231 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.727766 12699 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.681195 16989 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.726138 12558 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:38.706521 17056 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:38.751830 17068 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.772s	user 0.006s	sys 0.000s
I20260709 12:25:38.755034 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.756347 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.756560 17076 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.759359 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1136) took 1139 ms. Trace:
I20260709 12:25:38.759800 12628 rpcz_store.cc:276] 0709 12:25:37.620390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.653581 (+ 33191us) service_pool.cc:224] Handling call
0709 12:25:37.669130 (+ 15549us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.766575 (+ 97445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.766628 (+    53us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:37.766694 (+    66us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:37.766746 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.759122 (+992376us) spinlock_profiling.cc:243] Waited 97.2 ms on lock 0x7b5400455454. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.759169 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.759299 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223493376}
I20260709 12:25:38.773281 17037 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.776281 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:38.777236 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:38.777916 13232 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.731194 16975 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.782541 16746 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:38.783202 17041 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:38.783538 16522 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:38.783711 17041 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:38.784058 16522 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.784178 13234 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:38.784935 16522 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.786173 16522 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.786707 13234 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:38.786820 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 953) took 1167 ms. Trace:
I20260709 12:25:38.787381 17029 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.787803 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.789793 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.790786 16708 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:38.791574 16708 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:38.792050 16708 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:38.792750 16708 consensus_queue.cc:1243] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:25:38.792855 16877 consensus_queue.cc:1059] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:38.793829 17046 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:38.794170 17046 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:38.794997 17046 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.796123 17046 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.796705 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.798738 16881 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.800576 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 956) took 1180 ms. Trace:
I20260709 12:25:38.801112 12702 rpcz_store.cc:276] 0709 12:25:37.620245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.621824 (+  1579us) service_pool.cc:224] Handling call
0709 12:25:37.622083 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.915668 (+293585us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.915703 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:37.915749 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:37.915797 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.800282 (+884485us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54003ebcd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.800346 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.800504 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":674718080}
I20260709 12:25:38.804945 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2241) took 1677 ms. Trace:
I20260709 12:25:38.805317 12633 rpcz_store.cc:276] 0709 12:25:37.127915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.128066 (+   151us) service_pool.cc:224] Handling call
0709 12:25:37.128448 (+   382us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:37.697674 (+569226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.804722 (+1107048us) spinlock_profiling.cc:243] Waited 554 ms on lock 0x7b5400343ad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.804893 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1274990464}
I20260709 12:25:38.805789 12708 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.808125 13232 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:25:38.793252 16708 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:38.808908 13233 raft_consensus.cc:1240] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:38.809309 16708 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:38.810022 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.810207 16708 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.810753 12701 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:38.812001 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.813098 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.787282 12705 rpcz_store.cc:276] 0709 12:25:37.619271 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.619417 (+   146us) service_pool.cc:224] Handling call
0709 12:25:37.619709 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.914534 (+294825us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.914604 (+    70us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:37.914651 (+    47us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:37.914689 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:38.786591 (+871902us) spinlock_profiling.cc:243] Waited 295 ms on lock 0x7b54001fa9d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:38.786636 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:38.786762 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":677597440}
I20260709 12:25:38.814443 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.814836 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.815742 12701 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.815894 12705 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:38.784760 17041 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.819280 17041 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.819473 17034 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:38.819969 17034 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:38.820801 17034 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.822065 12554 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:38.822256 17034 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.823649 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.824826 16755 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.824879 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.825634 12559 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.825515 16755 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.825738 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:38.826503 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.827126 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.827690 16755 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.828058 13233 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:38.828859 13233 raft_consensus.cc:606] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.831048 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.831969 16969 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:38.832821 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:38.834805 17073 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:38.835021 12633 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:38.835259 17073 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.839686 13230 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:38.828110 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.833015 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.843842 12559 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:25:38.844758 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.845712 12522 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:38.804796 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.846611 12702 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:38.847208 12706 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:38.841841 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:38.857594 12554 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:38.765894 17054 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.858704 12700 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:38.858747 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:38.860250 12699 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:38.853156 12708 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:38.864310 12705 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:38.860930 12703 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:38.864717 13232 raft_consensus.cc:1240] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:38.867142 12707 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:38.867735 12523 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.772292 17051 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:38.871030 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.877535 12554 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:38.880180 12523 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.864127 16969 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.885075 12523 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:38.886593 12700 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:38.896644 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.898233 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.899673 12554 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:38.900802 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.900954 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.901376 12557 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:38.901602 12625 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.898754 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.902935 12557 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:38.867206 17076 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:38.908042 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:38.908049 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:38.904093 12556 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:38.863727 16569 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.870043 16755 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:38.909754 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:38.917932 12707 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:38.879017 17029 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.877061 16982 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:38.914391 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.900873 16970 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:38.915232 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.887298 17053 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.895430 16708 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:38.914937 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.869860 16989 consensus_queue.cc:1059] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:38.932549 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:38.937988 13233 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.941215 12625 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:38.935853 16755 raft_consensus.cc:697] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:38.942366 17099 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:38.949734 12702 raft_consensus.cc:2468] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:38.950357 16755 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.917057 16994 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.945169 17074 consensus_queue.cc:1059] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:25:38.951526 16970 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:38.884686 16993 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.036s
W20260709 12:25:38.964651 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:38.908862 17076 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:38.952715 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.970041 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.970151 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.923720 17042 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:38.952515 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.953135 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:38.953894 17057 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.924993 17037 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:38.924723 16982 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.958523 17054 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:38.930449 16569 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.963536 17074 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:38.909667 16969 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:38.944603 17030 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.968462 12700 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 13. Current term is 14. Ops: []
W20260709 12:25:38.980670 16841 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.969s	user 0.008s	sys 0.018s
I20260709 12:25:38.989852 12700 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:38.990849 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:38.991161 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:38.968582 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 45488.5us
I20260709 12:25:38.950947 16989 raft_consensus.cc:3055] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:38.975973 17042 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:38.970422 12702 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:38.949133 13201 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:38.947431 12704 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:38.975004 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.978457 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.985018 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:38.971405 17029 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:38.975639 17076 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:38.979456 17055 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:38.982009 16982 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:25:38.989285 16841 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.008s	sys 0.018s
W20260709 12:25:39.035982 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.037815 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45073.1us
I20260709 12:25:39.039737 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:38.985772 17074 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:39.036731 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 87690.8us
I20260709 12:25:39.045922 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:39.042012 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.050982 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.051846 12705 raft_consensus.cc:2376] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10. Re-sending same reply.
I20260709 12:25:38.993294 16989 raft_consensus.cc:740] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:39.039507 13199 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:39.055379 17105 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:25:39.055069 16569 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.060981 16841 raft_consensus.cc:993] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:39.060674 17011 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:38.964704 16970 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.063315 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.047737 17029 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:38.981307 17057 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.043722 16968 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:39.038203 17055 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.255780 17073 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.256376 17055 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.257053 16746 raft_consensus.cc:1081] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:39.243032 16842 raft_consensus.cc:2804] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:39.258992 16842 raft_consensus.cc:697] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:39.259824 17073 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:39.260001 16842 consensus_queue.cc:237] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.261546 16968 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:39.262590 16968 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:39.143600 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 104151us
I20260709 12:25:39.267486 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:39.269318 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:39.226188 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 180401us
I20260709 12:25:39.226302 12699 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:39.001892 17099 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:38.993083 16949 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260709 12:25:39.235039 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:39.052770 17091 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.063s	user 0.007s	sys 0.000s
W20260709 12:25:39.236954 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 200501us
I20260709 12:25:39.293576 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2297) took 1628 ms. Trace:
I20260709 12:25:39.239991 13233 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:39.293772 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:39.294035 12550 rpcz_store.cc:276] 0709 12:25:37.665012 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.669528 (+  4516us) service_pool.cc:224] Handling call
0709 12:25:37.669781 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.842937 (+173156us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:37.865865 (+ 22928us) log.cc:844] Serialized 14 byte log entry
0709 12:25:38.804344 (+938479us) spinlock_profiling.cc:243] Waited 6.38 ms on lock 0x7b180043e4c0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:25:38.942337 (+137993us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b180043e4c0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fb455 00007f0e984e33c7 00007f0e94af59a7 00007f0e94b050bf 00007f0e94b05038
0709 12:25:39.243579 (+301242us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.283187 (+ 39608us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.283248 (+    61us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:39.293305 (+ 10057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.293373 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:39.293522 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39331,"prepare.queue_time_us":46368,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":3236,"raft.queue_time_us":213386,"raft.run_cpu_time_us":231,"raft.run_wall_time_us":13755,"spinlock_wait_cycles":24766208,"thread_start_us":569342,"threads_started":3,"wal-append.queue_time_us":1105960}
I20260709 12:25:39.295274 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:39.296361 12555 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:39.251242 17074 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.251538 17029 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.253161 16969 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:39.247924 17107 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.203s	user 0.003s	sys 0.004s
I20260709 12:25:39.254081 17057 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:39.269104 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.272375 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:39.234803 16919 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:39.278894 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:39.270026 13229 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:39.271579 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.237861 16986 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.292728 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.315953 12702 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:39.316972 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.318881 12702 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:39.319404 12702 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.319846 12702 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:39.237532 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.322546 16986 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.323369 12627 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:39.315160 16209 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:39.302871 16927 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:39.325829 16927 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.326258 16927 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:39.326720 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.328133 16856 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.298838 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:39.300310 13230 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:39.293175 17097 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:39.303242 16817 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:39.314208 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 11 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.312633 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:39.290366 16792 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:39.356144 12553 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:39.334308 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:39.303503 17080 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:39.329138 17074 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:39.364234 12551 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:39.364970 12557 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:39.366856 12704 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:39.370824 12553 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:39.336684 16479 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.377154 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:39.380568 12631 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:39.387120 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.389914 17100 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:39.390978 17015 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.331984 17057 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.355198 17037 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:39.392792 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:39.395273 12702 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.371235 17096 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:39.418808 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 66399.3us
I20260709 12:25:39.363116 16946 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 12:25:39.362910 17055 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:39.421073 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 49483.6us
I20260709 12:25:39.308073 16989 consensus_queue.cc:260] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.397811 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:39.442972 12625 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:39.397348 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:39.391773 17114 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.421504 12558 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:39.348575 16969 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:39.348657 16755 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.432602 12674 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:39.434166 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:39.336100 16917 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:25:39.398444 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:39.459256 12702 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.430671 17041 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.464323 13232 raft_consensus.cc:1240] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:39.421144 17037 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.468719 12630 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 10: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:39.392326 17032 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:25:39.380126 16997 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 12:25:39.365198 17085 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.073s
I20260709 12:25:39.457173 16817 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.480958 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:39.447984 17073 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.447795 17036 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:39.488375 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:39.490417 13230 raft_consensus.cc:606] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:39.439976 16950 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:25:39.435329 17057 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.476907 17037 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:39.473366 17080 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.380374 17099 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.461041 16969 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.456673 17055 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.490944 17046 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:39.479790 16479 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:39.466428 16755 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.474253 16982 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.503633 17054 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.492214 17073 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.494858 17041 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:25:39.441375 17096 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.492980 17036 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.463634 17114 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.517539 17046 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:39.537515 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:39.538429 13229 raft_consensus.cc:606] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:39.556814 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 169783us
I20260709 12:25:39.557950 12598 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.562664 12701 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:39.568262 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 82256.1us
I20260709 12:25:39.562652 12598 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:39.573587 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.573208 12598 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.524000 17054 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.565482 17085 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:39.578199 16993 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.598263 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:39.598951 13229 raft_consensus.cc:606] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.599313 13229 raft_consensus.cc:614] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:39.600371 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.567229 17032 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.025s
W20260709 12:25:39.601358 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 202558us
I20260709 12:25:39.604224 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.607611 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.610891 16970 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.614094 12704 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:39.613991 16970 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:39.622061 17119 log.cc:927] Time spent T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 12:25:39.625340 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:39.625880 17118 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:25:39.593284 17075 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:25:39.593478 16997 consensus_queue.cc:1059] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.046s
I20260709 12:25:39.626580 12706 raft_consensus.cc:2393] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:39.638320 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
W20260709 12:25:39.657806 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52947.8us
I20260709 12:25:39.656718 13229 raft_consensus.cc:606] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.675447 17096 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.675882 17032 raft_consensus.cc:3055] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:39.676268 17096 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.676331 17032 raft_consensus.cc:740] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:39.675614 17046 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.676875 17096 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.677351 17032 consensus_queue.cc:260] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:39.628918 17122 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:25:39.678669 17032 raft_consensus.cc:3060] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:39.679257 17096 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:39.614121 17121 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:25:39.643191 17120 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.123s	user 0.001s	sys 0.001s
W20260709 12:25:39.667140 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 66833.6us
W20260709 12:25:39.642030 17030 consensus_meta.cc:287] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.643s	user 0.011s	sys 0.000s
I20260709 12:25:39.605799 17126 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:39.685180 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:39.675549 17125 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
W20260709 12:25:39.637251 17076 consensus_meta.cc:287] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.600s	user 0.011s	sys 0.000s
I20260709 12:25:39.685990 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:39.685665 12598 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.642402 16982 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:39.700052 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:39.638036 16969 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:39.679977 16993 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:39.675513 17057 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.705027 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.712455 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.719791 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.721954 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.722693 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.722878 13234 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:39.726892 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.733814 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.687362 16997 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:39.736137 16997 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:39.736724 16997 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:39.721706 17129 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:39.703728 17085 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:39.718713 16982 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.704015 17076 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.762096 17054 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.762172 16856 raft_consensus.cc:993] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:25:39.713393 17124 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.770088 16522 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 12:25:39.768849 16969 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.778249 17042 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.780290 16927 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.751084 16993 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:25:39.787453 12555 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2421) took 1103 ms. Trace:
I20260709 12:25:39.794137 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.794013 12555 rpcz_store.cc:276] 0709 12:25:38.684224 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.689132 (+  4908us) service_pool.cc:224] Handling call
0709 12:25:39.296175 (+607043us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.296789 (+   614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.787169 (+490380us) spinlock_profiling.cc:243] Waited 607 ms on lock 0x7b5400372b50. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:39.787373 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1395209600}
I20260709 12:25:39.790346 16856 raft_consensus.cc:1081] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:25:39.775938 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:39.797499 17135 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:25:39.797550 17054 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:39.798164 17054 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.798614 17054 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:39.798914 17114 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.796020 16969 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.802932 17036 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:39.803378 16969 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.756201 16997 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:39.815702 12555 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:36566
W20260709 12:25:39.824863 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49058.6us
I20260709 12:25:39.859282 12555 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.859990 12555 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:39.807562 17042 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:39.879467 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 154352us
W20260709 12:25:39.884330 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 163304us
I20260709 12:25:39.889251 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:39.889599 13233 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:39.873859 12555 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.893314 12598 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:39.894855 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.894901 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.899235 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.899555 13230 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:39.888880 16817 consensus_queue.cc:1059] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:25:39.906859 16817 raft_consensus.cc:3055] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:39.907213 16817 raft_consensus.cc:740] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:39.908110 16817 consensus_queue.cc:260] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.885020 16877 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:25:39.892725 17124 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:39.916119 17076 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:39.916877 17114 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:25:39.900530 17095 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.919389 17095 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.920562 17051 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:39.898759 16982 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:25:39.922482 17080 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:39.923030 17080 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:39.890226 17029 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.012s	sys 0.022s
I20260709 12:25:39.931296 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.933439 12707 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:39.937707 12555 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.938947 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.940711 12707 raft_consensus.cc:2410] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:39.942512 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.945755 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.946630 12701 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:39.950503 12558 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:39.955714 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.957690 12707 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
W20260709 12:25:39.933861 17029 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.012s	sys 0.022s
I20260709 12:25:39.965646 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.968765 12707 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:39.936254 16817 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:39.972496 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 79246us
I20260709 12:25:39.972601 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:39.932106 17032 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.974417 13233 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:39.979771 13233 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:39.976650 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:39.952692 16919 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:39.970709 16976 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:39.977903 16927 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:39.983174 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:39.965574 17074 consensus_meta.cc:287] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.574s	user 0.011s	sys 0.001s
I20260709 12:25:39.999965 12626 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:40.008273 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.009733 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:39.987221 12707 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:39.989161 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:39.964102 16969 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:39.990731 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:39.991235 16919 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.980968 13233 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:39.993577 12553 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:40.028993 12523 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:40.178473 13233 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:40.108188 17123 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.539s	user 0.004s	sys 0.000s
I20260709 12:25:40.080665 12700 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:39.941249 16783 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.053s
I20260709 12:25:40.087083 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:25:40.084153 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.025029 17095 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.184952 12704 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.196506 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:40.197340 12629 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.019104 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:39.939927 17114 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:40.011466 17080 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.025777 17073 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.154564 16986 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.180876 16969 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.119776 12705 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:40.214074 17080 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.215384 16969 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:40.216472 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 197488us
I20260709 12:25:40.216558 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.045035 12631 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:40.030339 17134 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:40.034618 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 140729us
W20260709 12:25:40.140326 17133 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:25:40.058733 16950 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
W20260709 12:25:40.111466 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.175508 17054 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.029707 17034 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:40.175053 13227 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:40.168236 17141 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260709 12:25:40.177336 12707 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:40.025276 17099 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:40.185967 16919 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:40.167042 16927 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.192072 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:40.188889 12625 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:40.189534 12553 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
W20260709 12:25:40.201121 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.190290 12633 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:40.189613 12626 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:40.200045 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:40.212080 16949 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:40.175884 17057 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.187263 17055 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.218976 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.220041 13233 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:40.217331 12628 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
W20260709 12:25:40.082281 17037 consensus_meta.cc:287] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.578s	user 0.005s	sys 0.015s
I20260709 12:25:40.258116 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:40.226907 13227 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:25:40.179248 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 150341us
I20260709 12:25:40.185820 17147 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:40.188274 17079 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:40.215394 16989 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.228729 12600 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:40.294088 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 65442.1us
I20260709 12:25:40.301697 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.303155 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.305711 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.182907 17096 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:40.224790 17074 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:40.184187 16209 consensus_queue.cc:1175] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "a2a8d71f644447218c1afc3e5f7716cd" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 12:25:40.242642 17075 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:40.242383 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:40.243501 16708 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:40.245653 17054 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.233096 17129 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:25:40.246937 16755 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.252839 17128 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.256827 12558 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:40.262050 17037 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.263017 16946 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.263381 16817 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.270861 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.346069 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.311004 17096 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:40.273952 17057 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.231649 17051 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.275518 12704 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:40.235415 17073 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.270113 13227 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.309396 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:40.229149 17030 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:25:40.226257 17148 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
W20260709 12:25:40.317894 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 75613.2us
I20260709 12:25:40.238855 16997 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:25:40.275915 17147 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:40.316726 16945 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:40.316965 16976 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.324445 16792 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.320565 17114 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:40.282971 17079 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:40.241906 16927 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.310398 17126 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:40.339870 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.344895 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.412988 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.366897 16817 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.357308 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.357308 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.336889 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.417253 12555 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
W20260709 12:25:40.361018 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 90226.2us
I20260709 12:25:40.418334 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:40.419203 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:40.225777 12629 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:40.338973 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.320101 16961 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:40.364289 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:40.454197 12632 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:40.455929 17140 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
I20260709 12:25:40.316007 16708 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:40.382891 13227 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.458455 17099 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:40.458168 16708 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.459007 17099 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:40.459300 16708 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.459173 16792 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:40.459538 17099 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:40.333146 17095 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:25:40.364185 17096 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.396925 16976 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.462262 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50978 (request call id 1137) took 1197 ms. Trace:
I20260709 12:25:40.462683 13232 rpcz_store.cc:276] 0709 12:25:39.265277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.265430 (+   153us) service_pool.cc:224] Handling call
0709 12:25:39.265742 (+   312us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.466085 (+200343us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.461973 (+995888us) spinlock_profiling.cc:243] Waited 198 ms on lock 0x7b54001b3854. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:40.462199 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":456236288}
I20260709 12:25:40.464082 16976 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.466224 17037 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.466733 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2240) took 1581 ms. Trace:
I20260709 12:25:40.467660 12708 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:25:40.468359 17057 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.346382 12707 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:40.391121 16945 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.469220 16945 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.469725 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45130 (request call id 2255) took 1406 ms. Trace:
I20260709 12:25:40.470130 12705 rpcz_store.cc:276] 0709 12:25:39.062954 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.063085 (+   131us) service_pool.cc:224] Handling call
0709 12:25:40.469576 (+1406491us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b54002a1054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:40.469671 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1804667776}
I20260709 12:25:40.470626 17147 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.471853 17147 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.472023 16961 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:40.472631 16961 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.383713 16755 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:40.473726 16755 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.474968 16961 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:40.475641 16755 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.421604 17055 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:40.411589 17126 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:40.422588 17152 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.112s	user 0.000s	sys 0.001s
W20260709 12:25:40.432236 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 190802us
I20260709 12:25:40.458173 16856 raft_consensus.cc:993] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:25:40.447377 17134 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:40.448899 16970 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.386256 17073 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.458597 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.468456 16927 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.496421 17126 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.416139 12630 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:40.477479 16817 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:40.413009 17129 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:40.401753 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:40.363426 16946 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.392599 12600 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.358961 17128 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.394122 16969 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:40.396747 17114 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.548398 17114 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.549121 12704 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:40.539391 16970 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.467190 12703 rpcz_store.cc:276] 0709 12:25:38.885286 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:38.887717 (+  2431us) service_pool.cc:224] Handling call
0709 12:25:38.887956 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:39.242759 (+354803us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:39.243570 (+   811us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:39.243638 (+    68us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:39.243680 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.177292 (+933612us) spinlock_profiling.cc:243] Waited 3.54 ms on lock 0x7b18002aad20. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919cc2a6 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419
0709 12:25:40.466484 (+289192us) spinlock_profiling.cc:243] Waited 238 ms on lock 0x7b5400129654. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:40.466540 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:40.466674 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8426,"raft.queue_time_us":9944,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":1792,"spinlock_wait_cycles":555183232}
I20260709 12:25:40.492462 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.559185 17099 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.525962 16209 raft_consensus.cc:1081] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:25:40.561721 16479 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:40.562175 16479 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:40.563202 16479 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.565552 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.566660 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:40.568849 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 176301us
I20260709 12:25:40.381776 17051 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.434561 12700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2258) took 1193 ms. Trace:
I20260709 12:25:40.498965 12632 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 5.
I20260709 12:25:40.499096 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.499367 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.571520 12629 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:40.499740 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.394794 17074 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:25:40.500984 12705 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.502437 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:40.574589 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 72252.4us
I20260709 12:25:40.491380 17055 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.532099 13227 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:40.471073 12707 raft_consensus.cc:1275] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:40.502252 17134 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:40.537163 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 51640.4us
I20260709 12:25:40.541915 16927 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:40.542726 16856 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:40.561264 17099 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.546754 17073 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.547237 17128 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.547693 16969 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:40.572811 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.569769 12700 rpcz_store.cc:276] 0709 12:25:39.240998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.241122 (+   124us) service_pool.cc:224] Handling call
0709 12:25:39.241611 (+   489us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.183720 (+942109us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.434311 (+250591us) spinlock_profiling.cc:243] Waited 837 ms on lock 0x7b54000d02d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:40.434486 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1925883136}
I20260709 12:25:40.502050 17042 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:40.535782 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 77257.4us
I20260709 12:25:40.580621 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:40.613291 16997 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:40.583055 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:40.545653 16946 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:40.632419 12699 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:25:40.616518 17055 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.573541 17147 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:40.641913 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.676788 12550 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:40.574602 17054 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:40.648666 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 68130.6us
I20260709 12:25:40.590363 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.564474 16479 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:40.643139 17139 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
W20260709 12:25:40.674204 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 173800us
I20260709 12:25:40.680823 12555 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:40.714179 17029 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:40.715402 17011 consensus_queue.cc:1048] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:40.716317 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.717729 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.675946 17037 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:40.680207 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:40.743650 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 63525.9us
I20260709 12:25:40.574134 17129 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.685253 17159 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:40.671967 17138 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:40.674757 17042 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.692670 12552 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.695062 17055 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.754669 17138 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.755185 17138 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.755997 17159 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.756382 17055 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.758147 17159 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.758843 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:40.760130 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.673659 17057 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.698634 17010 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:25:40.700294 12631 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:40.703024 17051 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.788179 17138 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.790359 12626 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:40.705626 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.467198 17079 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.717219 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:40.720323 12555 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.706853 16982 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.721892 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.726807 16969 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.739063 17096 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.685951 16997 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:40.753611 12632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:25:40.814368 12632 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:40.814755 12632 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:40.724808 16945 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.763399 17042 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.718258 17074 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.762548 16976 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:40.774580 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:40.783574 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:40.703862 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 400783us
I20260709 12:25:40.827462 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.797924 12555 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:40.834571 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.836006 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:40.813377 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.764514 17037 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:40.857558 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 83106.5us
I20260709 12:25:40.858281 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:40.858431 12556 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:40.860646 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.862901 12702 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.873945 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.873967 13227 raft_consensus.cc:2368] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12.
I20260709 12:25:40.682545 17134 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.878738 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:40.891039 12702 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:40.891992 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:40.893385 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:40.894697 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:40.856487 17074 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.880167 17037 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.880584 17080 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:40.883194 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:40.884881 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:40.963222 12699 raft_consensus.cc:2393] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:40.885849 17158 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:40.886447 16817 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:40.887487 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:40.873293 16969 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:40.888907 17039 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:40.896591 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:40.826543 16976 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.899809 16989 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.938476 12551 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:40.949106 12555 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:40.877967 17154 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
W20260709 12:25:40.964078 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 87878.5us
I20260709 12:25:40.818732 17061 consensus_queue.cc:1059] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:25:41.000912 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:41.002009 12701 raft_consensus.cc:2393] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:41.003008 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:40.971510 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:41.005908 12699 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:40.867612 17114 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:40.899459 16961 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:40.974370 17074 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:40.975473 17096 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.867282 16949 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:40.976913 16945 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:40.893143 16881 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:40.902510 17095 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.977692 17138 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:40.913714 16927 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.980201 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:40.888309 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 104821us
I20260709 12:25:40.983248 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:40.985045 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:41.043025 12631 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.988613 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:40.802479 17057 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.899163 17042 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:40.997800 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:41.055821 12702 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.928129 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:40.808143 16982 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.877563 17124 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.114s
I20260709 12:25:40.962250 17080 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:41.021801 17129 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:40.972043 17075 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:41.006759 12701 raft_consensus.cc:2410] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 15 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:25:40.968943 17158 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:40.825531 12632 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:40.990670 17039 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.998461 16976 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:41.036335 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 141707us
I20260709 12:25:41.036868 12550 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:40.991699 16817 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:41.058291 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 69762.3us
I20260709 12:25:41.150511 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:41.074934 12708 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:41.082804 12702 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:40.822906 13232 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:41.004897 16989 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:41.102020 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 102935us
I20260709 12:25:41.153921 12632 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.069804 16881 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:41.031662 17074 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 12:25:41.124994 17148 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.130748 17158 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:41.133554 17039 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:41.070219 17095 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:41.086388 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 151109us
I20260709 12:25:41.155359 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:41.157749 12702 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: [9.7-9.7]
I20260709 12:25:41.124696 17029 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.000810 16997 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.148281 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:41.037269 16949 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.086668 17042 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.157045 17169 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:41.162889 17126 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.588s	user 0.003s	sys 0.007s
I20260709 12:25:41.197721 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:41.172636 17148 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:41.211764 12522 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:41.213457 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:41.215221 12556 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.078395 17096 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.174727 16708 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
W20260709 12:25:41.204172 17178 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
W20260709 12:25:41.204993 17184 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:25:41.205824 17177 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260709 12:25:41.211756 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:41.199543 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 51345.6us
I20260709 12:25:41.209760 17126 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.218360 17129 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:41.219112 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:41.198705 16969 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:41.205629 17193 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:41.221515 12553 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:41.222064 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.222934 17057 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.224354 16989 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.231482 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:41.231750 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.232748 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.284948 12626 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:41.232748 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:41.239765 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.237162 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:41.285658 12550 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:41.241842 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.247702 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:41.287017 12556 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:41.287927 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:41.254190 12551 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.260893 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.261921 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.225675 16970 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:41.201351 17029 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.309502 12625 raft_consensus.cc:1240] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260709 12:25:41.254130 17192 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.242046 17010 consensus_queue.cc:1059] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:25:41.184119 17080 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.240650 16755 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:41.313163 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.295365 12632 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 10: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:41.254737 17128 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:41.319399 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.326646 12629 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:41.260736 17041 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:41.321760 12631 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:41.257915 17174 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.258280 16961 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.291101 17168 log.cc:927] Time spent T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.284s	user 0.001s	sys 0.000s
I20260709 12:25:41.242687 17073 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.075s
I20260709 12:25:41.332279 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.359653 12551 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:25:41.249076 17138 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.071s
I20260709 12:25:41.329166 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.310551 17189 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:41.313962 17057 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:41.327555 17114 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:41.318998 17075 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.433561 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 145674us
I20260709 12:25:41.422729 12631 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:41.317917 17096 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.100s
I20260709 12:25:41.351289 17080 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:41.437830 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:41.426764 17152 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:41.326996 16856 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.098s
I20260709 12:25:41.305085 16881 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.349707 16961 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:41.451257 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.454921 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:41.447465 16479 consensus_meta.cc:287] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.761s	user 0.010s	sys 0.000s
I20260709 12:25:41.348573 17041 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.462332 17041 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.457614 16970 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:41.460143 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:41.368535 16755 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:41.316958 17148 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.346748 17128 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.459780 17114 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.463869 16970 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.481041 17041 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:41.436969 17075 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.346670 17174 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.423794 17189 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.471441 16817 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.472043 16479 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:41.494678 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:41.482084 17188 log.cc:927] Time spent T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260709 12:25:41.492417 17041 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.490353 16755 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:41.505968 17197 log.cc:927] Time spent T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:25:41.495872 17095 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.556550 16961 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.560576 17075 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:41.565723 17171 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.781s	user 0.002s	sys 0.012s
I20260709 12:25:41.568641 12550 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:41.569703 12557 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2331) took 1264 ms. Trace:
W20260709 12:25:41.570592 17163 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.312s	user 0.000s	sys 0.001s
I20260709 12:25:41.571002 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2334) took 1234 ms. Trace:
I20260709 12:25:41.570099 12557 rpcz_store.cc:276] 0709 12:25:40.304835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.304969 (+   134us) service_pool.cc:224] Handling call
0709 12:25:40.310002 (+  5033us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.408394 (+ 98392us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:40.408438 (+    44us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.409014 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.668653 (+259639us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:40.668714 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.899432 (+230718us) spinlock_profiling.cc:243] Waited 80.6 ms on lock 0x7b540035f054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:40.899482 (+    50us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.565145 (+665663us) spinlock_profiling.cc:243] Waited 5.67 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:41.569481 (+  4336us) raft_consensus.cc:1685] finished
0709 12:25:41.569502 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.569647 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17283,"raft.queue_time_us":21684,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":54706,"spinlock_wait_cycles":198495360,"thread_start_us":259225,"threads_started":1,"wal-append.queue_time_us":375780}
I20260709 12:25:41.571604 12558 rpcz_store.cc:276] 0709 12:25:40.336104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.336236 (+   132us) service_pool.cc:224] Handling call
0709 12:25:40.336523 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.547481 (+210958us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.547511 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.547984 (+   473us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.770482 (+222498us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:41.150790 (+380308us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.151099 (+   309us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.570566 (+419467us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b540018a454. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:41.570617 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.570664 (+    47us) raft_consensus.cc:1685] finished
0709 12:25:41.570772 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.570923 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":359051,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":1171,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":8921,"spinlock_wait_cycles":484392320,"thread_start_us":559293,"threads_started":2,"wal-append.queue_time_us":352506}
I20260709 12:25:41.574030 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:41.575398 17128 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.577751 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:41.581784 17010 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:41.582232 17189 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.582482 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.583024 17029 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.583688 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.584738 17174 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.584849 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.586333 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:41.587003 13227 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:41.579082 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:41.588021 12600 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:41.589463 17137 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:41.589859 12627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.024s	user 0.006s	sys 0.011s
W20260709 12:25:41.590196 12627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.025s	user 0.007s	sys 0.011s
I20260709 12:25:41.590281 17075 consensus_queue.cc:1059] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:41.590866 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1190) took 1112 ms. Trace:
I20260709 12:25:41.591076 17075 raft_consensus.cc:3055] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:41.591492 17075 raft_consensus.cc:740] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:41.592860 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:41.582268 17010 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:41.593518 12704 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:41.594563 17010 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.594578 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:41.597741 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.580343 16755 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.598433 12625 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:41.599915 12625 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:41.591223 12627 rpcz_store.cc:276] 0709 12:25:40.478899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.489838 (+ 10939us) service_pool.cc:224] Handling call
0709 12:25:40.490162 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.490547 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.490586 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.498735 (+  8149us) log.cc:844] Serialized 26 byte log entry
0709 12:25:41.590537 (+1091802us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:41.590577 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.590640 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.590694 (+    54us) raft_consensus.cc:1685] finished
0709 12:25:41.590705 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.590812 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2129,"raft.queue_time_us":4822,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":90,"thread_start_us":1024873,"threads_started":1,"wal-append.queue_time_us":540243}
I20260709 12:25:41.605020 12626 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:41.542840 17126 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:41.608085 12627 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:25:41.495985 17114 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.552776 17041 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:41.615684 16982 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.618811 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:41.580096 17162 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:41.623536 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.631594 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:41.632623 17174 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:41.606559 17095 raft_consensus.cc:2804] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:41.639707 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 50924.3us
I20260709 12:25:41.640461 17137 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:41.634317 17162 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:41.639359 17189 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:41.592365 17075 consensus_queue.cc:260] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.579821 17039 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.644714 17174 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:41.663434 17209 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.668567 17189 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.681708 13232 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:41.644048 17158 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.677466 17174 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.674530 17095 raft_consensus.cc:697] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:41.686900 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.690893 17039 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:41.691471 17114 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.692097 17137 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.694124 17191 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:41.694656 17191 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.683027 17075 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.700214 12699 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:41.679939 16982 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.683413 17189 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.684506 17209 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.706656 17134 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:41.710314 17172 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.888s	user 0.000s	sys 0.015s
I20260709 12:25:41.718192 17147 raft_consensus.cc:3055] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:41.720271 17147 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:41.720351 17095 consensus_queue.cc:237] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.721320 17147 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.722826 17207 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:41.716112 16969 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.723583 17207 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:41.725891 17143 log.cc:927] Time spent T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.844s	user 0.009s	sys 0.012s
I20260709 12:25:41.727025 17191 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.695621 17162 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.728864 17207 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:41.729122 17162 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:41.730598 12559 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36566 (request call id 1138) took 1969 ms. Trace:
I20260709 12:25:41.730028 12454 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 8 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:41.731513 12454 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:41.730950 12559 rpcz_store.cc:276] 0709 12:25:39.761123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.762669 (+  1546us) service_pool.cc:224] Handling call
0709 12:25:39.763050 (+   381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:39.763465 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:39.763496 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:39.764078 (+   582us) log.cc:844] Serialized 52 byte log entry
0709 12:25:39.932689 (+168611us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:39.972710 (+ 40021us) log.cc:844] Serialized 14 byte log entry
0709 12:25:39.972921 (+   211us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:39.972996 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:40.194400 (+221404us) spinlock_profiling.cc:243] Waited 5.56 ms on lock 0x7b180049cae0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe522 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:40.881795 (+687395us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b180049cae0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:41.725285 (+843490us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:41.730335 (+  5050us) raft_consensus.cc:1685] finished
0709 12:25:41.730357 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.730488 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7059,"prepare.queue_time_us":39793,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":36,"raft.queue_time_us":17439,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":15623,"spinlock_wait_cycles":97690624,"thread_start_us":168218,"threads_started":1,"wal-append.queue_time_us":229257}
I20260709 12:25:40.670307 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:41.734560 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:41.735733 17042 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.711628 16982 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.739442 16982 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.742424 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2269) took 1657 ms. Trace:
I20260709 12:25:41.742784 12706 rpcz_store.cc:276] 0709 12:25:40.084887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.086667 (+  1780us) service_pool.cc:224] Handling call
0709 12:25:40.133951 (+ 47284us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:40.173148 (+ 39197us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.173196 (+    48us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:40.176022 (+  2826us) log.cc:844] Serialized 52 byte log entry
0709 12:25:40.437644 (+261622us) spinlock_profiling.cc:243] Waited 2.16 ms on lock 0x7b18002bed00. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b0d1 00007f0e94aa6a0f
0709 12:25:40.627138 (+189494us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:40.627178 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:40.627244 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.643035 (+1015791us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:41.742191 (+ 99156us) raft_consensus.cc:1685] finished
0709 12:25:41.742211 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.742368 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33642,"raft.queue_time_us":38775,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":2301,"spinlock_wait_cycles":14680192,"thread_start_us":189290,"threads_started":1,"wal-append.queue_time_us":565343}
I20260709 12:25:41.737640 16812 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.747619 16812 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:41.747749 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.748767 16812 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.750257 16812 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.749773 12454 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.755040 17042 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.755705 17042 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:41.757916 12453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 321) took 34206 ms (client timeout 15000 ms). Trace:
I20260709 12:25:41.725903 16969 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.758821 17079 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:41.751920 12454 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:41.758347 12453 rpcz_store.cc:269] 0709 12:25:07.551703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.551899 (+   196us) service_pool.cc:224] Handling call
0709 12:25:41.757814 (+34205915us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:33.411016 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:33.411733 (+   717us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:33.411811 (+    78us) write_op.cc:435] Acquired schema lock
0709 12:25:33.411835 (+    24us) tablet.cc:662] Decoding operations
0709 12:25:33.413078 (+  1243us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:33.413179 (+   101us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:33.413205 (+    26us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:25:33.414322 (+  1117us) tablet.cc:701] Row locks acquired
0709 12:25:33.414385 (+    63us) write_op.cc:260] PREPARE: finished
0709 12:25:33.414574 (+   189us) write_op.cc:270] Start()
0709 12:25:33.414677 (+   103us) write_op.cc:276] Timestamp: P: 1783599933414492 usec, L: 0
0709 12:25:33.414714 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:25:33.416282 (+  1568us) log.cc:844] Serialized 4351 byte log entry
0709 12:25:33.430402 (+ 14120us) op_driver.cc:464] REPLICATION: finished
0709 12:25:33.433118 (+  2716us) write_op.cc:301] APPLY: starting
0709 12:25:33.433223 (+   105us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:33.442229 (+  9006us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:33.442362 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:33.449276 (+  6914us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:33.449605 (+   329us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=0,mrs_lookups=0
0709 12:25:33.449647 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:33.450089 (+   442us) log.cc:844] Serialized 105 byte log entry
0709 12:25:33.450939 (+   850us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:33.451076 (+   137us) write_op.cc:454] Released schema lock
0709 12:25:33.451132 (+    56us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:33.451572 (+   440us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:33.451595 (+    23us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3376834,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":2460,"apply.run_cpu_time_us":17666,"apply.run_wall_time_us":18428,"cfile_cache_hit":42,"cfile_cache_hit_bytes":43974,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6221,"cfile_init":1,"lbm_read_time_us":1039,"lbm_reads_lt_1ms":8,"num_ops":11,"prepare.queue_time_us":1519,"prepare.run_cpu_time_us":11379,"prepare.run_wall_time_us":14805,"raft.queue_time_us":1284,"raft.run_cpu_time_us":2409,"raft.run_wall_time_us":2645,"replication_time_us":15558,"thread_start_us":13031,"threads_started":4,"wal-append.queue_time_us":8305,"wal-append.run_cpu_time_us":4550,"wal-append.run_wall_time_us":1031177}]]}
I20260709 12:25:41.770516 17042 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.770696 16209 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.771221 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.769572 12454 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.774098 12704 raft_consensus.cc:2410] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:41.768836 17189 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.774830 17075 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.791092 12454 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.793366 12454 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.795472 12454 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 10, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 10 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.725903 17158 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.804683 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:41.805774 12634 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:41.809255 16755 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:41.840832 12671 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:41.814970 17042 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.815243 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 993735us
I20260709 12:25:41.815927 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.847157 12631 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
W20260709 12:25:41.823140 17181 log.cc:927] Time spent T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.518s	user 0.003s	sys 0.000s
I20260709 12:25:41.823397 17128 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.823975 16961 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.828127 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.829718 17147 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:41.832552 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.858886 12550 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:41.859258 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:41.859776 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.860554 12550 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:41.833093 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.833525 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.861626 12551 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:41.779114 16877 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.834772 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.835179 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.787693 16209 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:41.845299 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:41.850996 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:41.853161 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:41.853533 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:41.788028 16970 consensus_queue.cc:1059] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 8.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 12:25:41.797127 17075 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.842722 16479 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.850742 17080 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:41.899617 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 49758.6us
I20260709 12:25:41.846300 17054 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:41.902431 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:41.868754 16817 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:41.868744 17037 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:41.865073 16917 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:25:41.915880 17075 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.904829 16969 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.863188 17010 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:25:41.851538 17042 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.936492 17042 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:41.866582 17074 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 12:25:41.937903 17074 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:41.938295 17074 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:41.939172 17074 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.940212 17074 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:41.940591 17041 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.901157 17209 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.850915 16755 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:41.862797 17128 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.905023 17203 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:41.865201 16961 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:41.931067 17217 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260709 12:25:41.929723 16856 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:41.931643 17189 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.932780 16917 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:41.933573 16976 consensus_meta.cc:287] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.780s	user 0.010s	sys 0.004s
I20260709 12:25:41.920471 16817 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.036854 16961 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.997551 12522 leader_election.cc:400] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12.
I20260709 12:25:42.038378 12522 leader_election.cc:403] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:42.038038 16856 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:42.040190 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 43530.6us
I20260709 12:25:41.864049 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.913489 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1004) took 1166 ms. Trace:
I20260709 12:25:42.041527 16917 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.042927 12707 rpcz_store.cc:276] 0709 12:25:40.747047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.747188 (+   141us) service_pool.cc:224] Handling call
0709 12:25:40.747537 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.754874 (+  7337us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.754904 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.755380 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:25:41.151464 (+396084us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:41.151508 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.152372 (+   864us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.822565 (+670193us) spinlock_profiling.cc:243] Waited 26.2 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:41.907511 (+ 84946us) raft_consensus.cc:1685] finished
0709 12:25:41.907543 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.913428 (+  5885us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13725,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":60272512,"thread_start_us":395621,"threads_started":1,"wal-append.queue_time_us":460341}
I20260709 12:25:41.797848 12454 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 9, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.040230 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.047793 12550 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 15: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:42.009120 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.050063 12557 raft_consensus.cc:2393] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:42.050307 12700 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:42.009882 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:42.051440 12551 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.011088 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.013283 12702 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:41.914721 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1007) took 1136 ms. Trace:
I20260709 12:25:42.054078 12558 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 7.
I20260709 12:25:42.055761 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:42.054378 12703 rpcz_store.cc:276] 0709 12:25:40.778263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.778373 (+   110us) service_pool.cc:224] Handling call
0709 12:25:40.778728 (+   355us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.778973 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:40.814072 (+ 35099us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.801396 (+987324us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18001afa40. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b23a 00007f0e94af5a2a
0709 12:25:41.914374 (+112978us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:41.914431 (+    57us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:41.914484 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.914549 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.914662 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":34770,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":79,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":9574784,"thread_start_us":112730,"threads_started":1,"wal-append.queue_time_us":1141646}
I20260709 12:25:41.913806 12704 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 14: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:42.059207 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.059370 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.060513 12704 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:42.060560 16708 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.015045 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:42.009506 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 86288.7us
I20260709 12:25:42.062789 12706 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:42.063347 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:42.064993 12706 pending_rounds.cc:85] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 6
I20260709 12:25:42.022516 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.023967 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:42.022585 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.025702 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.024755 16209 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:41.917838 16479 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.027431 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:41.900812 16877 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.065392 12706 pending_rounds.cc:107] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:42.072970 12706 raft_consensus.cc:2889] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.073607 12522 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:42.023432 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.074962 16877 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.066382 13227 raft_consensus.cc:2410] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:25:42.067868 13232 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:42.068578 12552 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
W20260709 12:25:42.078205 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.003337 12555 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:42.069634 16209 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:41.949816 16976 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.038750 16755 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.048324 12454 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:41.917095 17080 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:41.953683 17128 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:42.070950 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.137924 17080 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:41.899641 17174 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.140466 17057 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12.
I20260709 12:25:42.140679 17174 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:41.948513 17203 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.072439 12704 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.143432 12704 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:42.143800 17203 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.071326 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:42.145093 16817 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.146133 12703 raft_consensus.cc:2410] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:42.053239 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.077167 12522 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:42.072309 12553 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:42.146318 12454 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:42.093837 16949 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.071671 16479 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.071193 16927 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.038021 16961 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.149960 16961 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.151286 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.152554 16961 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.066332 16881 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.152925 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.153807 12633 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.155375 16927 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.115798 16708 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.158448 16708 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.098541 16917 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.119501 16856 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.119624 16969 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:42.159399 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.160322 12629 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:42.120760 17073 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:42.121651 17076 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:42.123370 17037 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:42.125627 16975 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.125775 17041 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.183172 17073 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:42.185958 17055 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:42.185696 16975 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:42.186539 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 110008us
I20260709 12:25:42.186887 17037 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.187547 12522 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:42.188513 16975 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.190001 17169 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.190153 17054 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.189142 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:42.191947 16970 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:42.192338 16970 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:42.192705 16970 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.127808 16976 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.128585 13229 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:42.111300 16945 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:42.194775 16945 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.195170 16945 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:42.133750 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.135598 17114 raft_consensus.cc:3055] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:42.196468 17114 raft_consensus.cc:740] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:42.196967 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.197872 17114 consensus_queue.cc:260] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.199061 17114 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.199680 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:42.168929 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.169812 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.159658 16969 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.170889 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.172883 16968 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.213670 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.213555 16968 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.214833 16881 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.215528 17041 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:42.215749 17159 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.215925 16968 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.216460 17159 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.217262 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 1141) took 1504 ms. Trace:
I20260709 12:25:42.174197 16856 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.217676 13229 rpcz_store.cc:276] 0709 12:25:40.713219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.718530 (+  5311us) service_pool.cc:224] Handling call
0709 12:25:42.217016 (+1498486us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b540064fad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:42.217176 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3062562048}
I20260709 12:25:42.218211 16856 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.220705 16856 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.221189 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.161468 17231 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:42.199924 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:42.211004 12631 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:42.212214 16969 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.213014 12625 raft_consensus.cc:2410] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
W20260709 12:25:42.167708 17218 log.cc:927] Time spent T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.420s	user 0.000s	sys 0.001s
W20260709 12:25:42.227047 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.186481 17055 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:42.232753 12704 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:42.184777 17073 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.215991 17041 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.201460 17037 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.237900 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.225179 17159 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.246101 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.261264 17148 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.261730 12700 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:25:42.271909 17055 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.246778 17041 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.284049 17158 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.284775 17158 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.256207 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:42.312467 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 113135us
W20260709 12:25:42.346769 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 277541us
I20260709 12:25:42.341207 17055 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:42.361511 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.363590 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.368695 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:42.303567 17231 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.370225 12703 raft_consensus.cc:1240] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:42.379606 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.381647 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:42.385710 17054 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:42.381892 17194 log.cc:927] Time spent T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 1.056s	user 0.005s	sys 0.000s
I20260709 12:25:42.390383 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.395753 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:42.400710 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.402371 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.403141 17158 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.405125 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:42.405650 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.406558 13230 raft_consensus.cc:2410] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260709 12:25:42.406796 16970 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.407594 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:42.409025 16970 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.372588 16927 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.411422 12553 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:25:42.409219 17147 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.415024 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46939.9us
I20260709 12:25:42.436158 12552 raft_consensus.cc:2393] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:42.439548 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.444118 17231 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.450709 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:42.450954 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.451843 13235 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 15: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:42.452447 12701 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:42.456521 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.457300 12559 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:42.462934 17011 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:42.463641 17011 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.468747 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.469599 17061 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:42.470271 17061 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.471174 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:42.471973 13228 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:25:42.474238 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.477226 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.480264 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.481699 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:42.482952 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.483690 17159 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:42.484109 17159 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:42.484529 17159 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.477463 17061 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.488299 12554 raft_consensus.cc:1240] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:42.489532 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 117430us
I20260709 12:25:42.490370 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:42.486159 17054 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:42.491817 12674 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.492206 17175 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:42.492944 17175 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:42.487483 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:42.495358 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.474277 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.499909 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.499946 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.501160 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.501679 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.501947 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.502970 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1006) took 1724 ms. Trace:
I20260709 12:25:42.503159 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.504072 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.505012 13228 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:42.503353 12705 rpcz_store.cc:276] 0709 12:25:40.777977 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.778741 (+   764us) service_pool.cc:224] Handling call
0709 12:25:40.779073 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.779467 (+   394us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:25:41.004615 (+225148us) log.cc:844] Serialized 14 byte log entry
0709 12:25:41.158776 (+154161us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:41.159262 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:25:41.159396 (+   134us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:41.159434 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.159500 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:42.054921 (+895421us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b48000339d8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e99a14aa1 00007f0e99a0bb37 00007f0e99a0b9ca 00007f0e99b0326f 00007f0e99b02f37 00007f0e99b1755c 00007f0e99b17508 00007f0e99b17488 00007f0e99b17443 00007f0e99b166ec 00007f0e98a40a96
0709 12:25:42.238062 (+183141us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:42.502572 (+264510us) raft_consensus.cc:1685] finished
0709 12:25:42.502593 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.502768 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25641,"prepare.queue_time_us":99393,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":45115,"raft.queue_time_us":2755,"raft.run_cpu_time_us":6056,"raft.run_wall_time_us":892965,"spinlock_wait_cycles":71769216,"thread_start_us":350895,"threads_started":2,"wal-append.queue_time_us":238649}
I20260709 12:25:42.505774 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.506484 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.506688 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.449031 17147 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.507290 12553 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:42.508720 17147 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:42.510118 12444 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:42.510797 13235 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:42.511708 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.512159 13235 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:25:42.512892 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.514835 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.515751 17011 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.509202 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.516202 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.516734 12626 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:42.518641 12630 raft_consensus.cc:2410] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:42.521809 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.522879 12631 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 16: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:42.493254 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.535867 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:42.536581 13231 raft_consensus.cc:3055] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:42.536968 13231 raft_consensus.cc:740] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:42.537889 13234 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
W20260709 12:25:42.539269 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.545495 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.552379 13230 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:42.546197 13231 consensus_queue.cc:260] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.556267 13226 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:42.534596 16927 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:42.557003 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.558562 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.563293 13231 raft_consensus.cc:3060] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.563503 12632 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:42.564033 12629 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:42.543264 17148 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:42.565256 17148 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.567905 17148 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.575667 12630 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 2289) took 1338 ms. Trace:
I20260709 12:25:42.576130 12630 rpcz_store.cc:276] 0709 12:25:41.236796 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:41.236925 (+   129us) service_pool.cc:224] Handling call
0709 12:25:42.575424 (+1338499us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b540025e4d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:42.575588 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2834105216}
I20260709 12:25:42.585881 12631 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 5.
I20260709 12:25:42.561513 12627 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
W20260709 12:25:42.589550 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 231770us
I20260709 12:25:42.599982 12626 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
W20260709 12:25:42.607854 17074 consensus_meta.cc:287] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.667s	user 0.013s	sys 0.007s
I20260709 12:25:42.560086 17169 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:42.603874 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.614621 12634 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:42.620478 12707 raft_consensus.cc:2410] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260709 12:25:42.623430 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.632256 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:42.636348 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 143215us
I20260709 12:25:42.640870 12558 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:42.655406 12633 consensus_meta.cc:287] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.501s	user 0.006s	sys 0.006s
I20260709 12:25:42.655795 12633 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:42.656347 12559 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:42.657312 17042 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.657804 17042 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.658192 17159 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.664714 13231 raft_consensus.cc:2468] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:42.616899 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:42.668241 13226 raft_consensus.cc:1275] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:42.674348 17159 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.678455 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:42.686080 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.658226 17042 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:42.691355 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48829.8us
I20260709 12:25:42.695379 12554 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:42.699223 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.700799 16569 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:42.701264 16569 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.701623 16569 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:42.641865 17080 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.708920 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.710955 13230 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
W20260709 12:25:42.682087 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 65220.8us
I20260709 12:25:42.709758 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.714313 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:42.716812 12551 consensus_meta.cc:287] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.665s	user 0.010s	sys 0.006s
I20260709 12:25:42.718066 12551 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:42.720258 12552 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:42.721719 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.732237 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:42.732723 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.741518 17169 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.742380 17169 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.718742 16969 raft_consensus.cc:2764] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:42.683914 16945 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.746949 12554 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:42.753194 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:42.762151 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 50020.3us
I20260709 12:25:42.756189 12552 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
W20260709 12:25:42.757828 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 43625.1us
I20260709 12:25:42.735739 17057 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.782250 13227 raft_consensus.cc:2368] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:25:42.765564 17231 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:42.780036 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:42.767089 17175 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:42.766968 16927 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:42.798804 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.793883 16917 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.805117 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.806325 12705 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:42.752378 17010 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.173s
I20260709 12:25:42.754736 17041 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:42.814929 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 114598us
W20260709 12:25:42.802472 16209 consensus_meta.cc:287] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.723s	user 0.010s	sys 0.006s
I20260709 12:25:42.790122 17231 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.821736 12674 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:42.816671 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:42.823052 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:42.814500 16917 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.824203 17074 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:42.802182 17169 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.828922 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:42.831041 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.832546 17193 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:42.825624 17231 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.836259 13233 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:42.830265 16927 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:42.846546 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 53300.7us
I20260709 12:25:42.851495 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:42.848910 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:42.792711 17057 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:42.858114 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.860894 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 45025.3us
W20260709 12:25:42.862000 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58666us
W20260709 12:25:42.870183 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.869833 12671 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:42.857652 17169 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:42.860363 17193 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:42.878971 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.866421 16708 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:42.870260 17175 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:42.875413 17169 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.888871 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.890619 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:42.890854 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.887560 16881 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:42.882107 16961 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:42.883440 16708 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.897094 12559 raft_consensus.cc:1240] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:42.883770 17080 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.899000 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.897598 12597 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:42.873898 16569 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:42.894181 17055 consensus_meta.cc:287] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.526s	user 0.012s	sys 0.000s
I20260709 12:25:42.904896 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.890877 17169 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.909976 12625 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.893272 17158 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:42.900262 16708 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:42.922600 12627 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260709 12:25:42.923170 12627 pending_rounds.cc:85] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 6
I20260709 12:25:42.923429 12627 pending_rounds.cc:107] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 9.7
I20260709 12:25:42.923660 12627 raft_consensus.cc:2889] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:42.920637 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.924639 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.925588 16881 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:42.926506 16881 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.926955 16881 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.928946 16881 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.929526 17057 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.932657 16927 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.939513 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.940461 12631 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 16: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:42.909123 16945 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.943406 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.943446 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:42.941897 12633 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:42.948184 12634 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:42.952155 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:42.954048 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:42.947055 17148 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:42.954969 17055 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:42.955646 17055 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:42.953053 17159 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:42.956640 17159 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:42.957823 17055 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:42.958876 17159 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:42.960793 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:42.966650 13198 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:42.970431 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 80529.1us
I20260709 12:25:42.972352 12554 raft_consensus.cc:2410] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for term 16 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:25:43.001917 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:43.004645 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:43.006964 12628 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:43.010257 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.012863 12551 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:42.978695 16569 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:42.991163 17055 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:43.019680 17080 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:42.973462 17041 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:43.023450 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 80147.6us
I20260709 12:25:43.033483 13229 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:43.036839 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:43.028342 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:43.037729 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:43.038434 13230 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:43.052605 17147 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.015774 16945 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:43.055727 13233 raft_consensus.cc:2393] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 15: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:43.035715 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:43.095988 12600 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 2.057s (SENT) [suppressed 15 similar messages]
W20260709 12:25:43.098650 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 160706us
I20260709 12:25:43.099391 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:43.018502 17231 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.053042 17147 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.071024 16945 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.046347 17080 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.107445 12628 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 6.
I20260709 12:25:43.109687 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.070077 17148 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260709 12:25:43.112507 17147 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.027976 17126 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260709 12:25:43.039999 17042 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.114964 16945 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:43.127439 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:43.127959 12552 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:43.117228 17080 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.133322 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.129101 17057 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:43.174293 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:43.152815 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 262238us
I20260709 12:25:43.181875 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:43.171298 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47677.2us
W20260709 12:25:43.195652 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.170578 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:43.168665 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:43.160210 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50633.2us
I20260709 12:25:43.194550 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.158329 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:43.145500 17041 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:43.204886 12550 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.205770 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:43.182338 17126 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:43.248760 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 54439us
I20260709 12:25:43.144200 16961 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:43.020246 17193 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.258174 17126 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.259241 17231 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.276542 17126 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:43.266482 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 60788.3us
I20260709 12:25:43.278376 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:43.279816 12522 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:43.266961 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:43.267447 17254 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:43.287439 12625 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:43.273331 12674 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.267911 17055 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.333772 17159 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:43.334484 17159 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:43.335511 17159 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:43.337571 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 88024.8us
I20260709 12:25:43.338011 17041 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.338413 17041 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.338733 17041 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.341812 17158 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:43.342281 17158 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.342674 17158 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.343416 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:43.347060 17042 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.325904 17057 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:25:43.330061 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50408.3us
I20260709 12:25:43.372714 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:43.373775 13234 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:43.388396 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 137074us
I20260709 12:25:43.389366 16708 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.391281 12630 raft_consensus.cc:2368] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16.
I20260709 12:25:43.391673 16708 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.394177 17055 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.396665 17041 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.399191 16970 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:43.399786 16970 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.401690 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:43.402500 13235 raft_consensus.cc:2393] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:43.401700 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.408335 13234 raft_consensus.cc:2468] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:43.405731 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.409261 12704 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:25:43.409605 13226 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:43.404217 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.391314 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.430428 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.445775 12705 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.446234 16970 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:43.448961 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 165673us
I20260709 12:25:43.450686 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:43.451575 17074 consensus_meta.cc:287] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.002s
I20260709 12:25:43.452479 17074 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:43.456111 12550 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:43.456843 17166 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.462574 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:43.436898 17073 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:43.461546 16961 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.480468 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:43.481225 12626 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:43.480526 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:43.486311 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:43.486892 12627 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 12
W20260709 12:25:43.487701 17169 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.000s
I20260709 12:25:43.487792 17158 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.488238 17169 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.493506 17251 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:43.496558 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 400571us
W20260709 12:25:43.532975 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 93196.1us
W20260709 12:25:43.560971 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.545260 12671 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:43.605067 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 59891.5us
I20260709 12:25:43.611665 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50962 (request call id 996) took 1207 ms. Trace:
I20260709 12:25:43.480535 17073 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.612221 13227 rpcz_store.cc:276] 0709 12:25:42.404215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.404814 (+   599us) service_pool.cc:224] Handling call
0709 12:25:43.603131 (+1198317us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b54005b27d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:43.611573 (+  8442us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":851696384}
W20260709 12:25:43.619671 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 159442us
I20260709 12:25:43.565693 17169 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.613255 17074 raft_consensus.cc:2804] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:43.603588 16708 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:43.631161 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.642438 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.663038 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.665833 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:43.671124 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 218251us
I20260709 12:25:43.671476 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:43.673719 12703 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.667893 17074 raft_consensus.cc:697] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:43.643489 16961 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.675040 16961 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.675369 17074 consensus_queue.cc:237] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:43.676194 17243 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.882s	user 0.008s	sys 0.010s
I20260709 12:25:43.641448 16881 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.683475 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.691169 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.677757 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:43.696590 17057 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:43.696841 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 237098us
I20260709 12:25:43.699646 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:43.699340 12700 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:43.672250 17158 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.707063 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:43.707166 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:43.706913 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:43.704710 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:43.713025 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.644593 17169 consensus_queue.cc:1059] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:25:43.698885 17262 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:43.715760 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.716584 12627 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:43.688400 16708 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.726893 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.727551 12704 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:43.741986 17126 raft_consensus.cc:2764] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
W20260709 12:25:43.743767 17080 consensus_meta.cc:287] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.002s
I20260709 12:25:43.743925 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.710773 17231 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:43.746124 17231 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:43.748623 16708 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:43.753167 16945 consensus_meta.cc:287] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.612s	user 0.007s	sys 0.000s
I20260709 12:25:43.695708 16881 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.745352 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.757844 17254 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:43.758069 16917 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.758630 12703 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
W20260709 12:25:43.759577 17246 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.851s	user 0.000s	sys 0.018s
I20260709 12:25:43.773948 17254 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.706919 17251 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:43.744194 17080 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:43.761257 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 258722us
I20260709 12:25:43.759912 17269 consensus_queue.cc:1059] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:43.721113 17073 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.763906 17114 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.766819 17148 raft_consensus.cc:2764] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:25:43.768337 16969 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.767004 16970 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:43.766079 17158 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:43.770227 17159 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:43.772254 17245 log.cc:927] Time spent T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.940s	user 0.007s	sys 0.009s
I20260709 12:25:43.811443 12705 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:25:43.782629 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2362) took 1232 ms. Trace:
I20260709 12:25:43.812127 17159 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.812557 12553 rpcz_store.cc:276] 0709 12:25:42.550488 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.550640 (+   152us) service_pool.cc:224] Handling call
0709 12:25:42.562952 (+ 12312us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:42.563432 (+   480us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:42.563462 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:42.564065 (+   603us) log.cc:844] Serialized 52 byte log entry
0709 12:25:42.787445 (+223380us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:42.825081 (+ 37636us) log.cc:844] Serialized 14 byte log entry
0709 12:25:42.825335 (+   254us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.825440 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:43.725806 (+900366us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b18004a3860. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:25:43.758874 (+ 33068us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:43.782359 (+ 23485us) raft_consensus.cc:1685] finished
0709 12:25:43.782382 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.782537 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18354,"prepare.queue_time_us":39754,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":10838,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":195,"spinlock_wait_cycles":19980544,"thread_start_us":222920,"threads_started":1,"wal-append.queue_time_us":317560}
I20260709 12:25:43.815207 17159 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.786978 16881 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.760922 17042 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.816363 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.761044 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:43.801892 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 56615.9us
I20260709 12:25:43.764070 17126 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.766911 16945 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.818804 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:43.807989 16917 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:43.788209 17251 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.826047 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:43.826411 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 160693us
W20260709 12:25:43.828616 12444 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:43.827350 17126 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.806721 17114 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.836006 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:43.828524 17147 consensus_meta.cc:287] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.003s
I20260709 12:25:43.836692 13233 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:43.811091 16969 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.864355 17156 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:43.816329 17042 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.818578 17158 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.867578 17042 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.867849 17158 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.868592 17126 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.827833 17254 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.873585 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1018) took 1079 ms. Trace:
I20260709 12:25:43.874035 12699 rpcz_store.cc:276] 0709 12:25:42.769971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.775428 (+  5457us) service_pool.cc:224] Handling call
0709 12:25:43.752722 (+977294us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800030f98. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:25:43.752945 (+   223us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.762763 (+  9818us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:43.762797 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:43.767654 (+  4857us) log.cc:844] Serialized 26 byte log entry
0709 12:25:43.821465 (+ 53811us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:43.835070 (+ 13605us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.835313 (+   243us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.835377 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:43.835411 (+    34us) raft_consensus.cc:1685] finished
0709 12:25:43.845749 (+ 10338us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.849402 (+  3653us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7764,"prepare.queue_time_us":12578,"raft.queue_time_us":14090,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":10885,"spinlock_wait_cycles":6865280,"thread_start_us":39771,"threads_started":1,"wal-append.queue_time_us":50463}
I20260709 12:25:43.877311 17041 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.878227 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38720 (request call id 2359) took 1428 ms. Trace:
I20260709 12:25:43.878620 12558 rpcz_store.cc:276] 0709 12:25:42.449877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.450147 (+   270us) service_pool.cc:224] Handling call
0709 12:25:42.466895 (+ 16748us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.641384 (+174489us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.877986 (+1236602us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b540033ed54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:43.878163 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":372765568}
I20260709 12:25:43.871732 17166 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:43.872582 17080 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.865043 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04a769018c454aa685eae73d74c89abb"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:43.885118 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:43.885258 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:43.830664 17262 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 16 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:43.806676 17057 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.897159 13232 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:43.897667 17055 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:43.899065 17055 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.902822 16969 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.881748 17147 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.905862 17147 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.906418 17268 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:43.896739 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:43.907351 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:43.907969 13227 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.908468 13230 raft_consensus.cc:606] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:43.908864 13230 raft_consensus.cc:614] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:43.909842 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.910432 12703 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:43.909423 17278 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:43.912962 17278 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:43.913456 17278 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.827688 17198 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260709 12:25:43.918239 17055 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.919082 17254 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:43.919708 17254 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.921018 17251 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.921933 17254 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:43.881438 17041 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:25:43.923290 17041 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:43.924100 17041 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:43.924700 17114 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:43.926407 17041 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:43.927121 16945 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.929796 13233 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 16.
I20260709 12:25:43.934099 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:43.936080 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.936879 12702 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:43.945127 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:43.944761 17055 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:43.946990 17055 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.949076 17055 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:43.953831 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:43.954209 17261 log.cc:927] Time spent T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.444s	user 0.004s	sys 0.003s
W20260709 12:25:43.961928 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 150929us
W20260709 12:25:43.962769 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 87987.3us
W20260709 12:25:43.963511 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 76679us
I20260709 12:25:43.973464 12705 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:43.977023 12597 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:43.945783 12706 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
W20260709 12:25:43.965425 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 265797us
I20260709 12:25:43.978588 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:43.982055 12702 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:43.970163 13227 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:43.939864 17114 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:43.991509 17114 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.974373 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:43.989253 12522 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:43.991042 17175 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.091s	user 0.011s	sys 0.021s
I20260709 12:25:43.991899 17114 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.992571 12630 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:25:43.993868 17175 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.011s	sys 0.021s
I20260709 12:25:43.994216 17175 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:43.995317 17175 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:43.997982 17251 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.998554 17251 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.000768 17251 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:44.000669 17114 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.005177 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2307) took 1049 ms. Trace:
I20260709 12:25:43.976054 17041 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.014446 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:44.020201 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:43.983695 17055 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.021324 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:44.005638 12629 rpcz_store.cc:276] 0709 12:25:42.939429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.939725 (+   296us) service_pool.cc:224] Handling call
0709 12:25:42.943045 (+  3320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.957028 (+ 13983us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:43.195612 (+238584us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.709166 (+513554us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:43.709226 (+    60us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:43.710179 (+   953us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.957212 (+247033us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b1800215380. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e989bf58f 00007f0e919fe571 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd
0709 12:25:43.988993 (+ 31781us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b5400114c54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:43.989048 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.989155 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22308,"prepare.queue_time_us":317391,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":71252,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":87,"spinlock_wait_cycles":65645184,"thread_start_us":687649,"threads_started":3,"wal-append.queue_time_us":567991}
I20260709 12:25:44.024230 13230 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:43.988780 17147 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:25:44.030397 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.002022 16970 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.953833 17262 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.033178 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:44.030937 13227 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:44.030717 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.033201 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:44.034757 12633 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.032246 13232 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:44.003042 16961 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:44.033460 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.039618 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.032287 12628 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:44.031106 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:44.036273 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.043262 12634 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:44.019510 17169 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.026703 16917 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:44.036960 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.052577 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.055114 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.053937 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.053210 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.057650 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.058382 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.058961 12554 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:44.035676 16968 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:44.015823 17269 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:25:44.060818 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.056438 12632 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:44.060325 12556 raft_consensus.cc:2368] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:44.029259 16708 consensus_queue.cc:1048] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:25:44.067781 17285 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:44.071450 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:44.027338 17278 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.060379 16856 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:44.086687 12707 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1017) took 1317 ms. Trace:
I20260709 12:25:44.093657 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:44.100317 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 70049.1us
I20260709 12:25:44.101310 12522 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.102726 12522 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.047487 16970 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.116132 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.099311 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.096596 12707 rpcz_store.cc:276] 0709 12:25:42.769595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.776454 (+  6859us) service_pool.cc:224] Handling call
0709 12:25:42.802047 (+ 25593us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:42.838094 (+ 36047us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:42.838113 (+    19us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:42.844839 (+  6726us) log.cc:844] Serialized 26 byte log entry
0709 12:25:43.935045 (+1090206us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b18003aa020. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919e0e07 00007f0e9a83b9a9 00007f0e919fd69b 00007f0e919fb93f 00007f0e919fdc02 00007f0e9468520b 00007f0e9468ad23 00007f0e9468b0d1 00007f0e94aa6a0f
0709 12:25:43.990403 (+ 55358us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:25:43.991248 (+   845us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.991503 (+   255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.991609 (+   106us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:44.070255 (+ 78646us) raft_consensus.cc:1685] finished
0709 12:25:44.086476 (+ 16221us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.086619 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16112,"prepare.queue_time_us":237,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":56,"raft.queue_time_us":7602,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":2231,"spinlock_wait_cycles":13240576,"thread_start_us":55108,"threads_started":1,"wal-append.queue_time_us":1145430}
I20260709 12:25:44.117142 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.080380 17147 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:44.052372 17055 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.087693 16968 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:44.124159 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.064659 16917 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.121707 12522 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.126094 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.131201 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.121718 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.131762 12550 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:44.130559 12558 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:44.132361 12557 raft_consensus.cc:2410] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 13 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:44.134123 17280 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.115439 16969 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.115257 16856 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:44.139241 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.139638 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.139807 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.139950 12552 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:44.121507 17169 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:44.127420 17057 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:25:44.118906 16881 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.145251 16970 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:44.147308 17159 raft_consensus.cc:3055] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:44.147732 17159 raft_consensus.cc:740] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:44.144975 16881 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.153452 16881 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:44.153612 17269 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:44.154793 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.155427 12555 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.140262 12556 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:44.160540 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.135299 17285 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:44.180135 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.181349 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.182569 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.137425 17276 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.175s
I20260709 12:25:44.183043 12552 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.163204 17274 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:25:44.185756 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.186309 12551 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:44.187047 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:44.187252 12702 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:44.188308 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.188557 13199 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.188925 12557 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:44.189402 16569 raft_consensus.cc:2804] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:44.189989 16569 raft_consensus.cc:697] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:44.190842 16569 consensus_queue.cc:237] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.191201 17159 consensus_queue.cc:260] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.192430 17159 raft_consensus.cc:3060] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.163754 17277 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.077s
I20260709 12:25:44.199084 12631 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55074
I20260709 12:25:44.164263 17283 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.164821 17282 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.164960 16917 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:44.169540 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:44.169169 17147 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.170331 16856 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.172022 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.173949 12674 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:44.174170 17114 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:44.140977 17273 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:44.176682 17266 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:44.222550 17266 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:44.178695 17055 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:44.161715 16968 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.228645 17278 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:44.223678 17266 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.181054 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:44.138198 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 91778.5us
I20260709 12:25:44.122903 12633 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:44.230942 12558 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:44.207902 12554 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 16.
W20260709 12:25:44.213313 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 76265.9us
I20260709 12:25:44.232053 12631 raft_consensus.cc:606] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 12:25:44.232398 12631 raft_consensus.cc:614] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:44.235348 13227 raft_consensus.cc:1240] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:25:44.238624 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:44.242584 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:44.243495 13227 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:25:44.213743 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 186774us
I20260709 12:25:44.220928 17282 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.221637 17041 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:44.221737 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 47907.2us
I20260709 12:25:44.224653 17283 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.261915 12674 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.264447 12600 leader_election.cc:400] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:44.264827 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.264834 12600 leader_election.cc:403] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:44.262944 12522 leader_election.cc:400] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16.
I20260709 12:25:44.268491 12522 leader_election.cc:403] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:25:44.264609 17266 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:44.267042 12674 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.271687 12600 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:44.274364 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.278365 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.280670 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.280959 12559 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:44.275230 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:44.285175 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 185962us
I20260709 12:25:44.288480 12674 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:44.290284 12674 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.272580 17278 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16.
I20260709 12:25:44.273664 17254 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.297437 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.277040 16881 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.279768 17274 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.279712 17251 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:44.301868 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:44.353065 12625 raft_consensus.cc:3060] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.279290 17296 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:25:44.287173 17041 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.284832 17276 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.303300 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.303505 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:44.304011 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.304155 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:44.358160 12632 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:25:44.301056 12630 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260709 12:25:44.309397 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45264.1us
I20260709 12:25:44.312062 17282 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:44.303403 17169 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.303043 17055 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:44.298098 16961 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.318023 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.322149 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:44.323870 13234 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:44.396750 12702 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:44.324111 12552 raft_consensus.cc:2468] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:44.325394 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.348652 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:44.350659 12628 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:44.351780 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:44.305701 17272 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:44.354630 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:44.317974 16708 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.356252 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:44.337874 17254 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.362998 12556 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 7. (term mismatch)
I20260709 12:25:44.350337 17080 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:44.382143 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 78193.6us
I20260709 12:25:44.350023 17158 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:44.386763 17284 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.354s	user 0.003s	sys 0.000s
I20260709 12:25:44.352566 17251 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.420135 12555 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:44.403121 12705 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.405055 13231 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
W20260709 12:25:44.409914 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 84658.3us
I20260709 12:25:44.357236 17041 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.411804 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.424667 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.409435 12556 pending_rounds.cc:85] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 6
I20260709 12:25:44.425499 12556 pending_rounds.cc:107] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 12:25:44.370204 17055 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:44.371438 17278 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.425824 12556 raft_consensus.cc:2889] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:44.402925 17272 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:44.435567 12625 raft_consensus.cc:2468] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:44.433197 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:44.410737 17254 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.410950 17080 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:44.494944 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 61845.8us
W20260709 12:25:44.484182 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 62349.4us
I20260709 12:25:44.423520 17251 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.398970 17169 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.428416 17041 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.431288 17055 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.435189 17276 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.511415 12703 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:44.423177 17158 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.435256 16961 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:44.499641 17080 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.499179 17280 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:44.519106 12551 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
W20260709 12:25:44.522073 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 224993us
I20260709 12:25:44.495657 17262 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:44.494171 17266 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:44.472463 17272 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.515797 17276 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.542572 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:44.544881 12706 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:44.528458 16961 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:44.537539 17286 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:44.548919 17286 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.550568 12598 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.551215 17286 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:44.538398 17301 log.cc:927] Time spent T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.176s	user 0.000s	sys 0.001s
I20260709 12:25:44.538759 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.559132 12705 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:44.560801 17169 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:44.558049 17286 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.561594 17286 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.563553 17286 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:44.564735 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.565124 12557 raft_consensus.cc:1275] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:25:44.565467 12557 pending_rounds.cc:85] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 9
W20260709 12:25:44.565528 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 262247us
I20260709 12:25:44.566732 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.565771 12557 pending_rounds.cc:107] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:25:44.567467 12557 raft_consensus.cc:2889] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:44.568454 13230 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:44.570098 12703 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:44.527635 17280 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:44.525627 17283 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:44.590752 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.593632 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:25:44.632362 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47216.7us
I20260709 12:25:44.573622 17273 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:44.596041 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 194488us
I20260709 12:25:44.568507 16708 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:44.573124 17262 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.599996 17074 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:25:44.600780 17286 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:44.609261 17280 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.615204 17041 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.617880 16961 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:44.587275 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 259741us
W20260709 12:25:44.663280 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 139299us
I20260709 12:25:44.597479 17278 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:44.665323 17286 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.731670 17278 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.731794 17286 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.732170 17278 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.732297 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.733289 12674 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.734242 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:44.735627 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 96317.3us
W20260709 12:25:44.690580 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 138898us
I20260709 12:25:44.736356 12523 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:44.659538 17273 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.662147 17283 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:44.737529 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:44.661422 17262 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.751926 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:44.739084 16881 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.756836 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.763727 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.739372 17175 raft_consensus.cc:2804] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.765156 13234 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:25:44.766494 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:44.740386 17273 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:44.770152 12598 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.770349 12705 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:44.747843 17114 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:44.746935 17262 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.751125 17231 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.743902 17269 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:44.739120 17314 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:44.779268 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:44.752302 17283 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:44.784566 17305 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.252s	user 0.001s	sys 0.003s
I20260709 12:25:44.781895 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:44.753219 17169 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:25:44.769384 16881 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.778082 17277 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:44.769273 17148 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:44.780515 16945 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:44.817338 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 81247.5us
I20260709 12:25:44.782311 17175 raft_consensus.cc:697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:44.784938 17283 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.821398 12559 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:44.828163 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.788682 17114 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:44.810446 16881 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.858402 17314 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:44.783048 17231 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:44.783689 17074 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:44.856056 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.861251 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:44.861945 17114 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.4, Last appended by leader: 4, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.824796 17126 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 12:25:44.869948 17324 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:44.873209 17080 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.815418 17148 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:44.907056 17148 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:44.906527 17314 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:44.818805 17296 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:44.854254 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.819029 16945 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:44.910346 16945 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.821834 17158 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:44.901846 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 118884us
I20260709 12:25:44.816200 17055 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:44.884800 17274 consensus_meta.cc:287] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.008s
I20260709 12:25:44.857080 17282 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:44.821033 17073 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 12:25:45.004531 12707 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:44.921766 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.014263 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:45.023087 12555 raft_consensus.cc:1240] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:45.025159 12702 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:44.995635 17057 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.994709 17296 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:44.997157 17274 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:45.036388 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.045627 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:45.012507 17282 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.031844 17334 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.039203 17041 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.039839 17296 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 7 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:45.087855 12522 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:45.049813 17313 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:45.052874 17332 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.111727 12627 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:45.125878 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.041139 17057 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.134822 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.107506 17275 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.038203 17175 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.134853 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.135669 12625 raft_consensus.cc:2393] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:45.132517 17114 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.140028 17114 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.140439 17114 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:45.140525 17315 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.262s	user 0.001s	sys 0.000s
W20260709 12:25:45.141667 17322 log.cc:927] Time spent T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:25:45.142808 17080 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.143981 17231 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:45.144498 17326 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.129s	user 0.001s	sys 0.000s
W20260709 12:25:45.146521 17303 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.581s	user 0.001s	sys 0.000s
I20260709 12:25:45.090559 17334 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.156723 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.157472 12633 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:45.182042 12674 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:45.184173 12674 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.185997 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.186811 12702 raft_consensus.cc:2368] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:45.188623 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.189066 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.191186 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.192971 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.194087 12699 raft_consensus.cc:2410] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:25:45.196236 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:45.196585 12702 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 14: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:45.196355 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.196936 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:45.196355 12706 raft_consensus.cc:2368] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13.
I20260709 12:25:45.197594 12550 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:45.201648 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 156159us
I20260709 12:25:45.203801 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:45.209815 17330 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.210196 17334 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.210796 17334 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.210927 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.211217 17057 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.211912 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.186726 17074 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.212812 12700 raft_consensus.cc:2410] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:45.212677 17074 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.214910 17074 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.183971 17268 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.215643 17268 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.217787 17268 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.221617 17296 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.185865 17041 consensus_queue.cc:1048] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:45.223291 17286 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.132133 17332 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.224944 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:45.225651 17332 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.156724 17275 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.226426 16708 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.227062 17147 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.227553 17147 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.228111 17275 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.227912 16881 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.228603 17295 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:45.228989 17295 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.229319 17295 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.229979 16881 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:45.234195 17251 consensus_meta.cc:287] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.716s	user 0.006s	sys 0.004s
I20260709 12:25:45.234632 17251 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:45.235153 17276 consensus_meta.cc:287] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.002s
I20260709 12:25:45.235585 17276 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.236012 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.236732 17251 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:45.238569 17254 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.726s	user 0.010s	sys 0.000s
I20260709 12:25:45.239008 17254 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.242285 12551 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:25:45.243116 17272 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.711s	user 0.011s	sys 0.000s
I20260709 12:25:45.243541 17272 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.246405 17148 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.246905 17282 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.135371 17339 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:45.247632 17339 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.248100 12553 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:45.248551 17148 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.250211 12625 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:45.226914 16708 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.251430 17329 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:45.252177 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.252789 12632 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:45.253206 17329 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:45.253656 17329 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.253803 17296 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:45.255074 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.258364 12634 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:45.253049 17262 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.263245 17262 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.264341 12627 raft_consensus.cc:2410] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:45.260923 12550 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:45.267086 12559 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:45.267526 12559 pending_rounds.cc:85] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 6
I20260709 12:25:45.267792 12559 pending_rounds.cc:107] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:45.268085 12559 raft_consensus.cc:2889] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:45.275913 12629 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:25:45.278173 12701 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.279253 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.288214 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:45.290216 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:45.288527 12633 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:45.288260 12626 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 12:25:45.281301 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 359631us
I20260709 12:25:45.288741 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:45.295733 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:45.290529 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:45.297914 12558 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:45.298161 12550 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:45.298894 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:45.241279 17254 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.291208 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:45.300593 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.294046 12557 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:45.299072 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:45.305450 12550 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.225313 17286 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.308542 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.310716 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:45.312508 13234 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:45.188264 17313 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.117s
I20260709 12:25:45.288067 17158 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:45.325894 13231 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:45.326705 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.322257 17147 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.333528 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.336040 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.336663 12633 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:45.338171 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.340197 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.341045 12633 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:45.342691 17339 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.343147 17345 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.011s
I20260709 12:25:45.344242 17345 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:45.344555 17345 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:45.344699 12626 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:45.346005 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.346283 17272 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.346778 12706 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:45.351415 17114 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.289371 17251 consensus_queue.cc:1059] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:25:45.354126 17273 consensus_meta.cc:287] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.568s	user 0.004s	sys 0.008s
I20260709 12:25:45.369488 17158 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:45.381078 13234 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:45.399282 17273 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.432307 17080 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:45.433173 17273 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.433332 17055 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.433979 12554 raft_consensus.cc:1240] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.384918 17114 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:45.403698 17278 consensus_meta.cc:287] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.648s	user 0.009s	sys 0.003s
I20260709 12:25:45.437853 17278 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.440220 17278 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.386837 17352 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.357776 17283 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.310523 17269 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.066s
I20260709 12:25:45.375939 17345 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.441045 17352 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.423172 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.385385 17293 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:45.314731 16569 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260709 12:25:45.442883 17293 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.443497 17352 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.385610 17346 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:45.445041 17346 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.445539 17346 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.446497 16708 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.427206 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.448016 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.447872 17295 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.428476 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.428654 12631 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:45.441154 17283 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.450598 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.451277 12631 raft_consensus.cc:3060] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.452121 17283 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.428892 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.385921 17294 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260709 12:25:45.445343 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.432928 17080 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.424914 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.428069 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.457911 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.458065 12705 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 15.
I20260709 12:25:45.454281 12707 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:45.429668 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.449740 12552 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:45.449184 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.449657 12630 raft_consensus.cc:3060] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.460218 12550 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:45.455789 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.463871 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.368278 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:45.430227 16945 consensus_meta.cc:287] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.519s	user 0.011s	sys 0.000s
I20260709 12:25:45.469089 12700 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.444756 17276 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.467324 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.471076 12598 leader_election.cc:400] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10.
I20260709 12:25:45.467532 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.507483 12630 raft_consensus.cc:2468] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:45.477777 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.473397 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:45.516202 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 211817us
W20260709 12:25:45.515923 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52730.9us
I20260709 12:25:45.483013 12632 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:25:45.520618 12702 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:25:45.468747 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 100565us
I20260709 12:25:45.371066 17286 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.095s
I20260709 12:25:45.526530 12699 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 14: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:45.529678 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:45.531044 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.530874 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:45.531697 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 76972.6us
I20260709 12:25:45.464725 16569 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.533310 13235 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:45.533445 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:45.461719 16708 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:45.536515 13233 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:45.518720 17330 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.547940 12631 raft_consensus.cc:2468] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:45.481485 17283 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.534047 17251 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.538484 17347 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.539192 17158 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.536690 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.554023 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.553916 17254 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.559075 17254 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.559209 17251 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.554039 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.562304 17347 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.507603 16945 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.506093 17346 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.562739 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.564901 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.580744 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.562500 17254 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.551767 17283 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.565840 17347 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.593518 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.595840 13226 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:45.593204 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.597534 13232 raft_consensus.cc:606] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.592412 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.597942 13232 raft_consensus.cc:614] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:45.593927 12705 raft_consensus.cc:1240] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:45.577544 17276 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.567358 17080 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.547063 16569 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:45.626716 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 74136us
I20260709 12:25:45.567579 17274 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:45.563519 17041 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:45.693665 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 101980us
I20260709 12:25:45.709509 12598 leader_election.cc:400] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13.
I20260709 12:25:45.709892 12598 leader_election.cc:403] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:45.695704 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.710494 12631 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:45.702310 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 73972.2us
I20260709 12:25:45.711856 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.589643 17286 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:45.713241 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.607072 17254 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:45.596541 17283 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.627979 17324 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.626060 17295 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.628321 17277 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.720534 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:45.721076 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 168416us
I20260709 12:25:45.723672 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.730635 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.730804 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.726766 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.701922 17251 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.592208 17074 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.125s
I20260709 12:25:45.727906 12631 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:45.621791 17347 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 12:25:45.720796 17297 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:45.721446 17351 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:45.599301 17334 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260709 12:25:45.563324 16708 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.734874 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.745299 12708 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:45.722996 17147 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13.
I20260709 12:25:45.711534 17080 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:45.748410 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.748731 17080 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.749786 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.750618 17266 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.751719 17080 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.748436 12626 raft_consensus.cc:1275] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:25:45.753831 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.627625 17276 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.760793 17276 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.767834 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.768644 12630 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 16.
I20260709 12:25:45.769495 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.757279 12702 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:45.718389 17360 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.761634 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.734292 16917 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:45.742274 17055 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:45.763672 17339 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:45.789086 12708 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:45.789324 17339 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:45.789767 17339 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:45.790637 17339 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.791739 17339 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.794108 17314 raft_consensus.cc:3055] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:45.794646 17314 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:45.796356 17324 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:45.795893 17314 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.796932 17324 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.797940 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.798534 12630 raft_consensus.cc:2376] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12. Re-sending same reply.
I20260709 12:25:45.799259 17324 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.802505 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.803035 12625 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:45.758615 17266 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.767904 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.805351 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.805951 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.806951 12633 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:45.761273 16569 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.763871 16708 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:45.805977 12625 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:45.771816 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.772961 16945 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.773316 17055 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:45.811101 17055 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:45.773795 12700 raft_consensus.cc:2393] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:45.723577 17231 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:25:45.742825 17351 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:45.812762 17351 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:45.787074 17346 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.731645 17329 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.815631 17329 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:45.733436 17277 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.817817 12632 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:45.803824 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.821707 12630 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:45.797284 17314 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:45.823151 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.824518 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.825613 17169 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:45.826494 17169 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:45.827010 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.826926 17169 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.829660 17169 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.833220 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.836433 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.837245 12631 raft_consensus.cc:2410] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:25:45.841827 17277 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:45.841975 17276 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:45.850050 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.879276 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:45.852643 12703 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.880491 12630 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:45.853127 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.884109 12671 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.861591 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.851488 12523 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.888051 12631 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.877724 12700 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:45.880100 12522 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.891942 12706 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.892140 12671 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.894447 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:45.899919 16961 raft_consensus.cc:2804] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:45.900518 16961 raft_consensus.cc:697] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:45.901517 16961 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:45.903450 12505 auto_rebalancer.cc:893] Removing replace marker failed: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:45.903895 12505 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:25:45.904176 12505 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:25:45.916525 12631 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:45.891036 17057 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.894635 17278 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:45.922746 17057 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.893532 17269 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:45.904770 17346 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.928133 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.886411 17283 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:45.937237 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.936940 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.938824 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:45.939790 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.943116 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:45.938321 17158 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:45.943924 12708 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:45.930510 17057 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.934110 17347 raft_consensus.cc:2804] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:45.955857 17329 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:45.956372 17329 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:45.956791 17329 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:45.955329 17351 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:45.971275 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.975772 12522 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.977521 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:45.992959 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.995477 12522 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.999689 12671 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:45.937443 17278 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:46.009445 12522 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:46.019917 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:46.020826 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:45.973495 17266 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:46.025687 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:45.973809 17074 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:46.011570 17276 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.011410 17295 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:46.011749 17041 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:46.001013 17347 raft_consensus.cc:697] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:46.010979 17273 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.955332 17169 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.062062 17347 consensus_queue.cc:237] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.063446 17169 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:46.065500 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:46.068810 17365 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.449s	user 0.002s	sys 0.004s
I20260709 12:25:46.069519 17278 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.040997 17294 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:46.037487 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.038527 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.015894 17251 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:46.041778 17276 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.047302 17286 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:45.990062 17269 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:46.023958 17344 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:46.094875 12555 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:46.050868 17055 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.052335 17283 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:46.032249 17074 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.036948 17330 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:46.079769 13230 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:46.084821 16708 consensus_queue.cc:1059] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:46.088080 17251 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:46.088487 17273 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.093690 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.096210 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.189860 13232 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:46.098093 12550 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.140275 12551 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:25:46.144572 12704 raft_consensus.cc:1240] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:46.146070 12554 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:46.207423 12555 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.242056 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.146796 17074 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.150182 17330 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.142549 17286 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:46.149856 17344 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.261396 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:46.263581 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:46.277325 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 257518us
I20260709 12:25:46.247633 17273 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.286765 12555 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:46.287631 16856 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:46.288813 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.298811 12557 raft_consensus.cc:2393] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
W20260709 12:25:46.290396 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 254722us
W20260709 12:25:46.290572 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 268329us
I20260709 12:25:46.302414 13199 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:46.325055 12557 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:46.310297 17080 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:46.329790 17169 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:46.331115 17269 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:46.331645 17269 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:46.310495 17010 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.324604 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.268283 17254 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:25:46.271924 17344 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.358624 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:46.368762 12629 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55098 (request call id 2317) took 2076 ms (client timeout 1618 ms). Trace:
W20260709 12:25:46.369285 12629 rpcz_store.cc:269] 0709 12:25:44.292182 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.292316 (+   134us) service_pool.cc:224] Handling call
0709 12:25:46.368566 (+2076250us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b5400116a54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:46.368681 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1673914240}
I20260709 12:25:46.371475 12558 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2506) took 1101 ms. Trace:
W20260709 12:25:46.378218 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.379385 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:46.382913 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.332768 17269 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.286175 17055 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.372064 12558 rpcz_store.cc:276] 0709 12:25:45.269953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.359390 (+ 89437us) service_pool.cc:224] Handling call
0709 12:25:45.359883 (+   493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:45.369440 (+  9557us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:45.369477 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:46.072359 (+702882us) spinlock_profiling.cc:243] Waited 3.55 ms on lock 0x7b2c00033668. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:25:46.072726 (+   367us) log.cc:844] Serialized 26 byte log entry
0709 12:25:46.186985 (+114259us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:46.187018 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.187085 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.371099 (+184014us) raft_consensus.cc:1685] finished
0709 12:25:46.371127 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.371397 (+   270us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4007,"raft.queue_time_us":9053,"raft.run_cpu_time_us":8723,"raft.run_wall_time_us":41640,"spinlock_wait_cycles":8158080,"thread_start_us":113969,"threads_started":1,"wal-append.queue_time_us":249802}
I20260709 12:25:46.311334 16856 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.406773 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.407895 12557 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
W20260709 12:25:46.402897 17370 log.cc:927] Time spent T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.143s	user 0.001s	sys 0.001s
I20260709 12:25:46.417197 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.325551 17286 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.419003 12557 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:46.290911 17251 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.423344 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.453212 12554 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:46.386927 17169 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:46.430306 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:46.434909 17273 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:46.435909 17374 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:46.436540 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:46.437008 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.401525 17057 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.439973 17074 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.440320 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.441743 13235 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:25:46.441658 17329 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.442557 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.444622 12558 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:46.452132 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 173943us
W20260709 12:25:46.424510 17312 log.cc:927] Time spent T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 1.823s	user 0.008s	sys 0.014s
I20260709 12:25:46.412997 17269 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:46.441726 16708 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.438815 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:46.473909 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 212579us
I20260709 12:25:46.475485 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:46.489543 12553 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:46.490662 12708 raft_consensus.cc:1240] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:46.494951 12632 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:46.496492 12632 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:46.468325 17273 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:46.497653 12632 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.469889 17276 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.506011 12632 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.512234 12704 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2314) took 1314 ms. Trace:
I20260709 12:25:46.496790 17347 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:46.509802 17387 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:25:46.519305 12704 rpcz_store.cc:276] 0709 12:25:45.197917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.198790 (+   873us) service_pool.cc:224] Handling call
0709 12:25:45.217735 (+ 18945us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:46.192310 (+974575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.511992 (+319682us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b54002a1054. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:46.512176 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130852096}
I20260709 12:25:46.542512 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:46.543056 12699 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.503455 17346 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:46.527275 17375 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:25:46.528134 17329 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.528555 17332 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.508320 17254 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.536274 17392 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:46.537333 13227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 1023) took 1757 ms. Trace:
I20260709 12:25:46.569357 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:46.576301 13235 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.538147 16856 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:46.541728 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:46.541138 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:46.543524 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:46.526633 17384 log.cc:927] Time spent T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:25:46.544075 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 95414.9us
I20260709 12:25:46.548702 12626 raft_consensus.cc:3055] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:46.551630 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.589380 12626 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:46.491834 16708 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.568976 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:46.591048 12625 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.574980 13227 rpcz_store.cc:276] 0709 12:25:44.764734 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.766766 (+  2032us) service_pool.cc:224] Handling call
0709 12:25:44.767097 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:44.991864 (+224767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:44.991909 (+    45us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:45.001698 (+  9789us) log.cc:844] Serialized 26 byte log entry
0709 12:25:45.155236 (+153538us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:45.155375 (+   139us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.512509 (+1357134us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b540054fe54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:46.512558 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:46.512624 (+    66us) raft_consensus.cc:1685] finished
0709 12:25:46.512643 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:46.522409 (+  9766us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27409,"raft.queue_time_us":21314,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":19378,"spinlock_wait_cycles":332337920,"thread_start_us":105021,"threads_started":1,"wal-append.queue_time_us":197347,"wal-append.run_cpu_time_us":1464,"wal-append.run_wall_time_us":1030231}
I20260709 12:25:46.552809 12558 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:46.522424 17347 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:46.569190 12557 raft_consensus.cc:1240] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: [13.7-13.7]
I20260709 12:25:46.595798 12704 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:46.508992 17276 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:46.571754 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45087.7us
I20260709 12:25:46.571494 12556 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:46.604086 12556 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:46.543569 17344 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:46.604478 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.573732 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.505234 17273 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.553829 12633 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:46.595330 12626 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.598028 17347 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.620913 12626 raft_consensus.cc:3060] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:46.569854 17346 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.579226 17254 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.576651 17332 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.651314 17332 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.652453 12628 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:46.653043 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40560 (request call id 1277) took 1393 ms. Trace:
I20260709 12:25:46.656535 12701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2315) took 1457 ms. Trace:
I20260709 12:25:46.656898 12701 rpcz_store.cc:276] 0709 12:25:45.199151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.199285 (+   134us) service_pool.cc:224] Handling call
0709 12:25:45.218137 (+ 18852us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.278792 (+ 60655us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.656314 (+1377522us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b54003ec1d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:46.656476 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":106852608}
I20260709 12:25:46.660660 17379 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:46.661010 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:46.619182 17169 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 12:25:46.631053 12625 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:46.642524 16708 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.677474 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:46.672524 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.688438 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:46.689203 12702 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 8: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:46.661392 17379 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:46.653326 12628 rpcz_store.cc:276] 0709 12:25:45.259495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.263468 (+  3973us) service_pool.cc:224] Handling call
0709 12:25:46.651935 (+1388467us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b5800032798. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:25:46.652130 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.652821 (+   691us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.652991 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5485952}
I20260709 12:25:46.694410 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:46.615432 17314 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.065s
I20260709 12:25:46.698634 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:46.700912 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.701332 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:46.697384 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:46.669903 17339 raft_consensus.cc:3055] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:46.666929 17346 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.705709 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.665320 17273 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:46.664371 17057 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:46.668118 17276 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.710536 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:46.681627 17397 consensus_queue.cc:1059] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:46.699826 17329 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:46.729120 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 132631us
W20260709 12:25:46.730376 12454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 223) took 19535 ms (client timeout 15000 ms). Trace:
I20260709 12:25:46.706213 17339 raft_consensus.cc:740] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:46.761873 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:46.772105 13232 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:46.777673 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.779398 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:46.783828 13234 raft_consensus.cc:1240] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:46.728302 16708 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:46.789160 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:46.790315 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 67542.5us
I20260709 12:25:46.727653 16968 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:46.775467 17379 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.813592 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.838827 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.840991 13234 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
W20260709 12:25:46.846447 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:46.846227 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 150719us
I20260709 12:25:46.780653 17293 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:46.849834 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.786370 17057 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.795629 17345 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:46.791900 17403 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.847070 16209 consensus_queue.cc:1048] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
W20260709 12:25:46.858759 12525 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.817902 16968 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.792238 16708 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:46.791746 17156 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:46.867089 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:46.791663 17402 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:46.846725 17273 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:46.730908 12454 rpcz_store.cc:269] 0709 12:25:27.193705 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.218261 (+ 24556us) service_pool.cc:224] Handling call
0709 12:25:46.723985 (+19505724us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:42.802236 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:42.858935 (+ 56699us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:42.858982 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:25:42.859014 (+    32us) tablet.cc:662] Decoding operations
0709 12:25:42.925537 (+ 66523us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:42.925655 (+   118us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:42.925685 (+    30us) tablet.cc:685] Acquiring locks for 18 operations
0709 12:25:42.927142 (+  1457us) tablet.cc:701] Row locks acquired
0709 12:25:42.927188 (+    46us) write_op.cc:260] PREPARE: finished
0709 12:25:42.927356 (+   168us) write_op.cc:270] Start()
0709 12:25:42.927510 (+   154us) write_op.cc:276] Timestamp: P: 1783599942927294 usec, L: 0
0709 12:25:42.927551 (+    41us) op_driver.cc:348] REPLICATION: starting
0709 12:25:42.930051 (+  2500us) log.cc:844] Serialized 7001 byte log entry
0709 12:25:43.759489 (+829438us) op_driver.cc:464] REPLICATION: finished
0709 12:25:43.869424 (+109935us) write_op.cc:301] APPLY: starting
0709 12:25:43.869528 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:43.921105 (+ 51577us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:43.921221 (+   116us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:44.069674 (+148453us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:44.070087 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0709 12:25:44.070148 (+    61us) write_op.cc:312] APPLY: finished
0709 12:25:44.165430 (+ 95282us) log.cc:844] Serialized 164 byte log entry
0709 12:25:44.165633 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:44.165789 (+   156us) write_op.cc:454] Released schema lock
0709 12:25:44.165872 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:44.166456 (+   584us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:44.166503 (+    47us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7102130,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":109604,"apply.run_cpu_time_us":24991,"apply.run_wall_time_us":296963,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79511,"num_ops":18,"prepare.queue_time_us":367010,"prepare.run_cpu_time_us":33878,"prepare.run_wall_time_us":371049,"raft.queue_time_us":498421,"raft.run_cpu_time_us":6605,"raft.run_wall_time_us":67242,"replication_time_us":831769,"spinlock_wait_cycles":75520,"thread_start_us":850586,"threads_started":4,"wal-append.queue_time_us":247995,"wal-append.run_cpu_time_us":119084,"wal-append.run_wall_time_us":2004259}]]}
I20260709 12:25:46.851930 17396 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:46.883873 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 122097us
I20260709 12:25:46.884820 13235 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:46.870323 17379 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:46.889720 17401 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:25:46.866333 16856 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:25:46.875188 17294 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:46.895597 17294 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.869712 17404 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:25:46.898619 17404 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:46.883055 17010 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.549s	user 0.010s	sys 0.001s
W20260709 12:25:46.903785 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 63396.7us
I20260709 12:25:46.905558 12632 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:46.906359 12600 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:46.907155 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 58704us
I20260709 12:25:46.911757 16968 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:46.912405 17254 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.913074 16708 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.914261 16708 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:46.925132 12699 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:46.928220 17413 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.928833 17413 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.881318 17057 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.938001 12600 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:46.916476 17010 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:46.884564 17402 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.873714 17339 consensus_queue.cc:260] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.887457 17273 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:46.948400 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46622.4us
I20260709 12:25:46.881138 17403 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.933804 17413 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:46.947196 17330 consensus_meta.cc:287] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.685s	user 0.014s	sys 0.000s
I20260709 12:25:46.956514 17339 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.963127 17402 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.965626 17368 raft_consensus.cc:3055] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:46.966058 17368 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:46.954779 17330 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:46.979092 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:46.977082 17329 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:46.979754 17330 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:46.980691 17329 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:46.981711 17415 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:46.985142 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:46.986924 17409 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:46.992630 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:46.993832 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:46.995379 17074 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:46.997399 17169 consensus_queue.cc:1059] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:25:46.998040 12705 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2319) took 1542 ms. Trace:
I20260709 12:25:46.998423 12705 rpcz_store.cc:276] 0709 12:25:45.455270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.464000 (+  8730us) service_pool.cc:224] Handling call
0709 12:25:45.464273 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.598603 (+134330us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.997811 (+1399208us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003ed0d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:46.997983 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297577728}
I20260709 12:25:46.999691 17254 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.000296 17392 consensus_queue.cc:1059] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:47.001101 17332 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:47.001533 17392 raft_consensus.cc:3055] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.001770 17057 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.001924 17392 raft_consensus.cc:740] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:46.999804 17286 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:46.997690 16961 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:47.000496 17254 consensus_queue.cc:1059] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:46.986956 12706 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2318) took 1532 ms. Trace:
I20260709 12:25:47.006421 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:47.009593 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:47.016326 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:47.017808 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1038) took 1003 ms. Trace:
W20260709 12:25:47.022675 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 84793.9us
I20260709 12:25:47.024087 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:46.976969 17418 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:46.975119 17413 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:47.028963 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.002827 17392 consensus_queue.cc:260] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.019071 13226 rpcz_store.cc:276] 0709 12:25:46.014167 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.014289 (+   122us) service_pool.cc:224] Handling call
0709 12:25:46.031769 (+ 17480us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:46.290164 (+258395us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:46.290193 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:46.797953 (+507760us) spinlock_profiling.cc:243] Waited 10 ms on lock 0x7b2c000fb4a8. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:25:46.798433 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:25:46.874553 (+ 76120us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:46.874610 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.874673 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:47.005342 (+130669us) raft_consensus.cc:1685] finished
0709 12:25:47.005360 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:47.017751 (+ 12391us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":13427,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":113,"spinlock_wait_cycles":23009152,"thread_start_us":330089,"threads_started":2,"wal-append.queue_time_us":129220}
I20260709 12:25:47.018456 12706 rpcz_store.cc:276] 0709 12:25:45.454955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.455066 (+   111us) service_pool.cc:224] Handling call
0709 12:25:45.455346 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:45.904472 (+449126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:46.986718 (+1082246us) spinlock_profiling.cc:243] Waited 436 ms on lock 0x7b54002a1f54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:46.986886 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1003447552}
I20260709 12:25:46.977077 17402 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.036638 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.034178 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.034996 12705 raft_consensus.cc:1240] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.038513 17313 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:47.049628 12707 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.051203 17392 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.029920 16961 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.028988 17114 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:47.054219 17114 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.054595 17114 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.003477 17158 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:47.001574 17332 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:47.000358 17403 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.014269 17286 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:47.059360 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 75435.4us
I20260709 12:25:47.041998 12600 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:47.065896 13235 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:47.061743 17286 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.032967 17409 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:47.070483 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.032299 17413 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:47.077879 17273 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.078269 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.079975 17276 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:47.059866 17254 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:47.103439 17332 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.104574 17332 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:47.060027 17158 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.107491 17396 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.109977 17413 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.111224 17413 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.113965 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.115134 12553 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2510) took 1844 ms. Trace:
I20260709 12:25:47.115624 12553 rpcz_store.cc:276] 0709 12:25:45.270867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.050913 (+780046us) service_pool.cc:224] Handling call
0709 12:25:46.051204 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.490090 (+438886us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.114814 (+624724us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b54001d10d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:47.115056 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1007628672}
I20260709 12:25:47.093555 17342 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.121493 17347 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.124699 17347 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.125525 12703 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:47.055689 16961 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.028036 17314 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:25:47.099406 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.063535 17416 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:47.101752 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.141158 13201 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:47.101500 17418 consensus_queue.cc:1059] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:47.102927 12701 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:47.117173 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:47.128293 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 86343.6us
I20260709 12:25:47.153733 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:47.069517 17346 raft_consensus.cc:3055] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.139809 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:47.154706 13226 raft_consensus.cc:606] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:47.154772 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.151192 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:47.156469 12559 raft_consensus.cc:2393] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:47.155629 12553 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:47.158926 12559 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:47.159430 12553 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:47.160297 12559 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:25:47.160679 12559 pending_rounds.cc:85] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 8
I20260709 12:25:47.160953 12559 pending_rounds.cc:107] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:25:47.161484 17346 raft_consensus.cc:740] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:47.161700 12553 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:47.162441 17346 consensus_queue.cc:260] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.164016 17346 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.161217 12559 raft_consensus.cc:2889] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.169397 17041 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:47.171706 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:47.184021 17074 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:47.185277 16961 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:47.142437 17416 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:47.190909 17416 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.170326 17041 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:47.192904 17041 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:47.176244 17402 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:25:47.195619 17114 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.172698 17396 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:47.198081 17396 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:47.198575 17396 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.202242 17418 raft_consensus.cc:3055] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:47.202798 17418 raft_consensus.cc:740] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:47.203919 17418 consensus_queue.cc:260] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:47.205922 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52271.8us
W20260709 12:25:47.207319 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66292.6us
I20260709 12:25:47.208019 17414 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.221918 17424 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:47.222577 17424 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.222998 17424 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.143596 17294 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:47.236449 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.177922 17330 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.224821 17286 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.237550 17402 consensus_queue.cc:1059] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:47.255739 17402 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:47.256246 17402 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.257092 17419 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.257661 17419 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.260202 17114 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.266878 17286 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:47.240533 17418 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.268929 12699 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:47.269428 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.270956 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.272284 12633 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:47.273137 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.278329 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.278666 12634 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
W20260709 12:25:47.279084 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.280557 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.270015 13201 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:47.286664 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.286998 12625 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 10 index: 5. (index mismatch)
I20260709 12:25:47.288130 17419 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:47.293287 17368 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.297730 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.297745 12522 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:47.310751 12701 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:47.298511 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.240031 17330 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:47.299814 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.305013 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.330156 12626 raft_consensus.cc:2376] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10. Re-sending same reply.
I20260709 12:25:47.330346 12632 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:47.332790 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:47.308710 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.309604 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.312420 12557 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:25:47.307679 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 4 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.312798 12630 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:47.313380 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.296829 17396 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.299182 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:47.250969 17389 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:25:47.339216 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:47.342602 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:25:47.344907 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 74966.3us
I20260709 12:25:47.344836 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.355039 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:47.349666 12557 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
W20260709 12:25:47.363835 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.358892 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:47.382548 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.336607 17419 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.333623 17169 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.353346 17368 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:47.391971 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.392139 12625 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:47.401860 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48586.4us
I20260709 12:25:47.379153 17273 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:47.358489 17413 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:47.378942 17311 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:47.405562 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.340896 17332 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:25:47.385761 17055 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:47.421241 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:47.422005 13230 raft_consensus.cc:606] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:47.426472 17345 consensus_meta.cc:287] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.553s	user 0.010s	sys 0.000s
I20260709 12:25:47.427688 17345 raft_consensus.cc:993] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:25:47.426518 17417 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:25:47.429979 17348 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.430186 17345 raft_consensus.cc:1081] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:25:47.430392 17348 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:47.431293 17348 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.438427 17404 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.016s
I20260709 12:25:47.453938 17348 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.454312 17404 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:47.440351 17351 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:47.438086 17158 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.434525 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:47.457803 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:47.458516 17396 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.458782 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:47.434871 13231 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:25:47.452505 16961 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.461479 16961 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:47.466938 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.389977 17429 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:47.501796 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.411149 17311 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:47.464118 16708 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.461479 17342 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.488987 17429 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.462709 12627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:25:47.398089 17419 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.543886 12627 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:47.502084 17402 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:47.407598 17330 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.513099 17311 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.563192 12627 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:47.500204 17396 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:25:47.543089 17403 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.543263 16708 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:47.543212 17429 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.545322 17342 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:47.567135 17425 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
W20260709 12:25:47.577812 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.588981 17055 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.589809 17055 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.597818 17377 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:47.598067 17055 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:47.598366 17377 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.599776 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.600405 12699 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:47.600615 17377 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:47.574011 17403 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.608001 17403 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.607791 17416 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.608896 12634 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:47.610371 17419 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:47.690946 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:47.691821 13226 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:47.581539 17295 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.728793 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.735419 16961 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:47.736507 17428 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.224s	user 0.000s	sys 0.003s
I20260709 12:25:47.736400 16708 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.738430 16708 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.748499 17311 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:47.754371 13231 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50978 (request call id 1167) took 1318 ms (client timeout 1592 ms). Trace:
W20260709 12:25:47.754825 13231 rpcz_store.cc:269] 0709 12:25:46.435751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.436278 (+   527us) service_pool.cc:224] Handling call
0709 12:25:47.754208 (+1317930us) spinlock_profiling.cc:243] Waited 965 ms on lock 0x7b54001987d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:47.754309 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2220123008}
I20260709 12:25:47.755762 17416 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.761931 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.771196 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.771919 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.772356 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:47.773828 12523 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.795722 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.796545 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.800112 12627 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:47.806162 12626 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 15: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:47.805932 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.809535 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.811414 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.813660 13232 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 15: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:47.815016 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:47.825328 12628 raft_consensus.cc:1240] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:47.825930 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 463139us
I20260709 12:25:47.828976 12597 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:47.829368 12634 raft_consensus.cc:1275] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:47.830511 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.815665 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:47.838730 13229 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:47.838980 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:47.839977 12703 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:47.841383 12627 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:47.842420 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.844379 12523 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:47.846004 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1073) took 1527 ms. Trace:
I20260709 12:25:47.846361 12708 rpcz_store.cc:276] 0709 12:25:46.318951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.454978 (+136027us) service_pool.cc:224] Handling call
0709 12:25:46.464697 (+  9719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:46.491167 (+ 26470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.845798 (+1354631us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b54001d6fd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:47.845949 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":59158400}
W20260709 12:25:47.850301 17418 consensus_meta.cc:287] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.582s	user 0.006s	sys 0.005s
I20260709 12:25:47.855692 17402 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:47.856117 17402 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:47.857621 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.859543 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.784832 17055 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:47.860291 17055 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.856851 17402 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.861984 17402 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.862030 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:47.863310 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:47.863546 17158 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:47.864235 17429 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.871773 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:47.872537 12557 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:47.873615 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:47.796705 17397 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:47.882615 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.887426 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:47.891348 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47077.3us
I20260709 12:25:47.893530 17344 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:47.894085 17344 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:47.694155 17424 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:47.902746 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.904641 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:47.768685 17295 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.907048 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.840814 17041 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:47.917837 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:47.918619 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 56877.5us
I20260709 12:25:47.820626 16569 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.087s
I20260709 12:25:47.921044 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:47.917243 12633 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:47.922081 13232 raft_consensus.cc:1240] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:47.878875 17114 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:47.926242 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:47.928244 12633 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:47.931072 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.932610 12631 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:47.933130 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:47.933857 12634 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.937304 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:47.937671 13235 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:47.938982 12600 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:47.940286 12633 pending_rounds.cc:85] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 6
I20260709 12:25:47.940659 12633 pending_rounds.cc:107] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:47.940977 12633 raft_consensus.cc:2889] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.941097 12600 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:47.955022 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 62944.5us
W20260709 12:25:47.943838 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 114947us
I20260709 12:25:47.926223 17418 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.963513 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:47.902333 17397 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.925228 17403 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:25:47.952150 16708 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.943534 17443 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.953125 17314 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.956633 17419 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:47.959981 17404 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.895221 17344 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:47.927709 17041 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.058857 12629 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:47.975749 17276 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:48.030334 17433 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:48.095369 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 166322us
W20260709 12:25:48.097468 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:48.106439 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 161660us
I20260709 12:25:48.107347 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:48.137871 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:48.140599 12671 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:48.130367 17445 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.157s	user 0.005s	sys 0.000s
I20260709 12:25:48.115353 12634 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:48.029618 17443 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.149474 13226 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17.
W20260709 12:25:48.153285 17444 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:25:48.130812 17276 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:48.115964 17313 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.159291 17041 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.115931 17311 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.174695 12628 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:48.183689 12628 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:48.140411 16209 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.177466 17429 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.196605 12557 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:48.198086 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:48.223470 12634 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:48.236260 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 266776us
I20260709 12:25:48.262544 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.212679 16945 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:48.193763 17449 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:48.213397 17295 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.299144 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:48.299168 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.304327 13226 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:48.213963 17313 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:48.222273 17424 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:48.315743 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.316465 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:48.319448 12555 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.249387 16961 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:48.186167 17448 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.137s
I20260709 12:25:48.220752 17456 consensus_queue.cc:1059] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:25:48.196127 16209 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.326526 16209 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.193922 17364 consensus_queue.cc:1059] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 12:25:48.328270 17364 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:48.328688 17364 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:48.329739 17364 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.330937 17364 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.331144 17342 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.331476 12558 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:48.249634 17041 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.332254 17041 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.248445 17268 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.320051 17397 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.314699 17295 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.323515 17449 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:48.311424 16945 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.347513 16945 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:48.348970 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.350093 12559 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:48.291520 17429 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.341461 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 384628us
I20260709 12:25:48.359205 12597 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:48.369180 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.351230 17314 raft_consensus.cc:3055] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:48.374881 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:48.359786 17447 log.cc:927] Time spent T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:48.386686 12555 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:48.377183 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.389384 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:48.384347 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 411622us
I20260709 12:25:48.372176 17397 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.371737 17424 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.366780 17451 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.376682 17419 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:48.401587 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:48.350221 17268 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.379168 17314 raft_consensus.cc:740] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:48.363742 17429 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.391482 17339 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:48.424149 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:48.360579 17295 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.427464 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.427541 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:48.429513 13230 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:48.429862 13230 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:48.431007 13231 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 16. Current term is 17. Ops: [14.10-16.11]
I20260709 12:25:48.432252 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:48.413550 17451 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.414543 17329 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.465106 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.465333 12597 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:48.458969 13235 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:25:48.466327 13230 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.470243 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:48.445104 17402 consensus_meta.cc:287] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.583s	user 0.010s	sys 0.002s
I20260709 12:25:48.427428 17419 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:48.479779 13230 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:48.453557 12441 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:48.402179 17397 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.443230 17429 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.447937 17404 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.455299 17449 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.513783 17449 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.516353 17449 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:48.481705 17459 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:48.485954 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 94964.5us
I20260709 12:25:48.518748 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:48.518595 17419 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:48.484411 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 83282.4us
W20260709 12:25:48.489845 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:48.522315 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.524695 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.486065 17339 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:48.525758 12700 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 16. Current term is 17. Ops: []
I20260709 12:25:48.527066 12699 raft_consensus.cc:2410] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:48.453722 17424 consensus_queue.cc:1059] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:48.483824 17467 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.533473 13230 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
W20260709 12:25:48.509513 17461 log.cc:927] Time spent T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.120s	user 0.001s	sys 0.000s
W20260709 12:25:48.510437 17463 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:25:48.511785 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:48.424225 17457 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.531590 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.623013 12703 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:48.507984 17451 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.535120 12597 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:48.535753 12627 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:48.540372 17344 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.540534 17397 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.540799 17470 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:48.543224 17472 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:48.424633 17443 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.544648 17295 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.486925 17314 consensus_queue.cc:260] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.468890 17329 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.534305 17449 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.545831 16961 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:48.495137 17460 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 12:25:48.546293 17339 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:48.546681 17041 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.539188 17467 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.548178 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.551432 17441 raft_consensus.cc:3055] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:48.574882 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.582666 17364 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.662106 17460 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:48.662689 17364 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.586943 17330 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.540688 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.538836 17424 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:48.598914 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.669977 12626 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:48.599202 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:48.605844 13201 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.594234 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:48.618628 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.674641 17339 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.680124 17329 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.620302 12629 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:48.681732 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 141206us
I20260709 12:25:48.606508 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.682356 17460 raft_consensus.cc:2764] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:48.682545 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:48.682747 12559 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:48.683144 17460 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:25:48.624987 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.683387 17379 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:48.683631 17460 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:48.684041 17379 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:48.684290 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.684597 17460 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.685104 17379 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.686087 17460 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.658118 17397 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:48.655920 16961 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:48.644605 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 109658us
I20260709 12:25:48.655606 17449 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.649343 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.692196 12699 raft_consensus.cc:2393] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:48.603008 17366 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.693439 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.594730 17055 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.603127 17347 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.632387 17344 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.605206 17456 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:48.658142 12523 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:48.660084 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.717199 12703 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:48.661230 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.659550 17441 raft_consensus.cc:740] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:48.672056 17364 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.589330 17268 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:48.696255 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.724498 12559 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:48.695013 17424 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.694012 17366 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.699254 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.730705 13226 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:48.705396 12600 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:48.732580 12600 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:48.709476 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:48.721675 12674 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:48.690014 17397 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:48.716331 17344 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.751209 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:48.743031 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 84954.4us
I20260709 12:25:48.749200 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.746614 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:48.716712 17472 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.765076 16961 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:48.742449 17424 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.769572 17470 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:48.770484 17424 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.771987 17467 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.772409 17332 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:48.773679 17449 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.776803 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.777478 12625 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:25:48.722319 17456 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.778501 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:48.778738 17366 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:48.779084 12632 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:48.779937 17456 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.780747 17441 consensus_queue.cc:260] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.781797 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.754483 17055 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.782939 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.783403 12630 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:48.719043 17347 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.784482 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.785115 12626 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:48.785432 17347 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:48.786131 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.787958 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.788584 13226 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
W20260709 12:25:48.790223 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 54379.8us
I20260709 12:25:48.791603 12632 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 17.
W20260709 12:25:48.793473 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46969us
I20260709 12:25:48.794490 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.787336 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:48.797072 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.798527 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.800508 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:48.802186 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.804181 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.806061 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.807622 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.809048 12702 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:48.811655 12598 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.812484 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.813248 12550 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 16.
I20260709 12:25:48.813280 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.814903 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.818423 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.818463 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:48.821754 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.822952 12674 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:48.828259 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.828730 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:48.829245 12626 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:48.829535 12703 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.822348 12705 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 15.
I20260709 12:25:48.836063 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.836786 12699 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:25:48.755595 16708 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.755272 17457 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:48.755452 17377 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:48.752950 17392 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:48.844617 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:48.844906 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.854689 12631 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:48.831781 17313 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:48.847249 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.866235 12704 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:25:48.823756 17055 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:48.844643 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:48.858832 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.839164 17429 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:48.857456 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:48.843133 16708 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.830614 17416 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:48.823860 17276 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:48.838781 17459 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.856451 16917 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:48.851992 16209 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.848572 17377 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.877974 17403 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:48.912247 12703 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:25:48.868033 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:48.879853 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:48.859647 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:48.857120 17457 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:48.921927 17156 raft_consensus.cc:993] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:48.865852 17313 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.868196 17055 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.914116 17329 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:48.882582 16708 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:48.879117 17158 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:25:48.932018 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 52266.2us
I20260709 12:25:48.880999 17331 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.783231 17397 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:48.933516 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 65554.3us
I20260709 12:25:48.923024 16917 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:48.946013 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.928349 17377 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:48.947636 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:48.950513 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.958041 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.937943 17443 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:48.976601 12632 raft_consensus.cc:2410] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 15 because replica has last-logged OpId of term: 13 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:48.941031 17074 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:48.979660 17074 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.980093 17074 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.943041 17313 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:48.982203 17482 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:25:48.982986 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:48.983994 12452 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 6 to 10, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:48.987031 12452 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:48.988811 12627 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2703) took 1130 ms. Trace:
I20260709 12:25:48.993927 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:48.993131 17377 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:48.954639 17331 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.943634 16976 raft_consensus.cc:1081] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:48.948998 17158 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:48.943267 17055 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:48.928013 16209 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.023301 17330 consensus_queue.cc:1048] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:49.023727 17377 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:48.997965 17483 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:49.024451 16209 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:48.946556 17329 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.025233 17329 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.997337 17074 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:48.993153 16917 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.026530 13230 raft_consensus.cc:2393] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 16: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:49.027199 17074 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.026566 16917 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.022248 17331 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.003468 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.033821 17329 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.033978 16708 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.041195 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:49.041910 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.041980 13226 raft_consensus.cc:606] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.042488 13226 raft_consensus.cc:614] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.042595 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.021215 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.022225 17158 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.024801 17456 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.999378 17457 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.036239 17329 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.005204 12627 rpcz_store.cc:276] 0709 12:25:47.858021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.930778 (+ 72757us) service_pool.cc:224] Handling call
0709 12:25:48.988642 (+1057864us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b5400343ad4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:48.988750 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1276164480}
I20260709 12:25:49.038425 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.020179 12522 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.043115 12550 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 16.
I20260709 12:25:49.044438 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.045162 17331 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.057991 17332 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.058099 12703 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:25:49.058574 17332 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.046936 17344 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.048218 13198 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.040211 17074 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.049077 17456 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.062937 16708 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.063596 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
W20260709 12:25:49.068737 12600 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.068643 17074 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.018898 17339 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.049755 17432 log.cc:927] Time spent T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.101s	user 0.000s	sys 0.004s
I20260709 12:25:49.071376 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.072129 12552 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.076009 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.076686 12628 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:49.076973 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 214583us
I20260709 12:25:49.080063 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.080262 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.080382 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.055080 16961 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.083016 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.083436 12626 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:49.083575 12629 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.065469 17344 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.071163 17392 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:49.069427 17347 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:49.094631 12632 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:49.073917 17467 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:49.096472 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:49.103210 13226 raft_consensus.cc:606] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.103399 13198 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.103715 13226 raft_consensus.cc:614] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.105535 12552 raft_consensus.cc:2468] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:25:49.095696 12522 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.099532 12708 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:49.079311 17379 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:49.098093 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.108012 12600 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:49.059496 17332 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.107290 12708 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:49.114341 12708 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:49.112016 12629 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:49.112788 12704 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:49.113385 16708 raft_consensus.cc:2804] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:49.096976 12628 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:49.115535 16708 raft_consensus.cc:697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:49.097715 17166 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:49.111874 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:49.097687 17490 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:49.079532 17339 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.097817 17472 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:49.116703 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 52027.4us
I20260709 12:25:49.116313 16708 consensus_queue.cc:237] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.126884 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.141906 17472 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:49.145061 17472 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.113687 17379 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.146996 12627 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:49.147585 17339 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.147835 17379 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.145133 17074 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:49.143677 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.149681 17441 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.152040 17363 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:49.152563 17363 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:49.153044 17363 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:49.154423 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58825.5us
I20260709 12:25:49.116083 17392 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.156811 12522 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:49.154592 17295 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:49.159088 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.160094 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.119122 17166 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.163371 12522 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:49.130568 17156 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.110565 17467 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.170260 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.169195 17166 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.173252 17495 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:49.175098 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.176203 17491 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:49.176550 17491 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.176858 17491 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:49.178301 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.179095 17448 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:49.179394 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.179632 17448 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:49.180155 17448 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.180576 17041 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:49.181232 17041 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:49.166564 17295 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.182600 17344 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:49.183246 17344 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.183795 17330 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:49.184366 17344 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.186709 17476 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:49.187402 17476 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.188200 12708 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.188268 17476 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.186431 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.190343 17330 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.190840 17330 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.191689 17330 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.202513 17456 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:49.166625 17377 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:49.205184 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:49.206189 13226 raft_consensus.cc:2393] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:49.208984 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.209666 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.210858 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.156504 17364 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:49.215408 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:49.212806 17074 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.223093 17331 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.225225 17456 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:49.225800 17456 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.226105 17467 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.226928 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.226680 17456 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.227672 12628 raft_consensus.cc:2393] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:49.213204 17377 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.235380 17392 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.242697 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.244293 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.244927 12552 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:49.245041 13226 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:49.246524 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.246984 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:49.247098 12555 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:49.250475 17339 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:49.253508 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.254141 12629 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:49.254603 12628 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:49.255805 12708 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.259389 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:49.170159 17273 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.075s
I20260709 12:25:49.214154 17364 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.270624 12700 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:49.113924 12452 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.273993 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.276396 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.299353 12705 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.277561 12704 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:49.286507 17491 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.263530 17169 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:25:49.294029 17449 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:49.310570 17449 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.290541 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.310976 17449 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.292340 17313 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.313315 17313 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:49.290549 17377 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.294085 12703 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:49.268675 17364 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.308574 12671 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.318125 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.335183 12671 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.323971 12705 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:49.326604 16708 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.342944 16708 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.343245 13234 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:49.304361 17339 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.375172 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.375454 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.375953 12629 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:49.378846 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.384869 16708 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.335358 17441 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.391148 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 124599us
I20260709 12:25:49.393198 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.399380 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.399821 12629 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:49.400054 12630 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.363345 17366 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:49.366621 17347 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:49.363564 17114 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.405627 12559 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:49.306941 17055 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:49.409183 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 149881us
I20260709 12:25:49.366117 17476 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.370187 17491 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.410907 12674 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:49.335675 17460 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260709 12:25:49.419574 12550 raft_consensus.cc:1240] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:25:49.421916 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:49.422533 13235 raft_consensus.cc:606] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.422914 13235 raft_consensus.cc:614] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.423841 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.424613 12552 raft_consensus.cc:3060] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.434725 12552 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:25:49.401568 17467 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.344595 17166 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:49.440093 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.440490 13235 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:49.449782 17166 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 17 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.421005 17332 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.443380 12674 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:49.450246 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.381811 17451 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:49.453897 12558 raft_consensus.cc:2368] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.455142 12552 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.385835 17339 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.405297 17470 consensus_queue.cc:1059] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260709 12:25:49.403551 17273 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:25:49.463223 12630 raft_consensus.cc:2468] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:25:49.459904 17332 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.472060 17158 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.472590 17332 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.439754 17347 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:49.468237 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:49.473556 12699 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:25:49.473982 13235 raft_consensus.cc:606] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.474368 13235 raft_consensus.cc:614] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.405967 17441 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.416529 17114 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.473603 17347 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.478016 17156 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:49.440999 12452 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:49.457144 17502 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260709 12:25:49.482064 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.468855 12552 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 17.
W20260709 12:25:49.481810 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 66723.2us
I20260709 12:25:49.422278 17443 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:25:49.419844 17476 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.505502 17404 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:49.459815 17313 raft_consensus.cc:2804] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:49.487484 12634 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:49.506511 17313 raft_consensus.cc:697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.506893 17476 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.494460 17397 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.507426 17313 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.507579 17397 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.509753 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.510380 12705 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.510445 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.510953 17158 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.499048 17055 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.500797 17114 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.500051 12452 catalog_manager.cc:5697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.533293 12452 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.535576 17364 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.501796 17363 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.538125 17364 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.538178 17363 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.488843 17347 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.503594 17441 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.509894 13232 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:49.547596 17347 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.499698 17339 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:49.548323 17467 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.518494 12705 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:49.519052 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.549585 12553 raft_consensus.cc:2393] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:49.521929 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.550520 12556 raft_consensus.cc:2368] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17.
I20260709 12:25:49.551344 17295 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.552929 17295 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.557155 17347 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:49.519626 17497 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:25:49.571386 12441 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:49.523265 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:49.524681 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:49.524873 17466 raft_consensus.cc:3055] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:49.525897 17397 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.527940 17448 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.528620 12634 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:25:49.528970 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.530917 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:49.535442 12452 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.514458 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.576424 13235 raft_consensus.cc:606] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.589515 13235 raft_consensus.cc:614] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:49.591730 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.592445 12631 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:49.558091 17499 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260709 12:25:49.595289 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 64464.6us
I20260709 12:25:49.599169 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:49.599828 13235 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:49.600126 13235 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:49.603497 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.600858 13235 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.611174 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.611297 12523 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:49.612105 12553 raft_consensus.cc:3060] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:49.615993 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 92799.4us
I20260709 12:25:49.617727 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:49.608414 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:49.619673 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:49.620659 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:49.581638 17466 raft_consensus.cc:740] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.628353 12707 raft_consensus.cc:1240] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:49.629077 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.633139 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.635030 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.636446 12630 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.636833 12633 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:49.636045 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:25:49.648622 12522 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.607062 17114 raft_consensus.cc:2764] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:25:49.506773 17472 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.637374 17512 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:49.680320 17472 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:49.681566 17506 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
I20260709 12:25:49.664700 17344 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:49.689762 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:49.690490 17448 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:49.690742 17512 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:49.691051 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:49.661522 17055 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:49.691829 17055 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.692139 17364 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.692709 17055 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.692848 17364 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.695257 17364 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.672240 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.690595 13231 raft_consensus.cc:2393] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:49.674270 12630 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:49.700845 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:49.701611 12634 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:49.697800 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.699401 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:49.704402 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:49.705824 12631 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:49.706357 12556 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:25:49.707371 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48761.3us
I20260709 12:25:49.710997 17156 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:49.715334 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.719851 13231 raft_consensus.cc:1240] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 15. Current term is 16. Ops: []
I20260709 12:25:49.710381 12452 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 8 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.735098 12452 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 9 to 13, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 13 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.715224 17472 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.717725 17156 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:49.744163 12631 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:49.747021 12522 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.753157 12522 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:49.711903 17449 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:49.754545 12672 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.698169 17466 consensus_queue.cc:260] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.761281 13231 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:49.741926 17441 consensus_queue.cc:1059] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
W20260709 12:25:49.764878 17523 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:25:49.768339 17314 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.769783 17156 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.750202 12452 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.758034 17276 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:49.784869 12631 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:49.793553 12700 raft_consensus.cc:3060] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:49.781500 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.786684 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.794147 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.794721 12705 raft_consensus.cc:2368] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.755371 17460 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.798542 12556 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:49.744774 17512 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.801543 17441 raft_consensus.cc:3055] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:49.801959 17441 raft_consensus.cc:740] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:49.802734 17441 consensus_queue.cc:260] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.803823 17441 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:49.787190 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.805531 17449 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:49.805815 12699 raft_consensus.cc:2368] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:49.806350 17276 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.807225 17276 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.812126 17460 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.815501 12700 raft_consensus.cc:1275] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:49.817160 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.811275 12452 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 5, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 5 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.817972 12706 raft_consensus.cc:2393] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:49.820086 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:49.820267 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.820642 12554 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.828550 12558 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:49.829849 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.788955 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.831532 12702 raft_consensus.cc:2368] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.831910 12553 raft_consensus.cc:2468] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
W20260709 12:25:49.834153 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 47475.1us
W20260709 12:25:49.832754 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45027.2us
I20260709 12:25:49.836433 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.836977 12554 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:49.837057 12705 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:49.837626 12631 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:49.855960 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:49.856848 12700 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
W20260709 12:25:49.876060 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 45180.8us
I20260709 12:25:49.879158 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.881477 12699 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
W20260709 12:25:49.882098 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.882295 12705 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 17.
I20260709 12:25:49.881579 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:49.895287 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 101907us
I20260709 12:25:49.900276 12554 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:49.900848 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.901046 12598 leader_election.cc:400] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.901443 12625 raft_consensus.cc:1240] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:49.901499 12630 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.901770 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:49.901450 12598 leader_election.cc:403] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:49.893596 13199 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.3:43633 timed out after 1.653s (SENT) [suppressed 8 similar messages]
I20260709 12:25:49.832701 17379 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.910614 12630 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:49.875269 17448 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.909682 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet 28c65936613f4ee89e3dc89d06a91776: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:49.911907 12671 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:49.919466 17286 raft_consensus.cc:2804] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:49.919675 17396 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.919957 17286 raft_consensus.cc:697] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.920966 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:49.892416 17332 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:49.886324 16209 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:49.923239 16209 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.915329 17456 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:49.924443 17456 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.925247 12707 raft_consensus.cc:3055] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:49.925642 12707 raft_consensus.cc:740] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.926364 12707 consensus_queue.cc:260] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.926967 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:49.927278 12707 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.927752 12452 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.930581 12452 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:49.932216 16961 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:49.932670 16961 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.932336 12452 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 7 to 8, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 8 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:49.933524 16961 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.934463 16961 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.935055 12674 leader_election.cc:400] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17.
I20260709 12:25:49.935376 12674 leader_election.cc:403] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.936132 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:49.937451 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:49.937739 17074 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:49.939248 16209 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:49.920867 17286 consensus_queue.cc:237] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.945361 17276 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:49.947271 12452 catalog_manager.cc:5697] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 3 to 9. New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:49.948298 13198 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:49.881116 17470 consensus_queue.cc:1059] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:25:49.954202 12707 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260709 12:25:49.954703 12707 pending_rounds.cc:85] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 7
I20260709 12:25:49.954999 12707 pending_rounds.cc:107] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260709 12:25:49.913466 12598 leader_election.cc:400] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:49.955314 12707 raft_consensus.cc:2889] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:49.955536 12598 leader_election.cc:403] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.878722 17403 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.071s
I20260709 12:25:49.886590 17295 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260709 12:25:49.962683 12600 leader_election.cc:400] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.960824 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:49.965651 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52426.5us
I20260709 12:25:49.967213 12708 raft_consensus.cc:1240] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:49.970497 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:49.945925 17276 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.952656 17330 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17.
I20260709 12:25:49.956099 16209 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:49.975754 16708 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:49.959926 17476 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.962631 17169 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:49.970855 17443 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9.
I20260709 12:25:49.966475 17339 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.953351 17448 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.986714 12598 leader_election.cc:400] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:49.973634 17472 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:49.974031 17379 raft_consensus.cc:3055] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:25:49.977937 16209 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.991889 12598 leader_election.cc:403] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.977108 17418 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:49.984853 17169 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:49.995837 17379 raft_consensus.cc:740] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:49.985273 17449 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:49.975049 17404 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:50.014952 17449 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:49.973923 17158 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:25:50.018548 12705 raft_consensus.cc:2393] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:49.999963 16209 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:50.035247 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet f768a2094f5744cfa0dec019647ccb13: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:25:50.039589 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 78824.8us
W20260709 12:25:50.038895 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52322.9us
I20260709 12:25:49.986115 17476 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.036640 17339 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14.
I20260709 12:25:50.020807 17396 consensus_queue.cc:1048] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:50.016338 17449 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:49.977519 17456 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.114742 12632 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:50.043195 17158 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.117149 12631 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:49.965477 12452 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 6 to 10, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.125990 12625 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
W20260709 12:25:50.141600 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 248025us
I20260709 12:25:50.177289 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:50.184060 13231 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:25:50.192962 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:50.196045 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:50.129578 17158 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.210541 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.212155 12631 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:25:50.214596 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.216171 12625 raft_consensus.cc:2393] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:50.195645 17517 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:50.219300 17344 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:50.229915 17158 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.219894 17448 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:50.203459 17169 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:50.233495 17537 log.cc:927] Time spent T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:25:50.234814 17535 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:25:50.239717 16209 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.198632 17331 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:50.243139 12701 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:50.246966 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.250952 16209 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:50.244894 17531 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.227s	user 0.001s	sys 0.000s
I20260709 12:25:50.243749 17466 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:50.246250 17346 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.261377 12634 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:50.263310 17470 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:50.275172 12705 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:50.283718 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 85959.7us
I20260709 12:25:50.288611 17476 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.317435 13199 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:50.319698 17268 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:50.320648 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:50.321288 12704 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.321851 17055 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:50.322480 17055 consensus_queue.cc:1243] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer 155b5b0a0b6d4b499edfe2797ffa5b91 log is divergent from this leader: its last log entry 13.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:50.324334 12705 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:50.324224 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:50.327081 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 360381us
I20260709 12:25:50.327618 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:50.328213 13226 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:25:50.329347 12631 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:50.333302 12704 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:50.337376 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.338184 12632 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:50.341689 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.279206 17346 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.346975 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:50.281472 17424 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260709 12:25:50.355182 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:50.355942 13234 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:50.350062 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:50.351541 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:50.353170 13226 pending_rounds.cc:85] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 9
I20260709 12:25:50.359169 13226 pending_rounds.cc:107] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 13.10
I20260709 12:25:50.359457 13226 raft_consensus.cc:2889] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.361349 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:50.326475 17517 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.364809 17055 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:50.370926 17055 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.371294 17055 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:50.374919 12701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33230 (request call id 1099) took 1554 ms (client timeout 1653 ms). Trace:
W20260709 12:25:50.375406 12701 rpcz_store.cc:269] 0709 12:25:48.820049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.822167 (+  2118us) service_pool.cc:224] Handling call
0709 12:25:50.374714 (+1552547us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54003ebcd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:50.374828 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3152713600}
I20260709 12:25:50.363955 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:50.364368 16917 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:50.382877 17505 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:25:50.367549 17360 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:50.360136 17512 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:25:50.387869 17404 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.396318 16961 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:50.397604 17546 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:50.397436 17404 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.389125 17379 consensus_queue.cc:260] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.400496 17379 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:50.368583 17517 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.405583 17517 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:50.417248 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet 700a61b9aeed45869b2d882368e99824: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:50.426901 17470 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.427459 17470 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.427955 17404 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.396590 16917 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:50.429883 16917 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.430557 17451 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:50.449198 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.452744 12627 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17.
I20260709 12:25:50.465456 17378 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:50.467867 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet c12120af627b4866b9f483d6cd9f30f5: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:25:50.468421 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 107141us
I20260709 12:25:50.451577 17346 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.473189 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:50.474226 12705 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:50.476655 12702 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:50.486140 17466 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:50.486671 17466 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.487126 17466 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:50.486492 17055 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.492293 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:50.500718 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:50.501425 12630 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.487634 17378 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.504267 17378 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:50.505357 17276 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.509145 12629 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:50.510756 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:50.513885 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:50.514720 13234 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:50.522078 12700 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:50.522639 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:50.522078 12704 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:50.529804 12700 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:25:50.472433 17404 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.543519 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.544111 12631 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:50.548883 12630 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:50.534232 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:50.537144 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:50.554471 13227 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:50.551183 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:50.559127 17467 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:50.559695 17467 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:50.559864 17495 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:50.560545 17495 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.560998 17495 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.576182 17495 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.582155 12671 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:50.499498 17470 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:50.560070 17467 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:50.601805 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 69538.3us
I20260709 12:25:50.604866 12625 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:50.607203 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.507747 17448 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.094s
I20260709 12:25:50.532100 16945 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:50.621982 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:50.608335 17449 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:50.556383 17404 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.632360 16209 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:50.632449 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:50.647730 13235 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.649926 12625 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:25:50.650316 12625 pending_rounds.cc:85] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Aborting all ops after (but not including) 10
I20260709 12:25:50.650542 12625 pending_rounds.cc:107] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:25:50.650768 12625 raft_consensus.cc:2889] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.650933 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.651281 12557 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:25:50.655009 17114 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:50.642481 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:50.667107 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.670939 16976 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:50.671370 12553 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:50.675405 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:50.677568 17166 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:50.671396 16976 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.679137 16976 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.664222 17332 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:50.682147 17055 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.686816 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:50.684949 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:50.691927 13235 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:50.703073 13235 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1073) took 1104 ms. Trace:
I20260709 12:25:50.628657 17057 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:50.706094 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:50.633729 17449 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.704749 13235 rpcz_store.cc:276] 0709 12:25:49.598629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.598888 (+   259us) service_pool.cc:224] Handling call
0709 12:25:50.417298 (+818410us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b1800394440. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94b26646 00007f0e94a6058e 00007f0e94ae1f9e 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:25:50.468967 (+ 51669us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b58006cd1d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:25:50.647239 (+178272us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b58006cd4d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:25:50.703016 (+ 55777us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1256847872}
I20260709 12:25:50.677279 17466 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.753078 17404 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:50.703728 17344 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:25:50.763641 12558 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:50.764972 17466 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:50.628777 17276 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260709 12:25:50.627429 17158 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.076s
I20260709 12:25:50.662112 17460 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:50.746641 17332 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.748276 17055 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:50.746568 17449 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:50.767204 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:50.771154 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 95814.3us
W20260709 12:25:50.770648 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 64648.7us
I20260709 12:25:50.775280 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.795475 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.803129 12554 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:50.800937 12627 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:50.804874 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:50.796442 17403 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.812314 12554 raft_consensus.cc:1275] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:25:50.801374 17404 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:50.748512 17057 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.842630 16976 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.797531 17332 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.858255 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.820869 17404 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.860643 12553 raft_consensus.cc:1240] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:50.816416 17403 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.877784 12559 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:50.909828 17057 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.917441 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:50.917016 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:50.928045 16976 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:50.929747 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:50.934832 12707 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:50.940258 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:50.941630 12625 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.933537 17460 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:50.940084 17495 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.968732 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:50.972137 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:50.973294 12550 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:50.974507 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:50.976826 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.974779 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:50.978464 12674 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:50.978582 12553 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:50.980468 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:50.981130 16708 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:50.981554 16708 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:50.981931 16708 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:50.985489 17495 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:50.986063 17231 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:25:50.980573 17542 consensus_queue.cc:1059] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:25:50.993748 17424 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.994127 17542 raft_consensus.cc:3055] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:50.994575 17542 raft_consensus.cc:740] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:50.994360 17424 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.997093 17424 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:50.997828 17404 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:50.998677 12552 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:50.982548 17329 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.983829 12625 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:51.007870 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:51.004397 16708 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:50.992965 17449 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:50.981739 17508 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:25:51.019652 17491 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:51.022621 17449 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.027822 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:51.031574 13235 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:51.033365 17403 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:51.037863 17467 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.039042 12556 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:51.037221 16708 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:51.040128 17467 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:51.046118 17562 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.193s	user 0.003s	sys 0.000s
I20260709 12:25:51.050379 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:51.051090 12552 raft_consensus.cc:2410] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
W20260709 12:25:51.052734 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 67617.5us
I20260709 12:25:51.056064 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:51.056659 12551 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.059760 17448 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:51.062865 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:51.051770 17491 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:51.066267 17403 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:51.067165 17448 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.083546 17448 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:51.085539 17565 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.185s	user 0.003s	sys 0.000s
I20260709 12:25:51.057459 17158 consensus_queue.cc:1048] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:25:51.063196 17456 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:25:51.078154 17443 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:51.078662 17561 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260709 12:25:51.078939 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:51.081444 17403 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.058758 17329 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:25:51.086615 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:51.087360 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:51.089335 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:51.103945 12707 raft_consensus.cc:2410] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 14 because replica has last-logged OpId of term: 12 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260709 12:25:51.085602 17448 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.091522 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:51.095623 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:51.106249 12553 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:51.098802 12555 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.099239 12551 raft_consensus.cc:2468] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:25:51.113658 12600 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:51.114590 12558 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:51.114995 17424 raft_consensus.cc:2804] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:51.115572 17424 raft_consensus.cc:697] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:51.116773 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:51.119993 12555 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:51.123196 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:51.123940 16708 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:51.124614 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:51.116379 17424 consensus_queue.cc:237] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:51.086490 17491 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.123986 12674 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:51.102636 17403 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:51.141989 12674 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:51.141302 16708 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.145967 17329 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:51.169193 17573 raft_consensus.cc:2804] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:51.178946 17329 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.210976 17329 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.223308 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:51.223991 13232 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.259575 13235 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:51.259317 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:51.261257 13226 raft_consensus.cc:3060] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.305683 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:51.306519 12629 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
W20260709 12:25:51.312726 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 111678us
I20260709 12:25:51.313898 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:51.314815 13235 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:51.329030 13226 raft_consensus.cc:2468] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:51.329964 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:51.330683 12629 raft_consensus.cc:2368] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 13. Current term is 14.
W20260709 12:25:51.343175 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 218600us
I20260709 12:25:51.388365 17346 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.396314 17346 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:51.399092 17566 log.cc:927] Time spent T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.494s	user 0.003s	sys 0.006s
I20260709 12:25:51.404603 17346 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:51.419365 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 79399.9us
I20260709 12:25:51.407038 17449 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:51.436146 12634 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:51.443285 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:51.426162 17443 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:51.430609 17416 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.453689 17332 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.448654 17443 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.455931 17443 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.458321 12556 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:51.431234 17346 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:25:51.460651 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:51.439826 17449 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.449502 17573 raft_consensus.cc:697] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:51.462118 17448 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.450789 17416 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.477787 17448 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:51.479312 17416 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.468421 17329 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.480089 17448 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:51.468961 13232 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:51.476104 17403 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.482532 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:51.483152 13232 raft_consensus.cc:606] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:51.483496 13232 raft_consensus.cc:614] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:51.483530 17573 consensus_queue.cc:237] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.481323 17329 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.484829 17449 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.485668 17403 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.496318 17542 consensus_queue.cc:260] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.498356 17542 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.508702 17591 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:25:51.517194 17582 log.cc:927] Time spent T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:51.538453 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:51.539271 12559 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:51.540326 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:51.541126 12554 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.546571 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:51.548326 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:51.548914 12632 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.551896 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:51.552531 13226 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 16.
I20260709 12:25:51.559221 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:51.559309 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:51.559749 13226 raft_consensus.cc:606] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:51.559830 13232 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:51.551275 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:51.466890 17585 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.088s
I20260709 12:25:51.566772 12629 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:51.567726 12634 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:51.569052 17590 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:51.569540 17590 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.569887 17590 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:51.574457 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 110951us
I20260709 12:25:51.577899 13232 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:51.586226 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:51.598688 12632 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:51.602005 12554 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:51.604477 12674 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:51.610294 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:51.611243 13235 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:51.612401 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:51.612983 13232 raft_consensus.cc:3060] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.613027 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:51.613808 13226 raft_consensus.cc:2393] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 16: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:25:51.617273 12597 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:51.623962 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:51.625236 13232 raft_consensus.cc:2468] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:25:51.627084 12597 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:51.628883 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:51.631603 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:51.632961 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:51.633504 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:51.634107 12707 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:25:51.635017 17396 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:51.635476 17396 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.635841 17396 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.640326 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:51.644140 12634 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:51.613207 17585 raft_consensus.cc:2804] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:51.639906 17403 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:51.635017 17424 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.633349 17587 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:25:51.691249 17587 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:51.691650 17587 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:51.692461 17587 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.666879 17585 raft_consensus.cc:697] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:51.694114 17585 consensus_queue.cc:237] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:51.715665 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 402046us
I20260709 12:25:51.724301 17587 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:51.705199 17396 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.740033 17508 raft_consensus.cc:993] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:51.740633 17231 raft_consensus.cc:1081] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:25:51.741046 17590 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:51.744810 17396 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:51.746767 12632 raft_consensus.cc:2368] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17.
I20260709 12:25:51.749782 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:51.750433 12707 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.754911 17590 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:51.758519 12522 leader_election.cc:400] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 13. Current term is 14.
I20260709 12:25:51.758889 12522 leader_election.cc:403] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:25:51.718400 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:51.811690 17114 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.815950 12552 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:51.816313 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:51.816974 12558 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.817826 17466 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.818450 17466 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:51.820518 17466 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:51.823798 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 105487us
W20260709 12:25:51.836331 12441 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:51.838456 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:51.839056 13235 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:51.840127 12707 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 17.
I20260709 12:25:51.841274 12705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:25:51.841997 12705 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:51.842341 12705 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:51.835731 12558 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:51.841355 12598 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:51.848522 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 199445us
I20260709 12:25:51.847611 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:51.857955 13235 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 17.
I20260709 12:25:51.835163 17332 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:25:51.886428 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:51.887212 13235 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:51.894302 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:51.898790 12558 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 17. Current term is 18. Ops: [17.11-17.11]
I20260709 12:25:51.845522 17443 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:51.837150 17158 consensus_queue.cc:1059] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:51.851408 17441 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:51.836794 17542 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 12:25:51.908893 17403 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:25:51.920204 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet 606f6695c1e84da291559cacabfa82bc: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:51.902630 17329 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:51.919759 12705 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:51.932818 12699 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:51.917786 17441 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:51.911072 17443 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.025724 12705 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:52.134814 17403 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.156023 12632 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:52.025871 17536 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:25:52.042038 17606 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.181432 17515 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:52.165635 17276 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:52.174017 17536 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:52.184027 17332 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:52.207098 17608 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:52.243732 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 392301us
W20260709 12:25:52.259156 17587 consensus_meta.cc:287] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.000s
I20260709 12:25:52.221393 17276 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.249855 17581 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.207376 17606 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.266680 17276 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:52.216068 17515 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.214917 17441 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.250512 17332 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.359303 17443 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.261740 17608 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.356523 17581 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:52.382161 17607 log.cc:927] Time spent T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
I20260709 12:25:52.387231 17608 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:52.388835 17606 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:52.416857 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet c6a602467dda4cb0bbfb59098cf973c9: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:52.432950 17332 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:52.434932 17114 consensus_meta.cc:287] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.617s	user 0.003s	sys 0.008s
I20260709 12:25:52.442906 17513 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:52.444136 17513 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.355345 17536 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.448280 17513 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:52.448937 17536 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.452306 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:52.453990 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:52.435599 17114 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 13. Current term is 14.
I20260709 12:25:52.461941 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:52.465122 17515 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:52.474699 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:52.479791 12700 raft_consensus.cc:3055] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:52.495048 12631 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:25:52.492049 12700 raft_consensus.cc:740] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:52.507930 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.517226 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:52.520759 12700 consensus_queue.cc:260] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.523612 12700 raft_consensus.cc:3060] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.528644 12634 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:25:52.540787 12522 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:52.508973 17581 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.509073 12559 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 16.
W20260709 12:25:52.564844 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 73250.3us
I20260709 12:25:52.567641 17508 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:52.552973 17515 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:25:52.584123 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:52.590003 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.589278 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.610236 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:52.612437 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "52ac1951d6d64447869208058e8755b6"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:52.613819 13231 raft_consensus.cc:606] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:52.614439 13231 raft_consensus.cc:614] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:52.622216 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:52.622866 17515 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.622272 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.623421 17515 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.623947 12550 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 18: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:52.622946 13232 raft_consensus.cc:606] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:52.630046 13232 raft_consensus.cc:614] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:52.631994 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 47980.9us
I20260709 12:25:52.631989 17628 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:52.635965 12708 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2550) took 1190 ms. Trace:
I20260709 12:25:52.637122 12555 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
W20260709 12:25:52.645547 17585 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.006s	sys 0.034s
W20260709 12:25:52.646565 17585 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.949s	user 0.006s	sys 0.035s
I20260709 12:25:52.636418 12708 rpcz_store.cc:276] 0709 12:25:51.446720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.446821 (+   101us) service_pool.cc:224] Handling call
0709 12:25:51.450910 (+  4089us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.457220 (+  6310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.457241 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.461658 (+  4417us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.890496 (+428838us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.914619 (+ 24123us) log.cc:844] Serialized 14 byte log entry
0709 12:25:52.634896 (+720277us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b18002d1b40. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e91a00a40 00007f0e919fb4e4 00007f0e919fb455 00007f0e94ae3060 00007f0e94af5716 00007f0e94b06287 00007f0e94b06208
0709 12:25:52.635333 (+   437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.635455 (+   122us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.635522 (+    67us) raft_consensus.cc:1685] finished
0709 12:25:52.635617 (+    95us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.635751 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26891,"prepare.queue_time_us":23947,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":733015,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":1894,"spinlock_wait_cycles":3437952,"thread_start_us":344773,"threads_started":1,"wal-append.queue_time_us":546885}
I20260709 12:25:52.666123 12700 raft_consensus.cc:1275] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:52.667090 17605 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:25:52.669633 12600 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:52.672617 17424 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:52.673053 17424 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:52.673435 17424 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:52.676184 17166 consensus_queue.cc:1059] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:52.678845 17508 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:52.679280 17508 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:52.680460 17508 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:52.667120 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.669003 17448 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:52.694706 17329 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:52.696358 17276 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:52.696623 12597 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 700a61b9aeed45869b2d882368e99824. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:52.710289 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.716655 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:52.722620 17276 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.725538 17466 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.726356 17466 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.729238 17055 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.729992 17055 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.732350 17055 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.738448 17448 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.742322 17396 consensus_queue.cc:1048] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:52.745810 17508 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:52.750026 17591 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.750867 17591 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.751592 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:52.755177 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:52.756008 12554 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:52.725140 17276 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:52.768440 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:52.768584 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:52.769393 13231 raft_consensus.cc:606] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:52.769794 13231 raft_consensus.cc:614] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:52.769624 17396 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:52.770375 17542 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:52.770802 17542 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.771175 17542 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:52.772099 13226 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:52.765888 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:52.775288 12631 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:25:52.776059 17448 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:52.783455 17639 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.784214 17639 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:52.789137 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.782061 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:52.781308 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:52.789242 17515 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.761446 17466 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.753360 17591 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.794094 17460 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:52.789458 17329 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.790061 17639 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:52.811200 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:52.816663 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.802904 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:52.802991 17581 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:25:52.815205 12557 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:52.801120 17460 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.816874 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:52.818158 17590 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:52.823025 17460 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:52.823407 17590 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.826570 17590 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:52.828260 17276 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.831207 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:52.845674 17639 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:52.846405 17639 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.848647 17639 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:52.850795 17496 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.851603 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:52.851473 17496 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.852301 12700 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 16: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:52.852015 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:52.848749 17590 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:52.853623 17364 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.854108 17496 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:52.858249 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66993.7us
I20260709 12:25:52.855041 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:52.855751 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:52.862664 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:52.859829 12701 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 18.
I20260709 12:25:52.862257 17496 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:52.860162 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 475505us
I20260709 12:25:52.881335 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:52.883275 17632 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.194s	user 0.002s	sys 0.000s
I20260709 12:25:52.890769 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:52.897521 12701 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:25:52.897224 12700 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:52.899228 12701 pending_rounds.cc:85] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Aborting all ops after (but not including) 9
I20260709 12:25:52.900503 12701 pending_rounds.cc:107] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:52.901475 12701 raft_consensus.cc:2889] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:52.904839 17515 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.905619 17424 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:52.906822 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:52.907473 12625 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:25:52.909327 17424 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:52.909066 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:52.913801 12454 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 10, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 10 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:52.915374 17330 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:52.916103 12671 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:52.915408 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:52.936920 12555 raft_consensus.cc:2368] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 16. Current term is 17.
I20260709 12:25:52.919064 17542 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.920758 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:52.924427 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.924294 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:52.925233 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.926507 12558 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:52.926935 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.927312 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:52.944401 12700 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 16: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:52.945729 12557 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 17: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:52.945191 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:52.951186 16968 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:52.951727 17441 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:52.952145 16968 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:52.952363 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:52.954067 17581 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:25:52.954361 17443 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:52.954562 17581 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.955235 17581 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:25:52.955605 17396 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:52.954527 17330 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:52.956673 17330 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:52.959470 12600 leader_election.cc:400] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 16. Current term is 17.
I20260709 12:25:52.959949 12600 leader_election.cc:403] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:25:52.937819 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.952765 16968 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.966785 13231 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:52.966914 12704 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:25:52.976017 17591 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:52.988329 17591 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.957783 17330 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:52.983384 17460 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:53.003293 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 87382.6us
I20260709 12:25:53.004446 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:53.005488 17590 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:53.006382 17639 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.007059 17443 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 12:25:53.011849 12550 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:53.009688 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:53.012749 12557 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:53.012706 12625 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17.
I20260709 12:25:53.017256 12522 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:53.026437 17055 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.027194 17055 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.029939 17460 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.038268 17554 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.039002 17554 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.039774 17276 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:25:53.040360 17276 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:25:53.041422 17276 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.042238 16968 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:53.044246 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.045187 12634 raft_consensus.cc:2368] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:53.047145 13198 leader_election.cc:400] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:53.047523 13198 leader_election.cc:403] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:53.049642 17331 raft_consensus.cc:3060] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:53.050200 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.052122 17554 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.053684 17404 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 16. Current term is 17.
I20260709 12:25:53.058887 17332 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:53.059576 17332 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.061499 17441 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:25:53.061676 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 57416us
I20260709 12:25:53.063097 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:53.071903 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.061705 17332 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.104512 12625 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:25:53.073673 17441 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.108376 12557 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:25:53.075456 17055 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.115423 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.126473 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:53.127673 12625 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.126092 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.129047 17638 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:53.130177 12671 leader_election.cc:400] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17.
I20260709 12:25:53.130695 12671 leader_election.cc:403] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:53.133806 17581 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.136051 17581 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.110914 17441 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.126917 17554 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:53.143581 17590 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17.
I20260709 12:25:53.129731 17638 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.154767 12631 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:25:53.157550 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:53.151209 17554 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.175108 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.177170 12522 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:53.179240 12625 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:53.156566 17591 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.181211 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:53.183609 12550 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 18: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:53.184571 17653 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.177181 17554 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:53.185209 17653 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:53.188573 17646 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:25:53.194166 17331 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:53.197557 17636 consensus_queue.cc:1059] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.019s
W20260709 12:25:53.198366 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 81724.3us
I20260709 12:25:53.204038 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:53.165941 17652 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.187461 17653 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.211117 12699 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 18.
I20260709 12:25:53.180042 17515 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:53.225934 17638 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.231429 13231 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:53.223456 17652 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.242375 12454 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:53.258366 13231 raft_consensus.cc:1275] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:53.267730 17441 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.223728 17515 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.273005 17515 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.245308 12454 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 7 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:53.280999 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.282552 17639 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.282691 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.283185 17639 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.284706 17590 raft_consensus.cc:3055] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:53.287158 13232 raft_consensus.cc:1275] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:53.289125 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 117187us
I20260709 12:25:53.301766 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.285306 17590 raft_consensus.cc:740] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:53.303416 17542 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.304240 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.303931 17590 consensus_queue.cc:260] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.304915 12556 raft_consensus.cc:2368] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:53.305171 17590 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.225013 17554 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.319768 17554 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.322178 17441 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.322448 12631 raft_consensus.cc:1240] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:53.323056 17441 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.324142 12631 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 17. Current term is 18. Ops: []
I20260709 12:25:53.325067 17651 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.325537 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:53.325855 17332 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.326361 12631 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:53.326472 17404 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.326674 17332 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.327064 17404 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.329749 17655 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.330130 17443 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.330312 17655 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.330933 17443 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.332401 17655 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.325769 17651 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.334180 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:53.334802 12625 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:53.335638 17651 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.329164 17404 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.340750 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.310585 17639 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.342741 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.241114 17652 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.348905 17332 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:53.361567 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46836.5us
I20260709 12:25:53.365696 17166 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.366223 12625 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:53.366398 13201 leader_election.cc:400] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) with higher term. Message: Invalid argument: T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10.
I20260709 12:25:53.369858 17581 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:25:53.381796 12631 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:25:53.384907 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:53.385551 12634 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:53.381166 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:53.382511 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.391897 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.395262 12454 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.387478 13232 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:25:53.408031 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.412258 12629 raft_consensus.cc:2393] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 17: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:53.417138 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.426898 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.427021 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.380400 17443 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.430671 12522 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:25:53.434276 12598 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:53.434980 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.438330 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:53.441191 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.413455 17055 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.407019 12454 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 13. New cstate: current_term: 13 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:53.455610 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 45993.2us
I20260709 12:25:53.475334 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:25:53.476761 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46195.2us
I20260709 12:25:53.470175 12600 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:53.491485 12522 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
W20260709 12:25:53.498127 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.499560 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:53.462009 17443 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:25:53.505939 17466 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:53.506239 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.508698 17640 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:53.509510 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.510126 12630 raft_consensus.cc:1240] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 14. Current term is 15. Ops: [14.8-14.8]
I20260709 12:25:53.511122 17441 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.516343 17628 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.491900 17276 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:53.530540 12634 raft_consensus.cc:2468] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:25:53.522127 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.494125 17652 raft_consensus.cc:2804] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:53.540774 12629 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:53.535487 17329 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:53.546588 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.549276 13198 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.557675 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.502614 17055 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.576318 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.539162 17276 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.574256 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.579535 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.582191 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.593025 12600 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.594414 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.552621 17443 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:53.596153 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.570536 17496 raft_consensus.cc:2804] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:53.601315 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:53.600943 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 232121us
I20260709 12:25:53.569852 17636 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.607115 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.601532 17416 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:53.591617 17276 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:53.619585 12556 raft_consensus.cc:2410] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:53.613371 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.554827 17329 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.555102 17640 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.590801 17652 raft_consensus.cc:697] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:25:53.613941 17542 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.631351 17456 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:53.617353 17496 raft_consensus.cc:697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:25:53.622350 12701 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:25:53.670615 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.689591 13231 raft_consensus.cc:2468] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
W20260709 12:25:53.695838 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 93792.4us
I20260709 12:25:53.699893 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.676775 17581 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60574 (request call id 3) took 1203 ms. Trace:
W20260709 12:25:53.702136 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 76846.5us
I20260709 12:25:53.644637 17416 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.700547 12707 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:25:53.646443 17636 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.692224 17466 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:53.717797 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 170284us
I20260709 12:25:53.719475 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:53.713387 17622 log.cc:927] Time spent T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:25:53.739984 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.738126 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.719882 12557 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Committing config change with OpId 9.7: config changed from index -1 to 7, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:25:53.718794 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:53.722424 17055 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.759897 13234 raft_consensus.cc:2410] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:53.722856 17636 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.697662 17456 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.770179 17640 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:53.770579 17456 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:53.773547 17675 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.746335 17329 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:53.774792 17666 ts_tablet_manager.cc:933] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:53.704684 17581 rpcz_store.cc:276] 0709 12:25:52.460532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.481598 (+ 21066us) service_pool.cc:224] Handling call
0709 12:25:52.576148 (+ 94550us) log.cc:844] Serialized 492 byte log entry
0709 12:25:53.653125 (+1076977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3838,"raft.queue_time_us":56463,"raft.run_cpu_time_us":2166,"raft.run_wall_time_us":2165,"thread_start_us":21726,"threads_started":1,"wal-append.queue_time_us":98925}
W20260709 12:25:53.768128 17660 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:25:53.777275 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:53.723075 17496 consensus_queue.cc:237] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:53.788794 17515 consensus_meta.cc:287] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.002s
I20260709 12:25:53.793401 17515 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:53.794087 17659 log.cc:927] Time spent T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:53.796913 12554 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 12: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:53.760150 17652 consensus_queue.cc:237] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:53.798216 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.713761 17443 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.769217 17416 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:53.838713 12629 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:53.816628 12454 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 13, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 13 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:53.884054 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:53.898383 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:53.903280 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.905573 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:53.903980 12707 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:53.892531 17466 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:53.911861 17677 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:53.925680 12555 raft_consensus.cc:1240] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:53.929015 17666 tablet_copy_client.cc:323] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.2:34669
I20260709 12:25:53.893775 17515 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:53.930346 12454 catalog_manager.cc:5697] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 12, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:53.932593 12454 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:53.942366 12598 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:53.951733 12674 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.953233 12598 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:53.956679 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.955957 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.966226 12550 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.966928 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.972074 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:53.974228 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.976233 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:53.976821 12707 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:25:53.982985 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.989037 12598 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:53.989399 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:53.998768 12700 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 15.
I20260709 12:25:54.001757 17673 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:54.002995 17658 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.006882 12454 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:53.966008 17653 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:54.014040 12452 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 346) took 23270 ms (client timeout 15000 ms). Trace:
I20260709 12:25:54.015120 17416 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:54.008915 12454 catalog_manager.cc:5697] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 11, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.019224 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:54.019205 12454 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.022418 12454 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 13, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 13 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:54.026916 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.027271 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.028430 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:54.028815 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.029117 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:53.984061 17456 consensus_queue.cc:1059] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260709 12:25:54.034658 12700 raft_consensus.cc:2410] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
W20260709 12:25:54.036432 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47479.2us
I20260709 12:25:54.038924 12707 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17.
I20260709 12:25:54.042629 12699 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:25:54.043128 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.042433 12454 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 11, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:54.044175 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 56424.3us
I20260709 12:25:54.044351 12550 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:54.059931 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.045127 17673 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:54.055018 17416 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:54.108745 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.109439 12631 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:54.104242 12454 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 7, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.116581 12634 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:54.112869 12454 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:25:54.119673 12454 catalog_manager.cc:5697] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.121522 16976 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.121934 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.122226 16976 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.121133 12454 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:54.126222 17661 log.cc:927] Time spent T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.525s	user 0.004s	sys 0.000s
I20260709 12:25:54.125818 12454 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.127614 12454 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.117537 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.132820 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.129200 12454 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.134271 12631 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:54.129223 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:54.145169 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.125130 16976 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:54.134258 12454 catalog_manager.cc:5697] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 9, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:54.158289 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 59522.1us
W20260709 12:25:54.209198 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 89981.9us
I20260709 12:25:54.210215 16209 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.117697 17640 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:54.217813 12454 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.215556 16209 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.222729 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.216828 17424 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:25:54.277727 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44685.8us
I20260709 12:25:54.222349 12454 catalog_manager.cc:5697] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 13, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 13 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.290162 12644 tablet_copy_service.cc:140] P a2a8d71f644447218c1afc3e5f7716cd: Received BeginTabletCopySession request for tablet 700a61b9aeed45869b2d882368e99824 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:40560)
I20260709 12:25:54.290942 12644 tablet_copy_service.cc:161] P a2a8d71f644447218c1afc3e5f7716cd: Beginning new tablet copy session on tablet 700a61b9aeed45869b2d882368e99824 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:40560: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-700a61b9aeed45869b2d882368e99824
I20260709 12:25:54.293859 16209 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:54.299093 12454 catalog_manager.cc:5697] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.300371 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:54.302500 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:54.310221 17689 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:25:54.314054 13235 raft_consensus.cc:1240] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:54.304797 17456 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:54.301384 17515 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:54.313802 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:25:54.306988 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 91750.9us
I20260709 12:25:54.319341 12523 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.305639 17448 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:54.317930 13234 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:54.313937 17638 raft_consensus.cc:3055] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:54.325866 17638 raft_consensus.cc:740] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
W20260709 12:25:54.326083 17686 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:25:54.320135 17456 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:54.333397 17695 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:54.334020 17456 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:54.014663 12452 rpcz_store.cc:269] 0709 12:25:30.743759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.744086 (+   327us) service_pool.cc:224] Handling call
0709 12:25:54.013789 (+23269703us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:50.465570 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:50.466135 (+   565us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:50.466164 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:25:50.466182 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:50.505998 (+ 39816us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:50.506086 (+    88us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:50.506113 (+    27us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:25:50.632223 (+126110us) tablet.cc:701] Row locks acquired
0709 12:25:50.643311 (+ 11088us) write_op.cc:260] PREPARE: finished
0709 12:25:50.652173 (+  8862us) write_op.cc:270] Start()
0709 12:25:50.652293 (+   120us) write_op.cc:276] Timestamp: P: 1783599950652121 usec, L: 0
0709 12:25:50.652314 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:25:50.652971 (+   657us) log.cc:844] Serialized 6246 byte log entry
0709 12:25:51.084185 (+431214us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b4400022b4c. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e91924c85 00007f0e919256a2 00007f0e946971db 00007f0e94692aaf 00007f0e9468686e 00007f0e94685bb6 00007f0e946857d8 00007f0e9468f221 00007f0e9468f1d9 00007f0e9468f169
0709 12:25:51.182137 (+ 97952us) op_driver.cc:464] REPLICATION: finished
0709 12:25:51.442162 (+260025us) write_op.cc:301] APPLY: starting
0709 12:25:51.445783 (+  3621us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:51.477515 (+ 31732us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:51.477676 (+   161us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:51.747914 (+270238us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:51.748319 (+   405us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=0,mrs_lookups=0
0709 12:25:51.748386 (+    67us) write_op.cc:312] APPLY: finished
0709 12:25:51.748834 (+   448us) log.cc:844] Serialized 148 byte log entry
0709 12:25:51.749008 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:51.749190 (+   182us) write_op.cc:454] Released schema lock
0709 12:25:51.749253 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:51.824217 (+ 74964us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:51.824262 (+    45us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106885,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":245619,"apply.run_cpu_time_us":22576,"apply.run_wall_time_us":333774,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71135,"num_ops":16,"prepare.queue_time_us":212276,"prepare.run_cpu_time_us":25322,"prepare.run_wall_time_us":389777,"raft.queue_time_us":95026,"raft.run_cpu_time_us":41240,"raft.run_wall_time_us":168510,"replication_time_us":529646,"spinlock_wait_cycles":23557504,"thread_start_us":557864,"threads_started":4,"wal-append.queue_time_us":245886,"wal-append.run_cpu_time_us":33540,"wal-append.run_wall_time_us":1849928}]]}
W20260709 12:25:54.332705 17276 consensus_meta.cc:287] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Time spent flushing consensus metadata: real 0.695s	user 0.017s	sys 0.004s
I20260709 12:25:54.342429 17276 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.326960 17638 consensus_queue.cc:260] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:54.343665 12551 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:54.346004 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.346885 17636 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:25:54.348076 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.348829 17636 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:54.350025 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.350184 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.351961 17448 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:54.357751 17685 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.359187 17276 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:54.359571 17448 consensus_queue.cc:1059] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:25:54.360808 17449 raft_consensus.cc:3055] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:54.361219 17449 raft_consensus.cc:740] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:54.362203 17449 consensus_queue.cc:260] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.363523 17449 raft_consensus.cc:3060] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:54.365659 17638 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:54.373126 12644 tablet_copy_source_session.cc:215] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Tablet Copy: opened 0 blocks and 1 log segments
W20260709 12:25:54.387068 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 493765us
I20260709 12:25:54.387799 17585 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:54.390303 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.406476 17640 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:25:54.407371 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet c12120af627b4866b9f483d6cd9f30f5: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:25:54.409348 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:54.411372 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.432235 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:54.444334 12557 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:54.451694 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.452905 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:54.432152 17448 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:54.503243 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 72553.4us
I20260709 12:25:54.509598 12557 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:54.517084 12628 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:54.546650 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.548638 13234 raft_consensus.cc:1275] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:54.483743 17698 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.553947 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.562148 17581 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:54.558801 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:54.574172 12630 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
W20260709 12:25:54.581372 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 77028.5us
I20260709 12:25:54.582201 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.488039 17448 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:54.574038 17658 consensus_meta.cc:287] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.005s
I20260709 12:25:54.598137 17707 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 12:25:54.598953 17657 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 12:25:54.607465 17658 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:54.591475 17331 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:54.560539 17695 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:54.672441 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 80120.4us
I20260709 12:25:54.688313 17707 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:54.686627 17660 log.cc:927] Time spent T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:25:54.695551 17703 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:25:54.697331 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 135133us
I20260709 12:25:54.586299 17329 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.105s
I20260709 12:25:54.704329 17449 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:54.706729 17709 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 12:25:54.722968 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 135913us
I20260709 12:25:54.724820 17448 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:54.734390 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 280566us
I20260709 12:25:54.690598 17655 consensus_queue.cc:1048] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:54.686944 17695 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.755719 12702 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:25:54.724074 17449 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:25:54.757503 17449 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.765781 17449 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:54.770349 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 174356us
I20260709 12:25:54.784611 17424 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:54.790917 17416 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:54.791736 17416 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.795814 17666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 700a61b9aeed45869b2d882368e99824. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:25:54.801194 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50824.8us
I20260709 12:25:54.851418 17695 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:54.856233 17416 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:54.864743 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.864768 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:54.868366 12671 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:25:54.877295 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44647.7us
I20260709 12:25:54.867854 17710 consensus_queue.cc:1048] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:25:54.884653 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:54.891207 12700 raft_consensus.cc:1275] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 12:25:54.895048 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.904464 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.905231 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.859812 17449 consensus_queue.cc:1048] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260709 12:25:54.895949 17721 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:54.911702 17655 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:54.930167 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:54.932037 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.932646 12634 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:54.936093 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:54.928390 17508 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:25:54.939007 13235 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:54.919128 17706 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:54.942164 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.933542 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:54.929894 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.954526 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:54.968664 13235 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:54.968760 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:54.969978 12700 raft_consensus.cc:2376] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17. Re-sending same reply.
W20260709 12:25:54.975351 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50350.7us
I20260709 12:25:54.950795 17591 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.989787 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:54.990471 12699 raft_consensus.cc:2376] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17. Re-sending same reply.
I20260709 12:25:54.992344 12708 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:25:54.972332 17671 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:54.995874 17591 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:54.977461 17685 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:55.013711 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:54.972856 16976 consensus_queue.cc:1048] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
W20260709 12:25:55.038064 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 104586us
I20260709 12:25:55.038997 12523 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:55.039776 12705 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
W20260709 12:25:55.058362 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 44747.9us
I20260709 12:25:55.059470 17710 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:55.061746 17717 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:55.055456 17680 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:25:55.077025 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 81359.7us
I20260709 12:25:55.057122 17715 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:55.017351 17590 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 12:25:55.152114 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 65150.2us
W20260709 12:25:55.151085 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 57411.8us
W20260709 12:25:55.155392 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 60920.4us
W20260709 12:25:55.201493 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47425.9us
W20260709 12:25:55.262049 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 170375us
W20260709 12:25:55.262645 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 105893us
I20260709 12:25:55.066185 17685 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.088s
I20260709 12:25:55.153599 17554 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:55.262015 17718 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:25:55.287766 12523 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:25:55.155051 17515 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.123s
W20260709 12:25:55.314252 17726 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:25:55.316915 17728 log.cc:927] Time spent T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:25:55.319104 17694 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:55.319792 17694 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:55.278290 17717 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260709 12:25:55.334548 17591 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:55.305742 17713 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:25:55.355540 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58497.8us
I20260709 12:25:55.377359 17713 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:25:55.395283 17732 log.cc:927] Time spent T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
W20260709 12:25:55.412261 17733 log.cc:927] Time spent T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:25:55.414971 17694 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:55.430721 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:55.466641 17737 log.cc:927] Time spent T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
W20260709 12:25:55.476660 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 168682us
W20260709 12:25:55.533002 17736 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.124s	user 0.003s	sys 0.000s
I20260709 12:25:55.524080 17713 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:55.586159 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 53940.1us
W20260709 12:25:55.586688 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 384188us
W20260709 12:25:55.593533 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 329377us
I20260709 12:25:55.600112 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:55.625187 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:55.640553 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:55.624155 17670 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:55.713829 17496 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:55.714560 17496 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:55.715914 17513 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:55.716576 17513 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:55.722672 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:55.729008 13199 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:55.733243 16209 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:55.669936 17670 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:55.740235 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:55.717160 17496 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:55.761899 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:55.760361 17424 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.738750 17591 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:55.777508 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 113417us
I20260709 12:25:55.769631 17424 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:55.791298 17666 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50978 (request call id 1227) took 2371 ms. Trace:
I20260709 12:25:55.774501 17591 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:55.793936 17591 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:55.791841 17666 rpcz_store.cc:276] 0709 12:25:53.420149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.430438 (+ 10289us) service_pool.cc:224] Handling call
0709 12:25:53.775275 (+344837us) ts_tablet_manager.cc:934] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
0709 12:25:54.463876 (+688601us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:55.588989 (+1125113us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:55.589137 (+   148us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:55.790507 (+201370us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:55.790813 (+   306us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:55.791133 (+   320us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:55.791201 (+    68us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":31249,"tablet-copy.queue_time_us":196891,"thread_start_us":232832,"threads_started":2}
I20260709 12:25:55.800921 17666 tablet_copy_client.cc:806] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:55.802176 17513 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:55.792058 17424 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:55.805310 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:55.805989 13227 raft_consensus.cc:606] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:55.806571 13227 raft_consensus.cc:614] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:55.806668 17666 tablet_copy_client.cc:670] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:55.805897 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:55.811524 17496 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:55.812974 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:55.822649 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:55.823310 13227 raft_consensus.cc:606] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:55.823649 13227 raft_consensus.cc:614] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:55.829028 12627 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:25:55.829654 12627 raft_consensus.cc:606] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:55.830020 12627 raft_consensus.cc:614] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:55.833056 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:55.833693 13227 raft_consensus.cc:606] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:55.834026 13227 raft_consensus.cc:614] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:55.835049 17670 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:55.838423 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:55.842362 17666 tablet_copy_client.cc:538] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:55.853826 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:55.855098 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:55.866952 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:55.867825 13227 raft_consensus.cc:606] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:25:55.868256 13227 raft_consensus.cc:614] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:55.879971 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 224915us
I20260709 12:25:55.882488 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:55.883177 13227 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:25:55.898113 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:55.904659 12707 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:25:55.906666 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:25:55.907387 13227 raft_consensus.cc:606] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:25:55.907780 13227 raft_consensus.cc:614] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:55.908107 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 65821.2us
I20260709 12:25:55.878214 17710 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:55.930368 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:55.936635 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:55.938548 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:55.939363 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:55.942032 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 59881.8us
I20260709 12:25:55.909066 17758 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.961611 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 49937.8us
I20260709 12:25:55.964838 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:55.982483 17760 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:25:56.004660 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:56.075354 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 70843.5us
I20260709 12:25:55.955955 17710 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:56.076359 13199 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:56.077033 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 79218.8us
I20260709 12:25:55.968883 17693 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.081950 17496 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:56.093823 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:56.090216 17713 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:56.124035 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:56.137053 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:55.962932 17758 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:56.117376 17697 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.122218 17674 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:25:56.177351 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 215043us
W20260709 12:25:56.164063 17725 log.cc:927] Time spent T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:25:56.188792 17709 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.142068 17713 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:56.264189 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 141073us
W20260709 12:25:56.292457 17731 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:25:56.271466 17655 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:56.346953 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 71810.4us
I20260709 12:25:56.221711 17674 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:56.521457 17713 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:56.491843 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 196325us
I20260709 12:25:56.521035 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:56.522599 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 148902us
W20260709 12:25:56.406581 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 194428us
W20260709 12:25:56.352769 17769 log.cc:927] Time spent T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:56.527120 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:56.530433 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:56.387632 17655 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:56.539542 17655 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:56.544009 17746 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:56.544857 17749 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:56.544708 17746 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:56.545514 17749 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:56.546535 17513 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:56.549057 17697 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:56.547101 17513 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:56.550171 13232 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:56.551628 17652 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.552193 17652 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:56.364553 17666 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
W20260709 12:25:56.729343 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 80392.7us
I20260709 12:25:56.547125 17746 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:25:56.611220 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49113.6us
I20260709 12:25:57.029013 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:56.597967 12441 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:25:57.030462 12441 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 432637us
I20260709 12:25:56.362895 17710 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:56.567392 17443 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.033463 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:56.611554 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:56.564231 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.034233 12557 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:56.371940 17674 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:57.048966 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:56.647526 17513 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:56.907747 17788 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.068154 17788 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.070806 17788 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:56.524904 17758 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:56.645040 17713 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.098990 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.098278 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:57.103704 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52068.2us
I20260709 12:25:57.103286 17710 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.088609 17713 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.039734 17443 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.113170 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:57.115974 12550 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
W20260709 12:25:57.110155 17655 consensus_meta.cc:287] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 0.570s	user 0.011s	sys 0.000s
I20260709 12:25:57.113049 17781 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.108642 17758 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.115087 17710 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.138237 17640 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.146252 17784 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.146917 17784 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.121717 17655 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.127933 17781 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.152314 17687 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.174547 17773 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:57.145159 17758 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.150568 17640 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:25:57.192150 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 149472us
I20260709 12:25:57.185039 17784 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:57.200470 17758 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:57.226357 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:57.228551 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 138812us
W20260709 12:25:57.238375 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 143517us
I20260709 12:25:57.242889 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:57.243523 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 136222us
W20260709 12:25:57.248567 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 140657us
I20260709 12:25:57.236677 17785 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.191977 17687 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.192364 17773 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:25:57.268697 17443 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:57.261139 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 63091.5us
I20260709 12:25:57.295544 17713 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:57.299250 17655 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:57.304301 12702 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:25:57.308586 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 112017us
I20260709 12:25:57.312639 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:57.313993 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 55259.5us
I20260709 12:25:57.326062 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:25:57.337205 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 79056.7us
I20260709 12:25:57.336146 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:57.345932 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:57.346367 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:57.384178 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 131491us
I20260709 12:25:57.268733 17785 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.337702 17798 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
W20260709 12:25:57.391359 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 44126.7us
W20260709 12:25:57.385568 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 52893.6us
I20260709 12:25:57.325311 17795 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:57.351217 17710 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:57.409480 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 1107) took 1171 ms. Trace:
I20260709 12:25:57.409914 13232 rpcz_store.cc:276] 0709 12:25:56.233181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.233458 (+   277us) service_pool.cc:224] Handling call
0709 12:25:56.233740 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:56.550573 (+316833us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:57.403249 (+852676us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400142b54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:57.404495 (+  1246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":726872832}
I20260709 12:25:57.399937 17800 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:57.426319 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 74488.7us
I20260709 12:25:57.417269 17640 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:57.416301 17687 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:57.440281 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 100301us
I20260709 12:25:57.423506 17800 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.417974 17805 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:25:57.443782 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 54440.9us
W20260709 12:25:57.450564 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 49363.1us
I20260709 12:25:57.445643 17800 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:57.457525 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.461352 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:57.463830 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:25:57.464023 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:57.446417 17805 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.403846 17798 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:57.490449 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 142026us
I20260709 12:25:57.487624 17694 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:57.449108 17812 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.491387 17816 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.464763 17805 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:57.503489 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 51085.4us
W20260709 12:25:57.499753 17801 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260709 12:25:57.488440 17773 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:25:57.525385 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 80886.1us
W20260709 12:25:57.523809 17803 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:25:57.548141 17800 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.550720 17800 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:57.535023 17749 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:57.525050 17799 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.542948 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.503785 17812 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.521811 17824 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.538169 17785 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:57.589576 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 128336us
I20260709 12:25:57.532451 17823 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:25:57.592895 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:57.597154 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.554563 17738 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.609738 17738 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.604987 17652 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:57.613684 17694 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:57.614414 17812 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:57.614306 17694 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.616986 17694 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:57.618853 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.620893 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.621726 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.624185 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.625259 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.626004 12704 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:57.627741 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.629904 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:57.630960 17828 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:57.631250 17806 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:57.642234 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.596807 17825 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.622572 17827 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:57.618880 17817 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:57.649386 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:57.653352 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 189395us
I20260709 12:25:57.646520 17785 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:57.662108 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 157847us
I20260709 12:25:57.598770 17799 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.753649 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:25:57.761498 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 84277.2us
I20260709 12:25:57.762320 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:57.650314 17670 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260709 12:25:57.851719 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 89498.5us
I20260709 12:25:57.603188 17824 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.855026 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.661659 17796 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:57.858352 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:57.854327 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:57.659065 17817 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.885982 17817 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:57.654994 17825 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:57.888684 17825 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:57.899312 17799 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:57.925014 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 269939us
I20260709 12:25:57.865239 17811 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:25:58.085717 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 108436us
I20260709 12:25:57.651584 17806 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.089332 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:58.099651 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 467141us
I20260709 12:25:57.901050 17812 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:57.651749 17828 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:57.973608 17740 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:57.657006 17827 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.100404 12522 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:58.097607 17449 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:57.923875 17796 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:58.182076 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 150222us
I20260709 12:25:58.129815 17685 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.146440 17800 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:25:58.197321 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 97016.1us
I20260709 12:25:58.133311 17818 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.137267 17749 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.136166 17833 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.219538 17749 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.222348 17749 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.224119 17749 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.224759 17749 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.236855 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.237105 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.237901 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:25:58.228765 12630 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.008s	sys 0.043s
W20260709 12:25:58.244057 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 100851us
I20260709 12:25:58.246555 17795 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.247135 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.247155 17795 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.249521 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:25:58.249506 17795 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.155259 17740 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:25:58.231580 17685 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.192440 17449 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.260695 17685 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.261328 17460 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:58.264353 17658 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.264693 17796 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:58.266040 17678 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:58.266592 17678 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.268719 17678 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.190577 17812 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.227550 17800 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.231781 17817 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.232663 17811 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
W20260709 12:25:58.305907 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 116168us
I20260709 12:25:58.262476 17826 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.312176 17826 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.314965 17826 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.315423 17449 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.325356 12632 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:58.334438 17749 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.383116 12550 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2689) took 1203 ms. Trace:
I20260709 12:25:58.383594 12550 rpcz_store.cc:276] 0709 12:25:57.179414 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.179619 (+   205us) service_pool.cc:224] Handling call
0709 12:25:57.189627 (+ 10008us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:57.301440 (+111813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.301485 (+    45us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:57.301536 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:57.301577 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.382809 (+1081232us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b5400106dd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:58.382873 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.383019 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256608000}
I20260709 12:25:58.295806 17658 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.395147 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.217499 17818 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:58.407063 13200 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.023s
W20260709 12:25:58.407496 13200 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.013s	sys 0.023s
I20260709 12:25:58.227787 17833 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.410811 17685 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.411252 17839 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:58.411309 17845 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.412431 17680 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.412560 17823 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.310434 17798 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.338366 17796 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.339068 17847 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.351392 17740 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.304507 17800 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.394447 17749 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.311061 17817 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.477439 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.554651 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.556118 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.522720 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.523233 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.541389 12551 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:38728 (request call id 2683) took 1431 ms. Trace:
I20260709 12:25:58.610189 12551 rpcz_store.cc:276] 0709 12:25:57.109605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.109778 (+   173us) service_pool.cc:224] Handling call
0709 12:25:58.540582 (+1430804us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800010298. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c6b71 00007f0e919c6a22 00007f0e9a8df8d9 00007f0e99a39ee0 00007f0e99b030ab 00007f0e99b03131 00007f0e99ac4fc0 00007f0e99aaf929 00007f0e99aaf3d2 00007f0e93026bd4
0709 12:25:58.540835 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.541060 (+   225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.541096 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.541150 (+    54us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:58.541183 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.541234 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.541337 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2643200}
W20260709 12:25:58.611609 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 65720.1us
I20260709 12:25:58.428453 17788 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.522763 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.613425 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.387458 17811 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:25:58.529691 17840 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
I20260709 12:25:58.473875 17685 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.676671 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.676999 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.645295 17853 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.645164 17749 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.645668 17773 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.646243 17846 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.646670 17055 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.646880 17740 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.646952 17449 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.647238 17855 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.524503 17658 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.647430 17785 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.697750 17855 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.701287 17853 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.703570 17853 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.684712 17773 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.707453 17846 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.709690 17846 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.711694 17449 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.649132 17800 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.477939 17746 consensus_queue.cc:1059] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.172s
I20260709 12:25:58.650316 17788 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.651360 17738 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.612104 17847 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.651698 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.652967 17818 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.654856 17852 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.655045 17791 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:58.655802 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.656551 17811 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.658046 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.659619 17812 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.615957 17810 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.834746 17810 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.836771 17810 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:58.552532 17713 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.837662 17713 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.839607 17713 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.840086 17713 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.840585 17713 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.662745 17424 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.841548 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.841518 17424 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.608505 17710 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.842828 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.843300 17710 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.663312 17780 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.845703 17780 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.664184 17515 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.848204 17515 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.850756 17515 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.851312 17515 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.851861 17515 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.852370 17788 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.807307 17740 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.854960 12629 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55098 (request call id 2516) took 1322 ms. Trace:
I20260709 12:25:58.855446 12629 rpcz_store.cc:276] 0709 12:25:57.532128 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.532229 (+   101us) service_pool.cc:224] Handling call
0709 12:25:57.532467 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:57.916066 (+383599us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.916107 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:57.916165 (+    58us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:57.916210 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.854640 (+938430us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b5400213ed4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:58.854697 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.854865 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881418496}
I20260709 12:25:58.856668 17740 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.474116 17839 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.666462 17828 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.523260 17680 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.671764 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.654913 17833 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.673703 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.675995 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.676316 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.677454 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.682197 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.475064 16976 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:25:58.621644 17805 consensus_meta.cc:287] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: Time spent flushing consensus metadata: real 1.105s	user 0.004s	sys 0.008s
I20260709 12:25:58.522074 17838 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.608117 17806 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:58.532553 17820 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.930878 17680 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.931380 17713 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.931557 17680 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.932301 17680 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.926110 16976 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.935995 16976 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.925969 17838 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.683733 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:25:58.938086 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 254414us
I20260709 12:25:58.938827 17839 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.940228 17817 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.692517 17685 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.942878 17818 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:58.923741 17805 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.946810 12628 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:58.947989 17805 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.948438 12628 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55082 (request call id 2812) took 1330 ms. Trace:
I20260709 12:25:58.948812 12628 rpcz_store.cc:276] 0709 12:25:57.617641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.622520 (+  4879us) service_pool.cc:224] Handling call
0709 12:25:58.948239 (+1325719us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b540025e4d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:58.948363 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3031354112}
I20260709 12:25:58.952024 13226 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:25:58.952636 17827 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.953323 17838 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.858243 17791 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.957357 17791 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.958993 17749 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.694767 17856 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.696300 17055 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.697993 17785 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.648567 17837 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.987543 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:58.988715 17705 raft_consensus.cc:493] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.988905 17800 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:58.989562 17515 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.989598 17800 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.987612 17837 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:58.991874 17800 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.992594 17055 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.992973 17837 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.994408 17780 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.996757 17855 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:58.535162 17796 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.983517 17773 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:58.833184 17852 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.011024 17781 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:59.012845 17852 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.862250 13234 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:25:59.012979 17680 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.664794 17844 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:59.014012 17844 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.015187 12556 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:58.901860 12702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45144 (request call id 2613) took 1040 ms. Trace:
I20260709 12:25:59.015641 12702 rpcz_store.cc:276] 0709 12:25:57.861837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.861981 (+   144us) service_pool.cc:224] Handling call
0709 12:25:57.862381 (+   400us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:57.862786 (+   405us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:57.862829 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:57.879328 (+ 16499us) log.cc:844] Serialized 26 byte log entry
0709 12:25:58.193049 (+313721us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:58.193107 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.193200 (+    93us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:58.901652 (+708452us) raft_consensus.cc:1685] finished
0709 12:25:58.901669 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.901804 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1085,"raft.queue_time_us":263,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":12458,"thread_start_us":313244,"threads_started":1,"wal-append.queue_time_us":375539}
I20260709 12:25:58.899359 17811 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:59.017675 17796 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.017495 17811 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.018487 12708 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
W20260709 12:25:58.830250 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 182077us
I20260709 12:25:58.903599 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:58.904345 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.020087 12626 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:25:58.905014 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:58.906512 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.909031 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.022037 12551 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:58.515944 17823 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.024387 17823 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.025166 17844 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.828972 17746 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:59.026077 17746 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.028179 17746 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:58.553164 17845 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.030033 17449 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.918275 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:58.937014 17847 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:58.961658 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 275912us
I20260709 12:25:58.553705 17697 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:58.913763 17740 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:58.975485 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:58.960775 17820 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.985913 17856 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:58.986907 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:58.987036 17785 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:58.989333 17705 raft_consensus.cc:515] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.010409 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.019562 17811 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:58.902977 17858 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:58.611200 17824 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.252077 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.108052 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.258097 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.176506 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.199186 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.106098 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.099704 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.260540 13235 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:25:59.056624 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:59.263531 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 288129us
I20260709 12:25:59.245671 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.272568 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.272950 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.250564 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.274971 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.273710 12702 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:25:59.277199 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:59.132578 12733 heartbeater.cc:646] Failed to heartbeat to 127.11.32.62:45335 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.11.32.62:45335 timed out after 15.000s (SENT)
I20260709 12:25:59.280014 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.285439 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.274477 13228 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:25:59.287458 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:25:59.075707 17865 log.cc:927] Time spent T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:25:59.293538 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.294164 12625 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:25:59.294951 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.295174 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.292263 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.297005 12557 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 18.
I20260709 12:25:59.297925 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.289008 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.305888 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.306727 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:25:59.307420 12701 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:59.308733 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.309947 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.311014 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.311964 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.312883 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.304114 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:59.300669 12552 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:59.057650 17710 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.215909 17441 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:59.364689 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.366824 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.331560 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.332696 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.335837 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.371659 12554 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
W20260709 12:25:59.324867 13201 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.11.32.1:45107 timed out after 1.593s (SENT) [suppressed 3 similar messages]
I20260709 12:25:59.374375 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.375550 17854 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:59.375991 17854 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:59.376371 17854 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.270506 17847 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:59.381042 17441 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.390059 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.290709 17857 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:59.391264 17857 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.390121 17785 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:59.468236 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.469730 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.469316 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.469173 12557 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:25:59.495347 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:59.496055 12554 raft_consensus.cc:3060] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.273964 17697 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.278496 17740 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.478938 17798 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:59.521376 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.522195 12628 raft_consensus.cc:2393] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 9: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:25:59.483367 17823 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:59.502251 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.519865 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.285552 17705 leader_election.cc:290] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.534106 17824 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.534550 17824 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:59.534917 17824 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.384706 17856 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.538362 17424 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.545696 17824 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.541635 13234 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1118) took 1112 ms. Trace:
I20260709 12:25:59.546936 13234 rpcz_store.cc:276] 0709 12:25:58.429436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.429729 (+   293us) service_pool.cc:224] Handling call
0709 12:25:59.541443 (+1111714us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b5400142b54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aef2fa 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c 00007f0e9302a7c2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:25:59.541556 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":604903808}
I20260709 12:25:59.547868 17824 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:59.548748 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46588.3us
I20260709 12:25:59.549546 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.549840 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.550402 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.551048 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.551375 17554 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.553102 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.532763 17515 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:59.558619 17515 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.560796 17515 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.553920 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.562703 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.562918 17798 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.564275 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.562754 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.565019 17798 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.529968 12522 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.565845 17515 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.567203 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.568161 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.565764 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.569119 17697 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:59.549188 17820 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.570079 12626 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:25:59.398284 17785 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.392540 17845 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.491194 17847 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:59.572260 17785 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.573890 17847 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.572835 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.575604 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.575958 17847 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.567250 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.576844 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.313915 17858 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.577497 12555 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:59.577970 17845 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.579528 17858 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.579977 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.581194 17441 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.581341 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.582860 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.582782 17823 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:25:59.584056 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.584939 17823 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:25:59.584426 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.570976 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.595674 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.595867 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.596158 12554 raft_consensus.cc:2468] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:25:59.596962 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.597571 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.599436 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.599556 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.600054 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.600643 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.601284 12555 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:25:59.602433 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.603087 12555 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 6.
I20260709 12:25:59.604032 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.606201 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.608479 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.608587 13199 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:59.609582 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.613492 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.562659 17857 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:25:59.585753 17858 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:25:59.611290 13199 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.644300 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.643471 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:59.648963 12522 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.649318 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.666193 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.666500 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.666131 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.672922 12555 raft_consensus.cc:2393] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:25:59.661226 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.665732 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.665866 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.675617 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:25:59.652686 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:25:59.620990 17806 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:25:59.618022 17798 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:59.678349 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.680249 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.679224 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:25:59.679538 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.680441 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.681195 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.687127 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.688865 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.689486 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.693919 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.693838 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.671077 17694 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:59.650594 17678 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:25:59.708137 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.708889 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.699571 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:25:59.703073 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.669567 17858 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.684484 17823 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:59.715746 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.709848 12550 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:25:59.681492 17798 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:59.718106 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.724121 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.727022 12600 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.704746 17785 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:59.731715 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:25:59.714799 17823 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:25:59.784368 12600 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.785899 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.787207 12600 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.720099 17798 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.715215 17678 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.774139 12633 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55082 (request call id 2820) took 2020 ms. Trace:
I20260709 12:25:59.728490 17670 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.788909 17786 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:59.730232 17740 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.792627 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.793932 17824 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.794350 17441 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:59.796868 12633 rpcz_store.cc:276] 0709 12:25:57.753562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.251552 (+497990us) service_pool.cc:224] Handling call
0709 12:25:58.252160 (+   608us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.678994 (+426834us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.679024 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.679064 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:58.679101 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.773927 (+1094826us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b540025dfd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:59.773969 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.774084 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":981186816}
I20260709 12:25:59.732788 17794 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:59.750355 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.762151 17858 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:59.723671 17862 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:58.158599 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:59.917584 17666 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:59.919623 17854 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:25:59.789662 17823 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:25:59.923501 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 130949us
I20260709 12:25:59.919610 17678 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:25:59.944419 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 194142us
I20260709 12:25:59.947240 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.936812 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:59.940938 13232 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50990 (request call id 1119) took 1502 ms. Trace:
I20260709 12:25:59.910866 17441 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:25:59.949321 12600 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:25:59.933926 17824 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:59.950012 13232 rpcz_store.cc:276] 0709 12:25:58.438901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.439279 (+   378us) service_pool.cc:224] Handling call
0709 12:25:58.439653 (+   374us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:58.998410 (+558757us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:59.135040 (+136630us) log.cc:844] Serialized 14 byte log entry
0709 12:25:59.483164 (+348124us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:59.483298 (+   134us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:59.483374 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.940628 (+457254us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54004a29d4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:59.940691 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.940864 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14587,"prepare.queue_time_us":88312,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":32,"raft.queue_time_us":15611,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":6055,"spinlock_wait_cycles":1284491648,"thread_start_us":468347,"threads_started":2,"wal-append.queue_time_us":485319}
I20260709 12:25:59.956481 17678 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:59.951663 17858 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:59.954895 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.950088 17863 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:59.952850 17794 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:59.962206 17847 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.953999 17441 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.957370 17694 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:59.962941 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.969954 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:25:59.959187 17678 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:59.975190 17678 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:59.964128 17794 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:25:59.976161 17854 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:25:59.976537 17794 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.953763 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:25:59.983134 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1276) took 1145 ms. Trace:
I20260709 12:25:59.983796 12703 rpcz_store.cc:276] 0709 12:25:58.837947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.838734 (+   787us) service_pool.cc:224] Handling call
0709 12:25:58.838987 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:59.316754 (+477767us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.316784 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:59.316822 (+    38us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:59.316851 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.982853 (+666002us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b54000fcb54. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:25:59.982912 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.983069 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1098401152}
I20260709 12:25:59.977155 17847 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:59.993151 12600 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:59.997591 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 453156us
I20260709 12:25:59.999224 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:25:59.998570 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 513046us
W20260709 12:25:59.998095 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 505542us
I20260709 12:26:00.002003 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.004055 12674 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:00.004693 17820 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:00.005379 17820 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:00.004731 12674 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:25:59.989678 17666 tablet_bootstrap.cc:492] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:25:59.979628 17824 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:25:59.989290 17709 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.012041 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.006884 12674 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.007280 17820 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:00.018975 12674 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.020879 17640 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:00.010141 17802 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.021481 17640 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:00.018473 17854 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.024938 17666 ts_tablet_manager.cc:1403] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 3.659s	user 0.057s	sys 0.054s
W20260709 12:26:00.032335 13201 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.027s	sys 0.027s
I20260709 12:26:00.034897 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.035394 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.038082 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.038568 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:26:00.033159 13201 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.027s	sys 0.027s
W20260709 12:26:00.039551 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 714675us
I20260709 12:26:00.040902 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.043576 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.047940 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.046749 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.052754 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.030783 17640 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.055717 12597 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.056691 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:26:00.074139 17815 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.541s	user 0.007s	sys 0.042s
I20260709 12:26:00.055413 17424 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:00.088364 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 89762.5us
I20260709 12:26:00.089354 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:00.074688 17815 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.554s	user 0.007s	sys 0.043s
I20260709 12:26:00.064348 17745 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.061614 17869 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:00.094518 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:00.102072 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.108011 12634 raft_consensus.cc:1240] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:00.094146 12597 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.101060 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.092679 17802 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:00.120314 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 101429us
I20260709 12:26:00.121173 12674 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:00.122234 12674 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.095485 17786 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.098217 17815 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.117638 17745 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.097632 17869 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.114903 17424 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:00.144433 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 145264us
I20260709 12:26:00.145682 17745 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.146677 17424 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:00.145833 17869 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.148062 17815 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.171300 12671 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.154670 17873 raft_consensus.cc:3055] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 12:26:00.223491 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52056.8us
I20260709 12:26:00.166435 17854 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:00.239225 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 117081us
I20260709 12:26:00.255558 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.232777 17823 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:00.184099 17868 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260709 12:26:00.172160 17424 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.261215 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:26:00.269585 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 196388us
W20260709 12:26:00.270360 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 153429us
I20260709 12:26:00.211624 17877 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.273793 12627 raft_consensus.cc:2393] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:00.210004 17745 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.211902 17879 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.206751 17876 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:00.278060 13201 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.228756 17873 raft_consensus.cc:740] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:00.282869 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a59b6927edd4e21a78fe14b7acdad1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.285096 12631 raft_consensus.cc:1240] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:00.283466 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.286406 12631 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.288786 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
W20260709 12:26:00.291134 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 197042us
I20260709 12:26:00.205307 17794 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.292850 12597 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.297652 13201 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.291433 17862 consensus_queue.cc:1059] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:26:00.302448 17862 raft_consensus.cc:3055] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:00.302836 17862 raft_consensus.cc:740] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:00.303668 17862 consensus_queue.cc:260] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.303884 17678 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.291747 17835 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:00.310808 12628 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.177970 17666 raft_consensus.cc:359] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:00.305109 12634 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 6. Current term is 7. Ops: []
I20260709 12:26:00.177525 17815 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:00.311590 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 68445.2us
I20260709 12:26:00.280758 17876 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:00.293135 17881 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.295598 17877 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:00.317513 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 146290us
I20260709 12:26:00.304934 17862 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.325737 12551 raft_consensus.cc:1240] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:00.305111 17798 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.336623 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.314028 17666 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:26:00.320883 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.315258 17554 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.351912 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.352945 13201 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.315963 17876 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.287849 17879 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.320134 17820 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.372920 17820 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 19 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.354105 12674 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.370810 17678 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.318490 17802 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.377794 13231 raft_consensus.cc:1240] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.376387 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.352584 17697 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.350349 17441 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:00.409813 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 90490.2us
W20260709 12:26:00.412012 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 57993.7us
I20260709 12:26:00.385280 17796 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.329017 17881 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.415617 12674 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.396852 17854 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:00.416812 17798 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:00.418632 17879 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.423954 17424 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.440778 17424 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.443085 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.444628 12632 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.410941 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.448388 17745 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.450300 17823 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.414855 17885 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:00.451305 17885 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:00.451495 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.451714 17885 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.397045 17880 consensus_queue.cc:1059] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:26:00.463085 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.436705 17889 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:00.430606 12625 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.464015 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.464329 17889 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.464855 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.466480 17889 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.467368 17815 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.467443 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.464046 17880 raft_consensus.cc:3055] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:00.468376 17880 raft_consensus.cc:740] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.454095 17640 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.469108 13226 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50962 (request call id 1113) took 1295 ms. Trace:
I20260709 12:26:00.469576 13226 rpcz_store.cc:276] 0709 12:25:59.173863 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.175027 (+  1164us) service_pool.cc:224] Handling call
0709 12:25:59.542068 (+367041us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.542391 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.542421 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.542882 (+   461us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.968413 (+425531us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:59.968474 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.968572 (+    98us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.314397 (+345825us) raft_consensus.cc:1685] finished
0709 12:26:00.314417 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.468855 (+154438us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b5400142b50. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aea8ad 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6 00007f0e92e2526f
0709 12:26:00.469034 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3144,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":843084032,"thread_start_us":425137,"threads_started":1,"wal-append.queue_time_us":526625}
I20260709 12:26:00.412195 17666 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:00.472309 17666 ts_tablet_manager.cc:1434] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.434s	user 0.001s	sys 0.009s
I20260709 12:26:00.465394 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.469131 17880 consensus_queue.cc:260] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.476490 17877 raft_consensus.cc:2804] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:00.477061 17877 raft_consensus.cc:697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:00.478883 17881 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.479051 17877 consensus_queue.cc:237] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.480871 17869 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.482010 12630 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:00.456488 17794 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.483697 17441 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:00.484053 17713 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:00.485209 17713 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:00.485685 17713 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:00.486603 17869 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.487092 17694 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:00.486768 17713 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.487604 17694 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.488703 17713 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.489845 17694 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:00.492395 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.493562 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.493975 12558 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.497833 17745 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:00.497931 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46527.7us
I20260709 12:26:00.498395 17745 raft_consensus.cc:493] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:00.499015 17640 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.499737 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.497864 12699 raft_consensus.cc:1240] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:00.503753 17746 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.504509 12671 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.498957 17745 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.509577 12671 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:26:00.512182 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 141883us
I20260709 12:26:00.519368 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.520182 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.500434 17880 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.523533 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.345471 17873 consensus_queue.cc:260] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.509162 17746 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:26:00.534909 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 150647us
I20260709 12:26:00.535053 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.536341 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:00.538214 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.539192 17796 consensus_queue.cc:1059] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:00.540287 17796 raft_consensus.cc:3055] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:00.540412 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.540701 17796 raft_consensus.cc:740] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:26:00.545189 12524 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.534188 17746 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.547462 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.548316 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.548959 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.546482 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.513216 17879 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.550148 17869 consensus_queue.cc:1059] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:00.550715 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.551203 17869 raft_consensus.cc:3055] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:00.551697 17869 raft_consensus.cc:740] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.552595 17869 consensus_queue.cc:260] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.553929 17869 raft_consensus.cc:3060] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.555569 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.556785 12597 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.558051 17794 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:00.558758 17794 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.559852 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.560386 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.586338 17823 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.551394 17876 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.588799 12699 raft_consensus.cc:2393] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 15: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:00.589464 17796 consensus_queue.cc:260] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.590708 17796 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.593930 17876 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.563230 17885 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:00.564692 12597 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.523610 17820 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:00.570205 12455 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 7 to 11, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.603699 12597 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.607085 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.607419 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.608923 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:00.610597 12558 raft_consensus.cc:2468] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:26:00.612015 12600 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:00.614653 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.615329 12708 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 10.
I20260709 12:26:00.618192 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.619689 12455 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 7 to 11, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:00.622246 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 86687.6us
I20260709 12:26:00.623191 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.623847 13201 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.627751 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.610136 17441 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:00.621012 17424 raft_consensus.cc:2804] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:00.609285 17815 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.609176 17869 raft_consensus.cc:493] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:00.640671 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.636152 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:00.638743 12454 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 224) took 11954 ms (client timeout 15000 ms). Trace:
I20260709 12:26:00.622223 17873 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.616542 17847 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.634071 17424 raft_consensus.cc:697] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.635491 13201 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.634212 17788 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:00.648629 13201 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:00.641705 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 262654us
I20260709 12:26:00.649683 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.658989 13201 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.643690 17746 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.662039 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.663390 12558 raft_consensus.cc:2393] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 14: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:26:00.666796 17424 consensus_queue.cc:237] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.669109 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:00.662575 17808 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:00.670332 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:00.644907 17815 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.671661 17746 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.674479 12554 raft_consensus.cc:1240] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:00.675616 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.675863 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.676712 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.677693 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.675668 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.673171 12708 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:26:00.680568 12702 raft_consensus.cc:1240] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:00.682171 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.684265 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.657011 17807 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.718626 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.719143 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.720009 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
W20260709 12:26:00.644510 12454 rpcz_store.cc:269] 0709 12:25:48.673021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.677534 (+  4513us) service_pool.cc:224] Handling call
0709 12:26:00.627447 (+11949913us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:54.757113 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:54.757732 (+   619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:54.757779 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:25:54.757797 (+    18us) tablet.cc:662] Decoding operations
0709 12:25:54.765896 (+  8099us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:54.765980 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:54.766008 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:25:54.854075 (+ 88067us) tablet.cc:701] Row locks acquired
0709 12:25:54.854128 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:25:54.886900 (+ 32772us) write_op.cc:270] Start()
0709 12:25:54.887053 (+   153us) write_op.cc:276] Timestamp: P: 1783599954886829 usec, L: 0
0709 12:25:54.887079 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:25:54.987238 (+100159us) log.cc:844] Serialized 9259 byte log entry
0709 12:25:55.628521 (+641283us) op_driver.cc:464] REPLICATION: finished
0709 12:25:55.790776 (+162255us) write_op.cc:301] APPLY: starting
0709 12:25:55.790873 (+    97us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:55.991460 (+200587us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:56.082146 (+ 90686us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:56.599932 (+517786us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:56.600443 (+   511us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0709 12:25:56.600510 (+    67us) write_op.cc:312] APPLY: finished
0709 12:25:57.183454 (+582944us) log.cc:844] Serialized 212 byte log entry
0709 12:25:57.272328 (+ 88874us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:57.273861 (+  1533us) write_op.cc:454] Released schema lock
0709 12:25:57.274037 (+   176us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:57.282774 (+  8737us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:57.283025 (+   251us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":867633,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":156719,"apply.run_cpu_time_us":54155,"apply.run_wall_time_us":1490983,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104639,"num_ops":24,"prepare.queue_time_us":347527,"prepare.run_cpu_time_us":24033,"prepare.run_wall_time_us":548930,"raft.queue_time_us":47605,"raft.run_cpu_time_us":22103,"raft.run_wall_time_us":125902,"replication_time_us":741269,"thread_start_us":734582,"threads_started":5,"wal-append.queue_time_us":503278,"wal-append.run_cpu_time_us":29341,"wal-append.run_wall_time_us":2459942}]]}
I20260709 12:26:00.685725 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.688753 17820 consensus_queue.cc:1059] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:00.668696 17745 raft_consensus.cc:515] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.672497 17815 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.726493 17806 consensus_queue.cc:1059] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:00.727696 17806 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:00.728082 17806 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:26:00.728971 12673 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.645025 17869 raft_consensus.cc:515] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.733927 17869 leader_election.cc:290] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:00.735152 13234 raft_consensus.cc:1217] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEARNER]: Deduplicated request from leader. Original: 9.6->[9.7-9.7]   Dedup: 9.7->[]
I20260709 12:26:00.736105 12455 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:00.739765 12455 catalog_manager.cc:5697] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 3 to 4, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 4 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:00.713764 17885 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:00.747952 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:00.651866 17788 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:00.748793 17788 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.747867 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.748944 12455 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 5 to 6, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 6 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:00.657757 17798 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.724550 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:26:00.725381 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44386.7us
I20260709 12:26:00.725956 17808 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.726094 17820 raft_consensus.cc:3055] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:00.761592 17820 raft_consensus.cc:740] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:00.761791 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.762547 17820 consensus_queue.cc:260] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.763909 17820 raft_consensus.cc:3060] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.697688 12598 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:00.766570 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 68979.7us
I20260709 12:26:00.767352 12598 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.768622 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.729069 17806 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.770040 17806 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:00.770725 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.771420 12633 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:26:00.772097 17788 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.773159 17847 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:00.773617 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:00.773980 17847 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.774212 13234 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.774765 17847 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.775385 12644 tablet_copy_service.cc:342] P a2a8d71f644447218c1afc3e5f7716cd: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-700a61b9aeed45869b2d882368e99824 received from {username='slave'} at 127.0.0.1:40560
I20260709 12:26:00.775871 12644 tablet_copy_service.cc:434] P a2a8d71f644447218c1afc3e5f7716cd: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-700a61b9aeed45869b2d882368e99824 on tablet 700a61b9aeed45869b2d882368e99824 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:00.742452 12708 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:00.742761 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:00.777945 17885 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:00.778331 17885 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:00.778589 12671 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.779819 17873 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.728145 17745 leader_election.cc:290] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.778698 17885 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.784418 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:00.790537 12708 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:00.792160 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.793185 17816 consensus_queue.cc:1059] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:00.794108 17807 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:00.795593 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.806134 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.810871 17854 consensus_queue.cc:1059] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:00.811180 17847 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:00.811728 17847 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:00.803673 12630 raft_consensus.cc:2468] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:00.798081 17885 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.812844 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.813360 13234 raft_consensus.cc:606] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.822487 13234 raft_consensus.cc:614] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:00.824136 17808 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.824263 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.813843 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.825954 17815 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.826635 17894 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:00.827237 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:00.827716 17894 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.806793 12551 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:26:00.815606 17746 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:00.816361 17816 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:00.812255 17869 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.829725 17816 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:00.830078 17869 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.830608 17816 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.831177 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.831903 17816 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.815104 17807 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:00.832751 17807 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:00.830811 17869 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:26:00.828392 17894 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:00.833860 17894 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:00.834359 12705 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:00.834632 17894 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.811939 17854 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:00.836436 17854 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.836542 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.837342 17854 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:00.838410 17873 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.838755 17854 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.839602 17894 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.833680 17807 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:00.840521 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8acfb123196f471d9fa81328e89997cc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:00.840723 17807 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.841830 17825 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:00.842394 17815 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.842664 17825 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:00.819686 17788 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:00.837893 12671 leader_election.cc:304] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.812994 17847 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.825922 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.849327 12598 leader_election.cc:304] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.861914 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.857856 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:00.865875 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.866664 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.867281 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.869763 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.869867 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.869029 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.872066 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.874707 13231 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:00.865003 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.877969 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:00.881462 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:00.882272 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c8dc26a51db24f54ad0e0272c06d9306" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:00.882954 12631 raft_consensus.cc:2393] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:00.843143 17825 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.863010 17820 raft_consensus.cc:2749] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.897343 13198 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:26:00.888135 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44774us
I20260709 12:26:00.899099 12600 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:00.909144 13198 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.915271 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.917439 12523 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.910434 17869 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:00.880510 17694 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.921254 17694 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:00.921564 17827 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.921726 17694 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.893451 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:00.875026 17794 raft_consensus.cc:2749] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.894848 17885 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:00.877288 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.919935 12523 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.898360 17825 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:26:00.940735 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 63805.2us
I20260709 12:26:00.941565 12523 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.943317 12523 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.944609 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:00.945523 17827 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.920222 17796 raft_consensus.cc:2804] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:00.927450 17670 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.949836 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.956550 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.946225 17823 raft_consensus.cc:2749] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:00.946461 17713 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:00.946496 17424 consensus_queue.cc:1175] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "23740bafdb794232879a0bb6884f7a68" responder_term: 9 status { last_received { term: 9 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 9 index: 7 } }
I20260709 12:26:00.941918 17835 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.959158 17877 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:00.958830 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.972721 12708 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:00.974282 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.975373 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.956159 17862 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.961328 17441 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:00.960304 17796 raft_consensus.cc:697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:00.975905 13228 raft_consensus.cc:2468] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:26:00.943125 17869 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.956715 17825 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.947995 17820 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.979821 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.959847 17746 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:00.977299 17873 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.977041 17862 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:00.979291 17441 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:00.985790 17745 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:00.983840 17881 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:00.993160 12671 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:00.996693 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:00.998492 13228 raft_consensus.cc:606] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:00.999221 13228 raft_consensus.cc:614] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:01.002307 17441 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.003978 17441 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:01.001531 12671 leader_election.cc:304] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:00.995988 17862 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.993892 17815 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:00.987545 17839 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:26:01.014921 12671 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
W20260709 12:26:01.016206 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 71670.5us
I20260709 12:26:01.017088 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.005903 17873 raft_consensus.cc:2749] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:01.019881 12523 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.021327 12671 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:01.012756 17745 raft_consensus.cc:2749] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:01.019783 17713 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.031629 17844 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.034278 13234 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e19c569fe6e34f969a722bd2495c3a89"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:01.034788 12558 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:01.034925 13234 raft_consensus.cc:606] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.035279 13234 raft_consensus.cc:614] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:01.018483 17554 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:01.017154 17820 raft_consensus.cc:2749] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:01.038273 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:01.031416 17876 raft_consensus.cc:2804] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:01.040158 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:01.039808 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.050344 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.052183 17903 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.054047 12626 raft_consensus.cc:1275] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:01.044291 17746 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:26:01.038533 17554 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:01.058198 17554 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.062583 12523 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.059552 17554 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:01.066437 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:01.017979 17796 consensus_queue.cc:237] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.062120 17903 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:01.064895 17876 raft_consensus.cc:697] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:01.070498 17877 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:01.093107 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:01.128772 13228 raft_consensus.cc:606] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:01.022823 17869 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.129328 13228 raft_consensus.cc:614] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:01.142521 13226 raft_consensus.cc:1240] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:01.142952 12708 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:01.147989 17862 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.159814 17847 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.161106 17876 consensus_queue.cc:237] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.169746 12632 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:26:01.174109 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:01.176162 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:01.181145 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:01.076427 17901 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:01.137012 17694 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.143033 17881 consensus_queue.cc:1048] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:26:01.195063 12551 raft_consensus.cc:1240] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:01.196223 17862 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:01.207007 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
W20260709 12:26:01.197360 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 131049us
I20260709 12:26:01.180691 17854 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:26:01.155709 17827 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:01.201014 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58198us
I20260709 12:26:01.213853 13232 raft_consensus.cc:1240] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:01.214880 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:01.215233 12523 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.229475 17885 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:01.229528 17815 consensus_queue.cc:1059] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:01.230142 17885 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:01.213356 17901 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:01.231041 17885 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.231418 17901 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.231866 17815 raft_consensus.cc:3055] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:01.232358 17815 raft_consensus.cc:740] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:01.233515 17901 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:01.234537 17694 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:01.239727 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:01.241523 17847 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:01.242117 17713 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.245198 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:01.247047 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:01.249248 12553 raft_consensus.cc:1275] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:01.254455 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.261348 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:01.263679 17825 consensus_queue.cc:1048] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:01.272336 13199 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.263038 17854 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.251883 17847 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.233628 17815 consensus_queue.cc:260] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:01.284430 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 67323.5us
I20260709 12:26:01.289132 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.280824 17832 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:01.285537 17873 consensus_queue.cc:1059] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260709 12:26:01.282935 17891 consensus_queue.cc:1059] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:26:01.291222 17847 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.334959 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:01.338052 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:01.321259 17844 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:01.356393 17847 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:01.361173 17788 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:01.361711 17788 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:01.362653 17788 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.364070 17788 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.329097 17815 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:01.369946 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:01.370841 12704 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
W20260709 12:26:01.373642 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46395.6us
I20260709 12:26:01.377166 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:01.377960 13232 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:01.383528 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:01.386199 17869 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:01.386711 17869 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.387185 17869 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.339694 17827 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:26:01.392961 17877 raft_consensus.cc:3055] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:01.393503 17877 raft_consensus.cc:740] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:01.394405 17877 consensus_queue.cc:260] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.396059 17877 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.415457 17827 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:01.415973 17827 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:01.416879 17827 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.421729 17827 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.425683 12523 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.427053 17901 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:01.436342 17869 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.461906 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:01.463572 17869 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:01.467075 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:01.477227 13232 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.485546 12704 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:01.507213 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 290668us
I20260709 12:26:01.510388 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:01.510411 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:01.512859 12632 raft_consensus.cc:1240] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:01.511114 13226 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:26:01.515319 12522 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.516096 12626 raft_consensus.cc:2393] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:01.525719 17918 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.526350 17918 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.532675 17901 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:01.536947 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:01.537775 17901 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:01.538163 17901 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:01.538630 17901 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:01.542728 17918 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:01.543985 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:01.547942 12631 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:01.549607 17554 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:01.555790 13232 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:01.558017 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:01.556903 12597 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:01.558754 12629 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:26:01.568487 17827 consensus_queue.cc:1059] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:01.569561 17827 raft_consensus.cc:3055] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:01.569928 17827 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:01.575070 12522 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.573887 17869 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:01.584182 17844 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:01.595535 17844 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.596030 17844 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.602079 17869 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:01.603053 17869 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.571460 17901 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.614372 12704 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:01.623071 17827 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.624459 17827 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:01.653236 12454 catalog_manager.cc:5697] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 13, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 13 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.654805 12454 catalog_manager.cc:5697] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 13 to 14, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 14 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.660214 12454 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 17, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 17 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.661623 12454 catalog_manager.cc:5697] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.669142 12454 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.670742 12454 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.672926 12556 raft_consensus.cc:3060] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.672371 12454 catalog_manager.cc:5697] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 12, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.675076 12454 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 12 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.676358 12454 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 13, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 13 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.677832 12454 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.688481 12626 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:01.679185 12454 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 17, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 17 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:01.690016 12454 catalog_manager.cc:5697] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.691694 12454 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 17, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 17 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.693507 12454 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index -1 to 7, term changed from 5 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:01.700940 17877 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:01.702441 17844 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.704617 17844 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:01.696576 17788 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:01.705610 17788 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:01.707778 17788 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:01.709511 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:01.709511 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:01.714429 17901 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:01.715934 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:01.716702 12558 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:01.720209 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:01.721130 12630 raft_consensus.cc:2393] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 7: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:01.722724 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:01.723279 12632 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.727697 13228 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:01.728536 12704 raft_consensus.cc:1275] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:01.728566 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:01.736232 13228 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:01.738709 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:01.739459 17897 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:01.744695 12556 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:01.763744 17877 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:01.749433 17897 consensus_queue.cc:1048] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:01.751252 12455 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 324) took 38831 ms (client timeout 15000 ms). Trace:
I20260709 12:26:01.752857 12694 tablet_service.cc:1558] Processing DeleteTablet for tablet d9812250f15d4075a3c8831ca5f3ed41 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 5)) from {username='slave'} at 127.0.0.1:45128
I20260709 12:26:01.758307 17847 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:01.783607 12556 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:01.791909 12442 catalog_manager.cc:5028] TS c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): tablet d9812250f15d4075a3c8831ca5f3ed41 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:01.794252 13227 raft_consensus.cc:1275] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260709 12:26:01.780174 12455 rpcz_store.cc:269] 0709 12:25:22.944943 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:22.962738 (+ 17795us) service_pool.cc:224] Handling call
0709 12:26:01.751154 (+38788416us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:00.967239 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:00.967773 (+   534us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:00.967806 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:26:00.967824 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:00.968489 (+   665us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:00.968565 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:00.968591 (+    26us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:26:00.969112 (+   521us) tablet.cc:701] Row locks acquired
0709 12:26:00.969130 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:00.969285 (+   155us) write_op.cc:270] Start()
0709 12:26:00.976536 (+  7251us) write_op.cc:276] Timestamp: P: 1783599960969235 usec, L: 0
0709 12:26:00.977474 (+   938us) op_driver.cc:348] REPLICATION: starting
0709 12:26:01.020778 (+ 43304us) log.cc:844] Serialized 2055 byte log entry
0709 12:26:01.330511 (+309733us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.521503 (+190992us) write_op.cc:301] APPLY: starting
0709 12:26:01.521581 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:01.524779 (+  3198us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:01.524889 (+   110us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.583671 (+ 58782us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.592019 (+  8348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0709 12:26:01.592068 (+    49us) write_op.cc:312] APPLY: finished
0709 12:26:01.593394 (+  1326us) log.cc:844] Serialized 57 byte log entry
0709 12:26:01.594519 (+  1125us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.594630 (+   111us) write_op.cc:454] Released schema lock
0709 12:26:01.594670 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.596961 (+  2291us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.596992 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":147777,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":190724,"apply.run_cpu_time_us":8097,"apply.run_wall_time_us":73581,"cfile_cache_hit":22,"cfile_cache_hit_bytes":25067,"num_ops":5,"prepare.queue_time_us":185994,"prepare.run_cpu_time_us":42813,"prepare.run_wall_time_us":204847,"raft.queue_time_us":64976,"raft.run_cpu_time_us":24588,"raft.run_wall_time_us":179257,"replication_time_us":352845,"thread_start_us":504569,"threads_started":4,"wal-append.queue_time_us":190099}]]}
I20260709 12:26:01.805841 17877 consensus_queue.cc:1048] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:01.810135 17881 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:01.808045 12632 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:26:01.814445 12522 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:01.815310 17670 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:01.816048 17670 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:01.816998 17670 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:01.854257 12556 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:01.855343 13232 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 7.
I20260709 12:26:01.857467 12632 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "700a61b9aeed45869b2d882368e99824"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55074
I20260709 12:26:01.858232 12632 raft_consensus.cc:606] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Received request to transfer leadership
I20260709 12:26:01.858738 12632 raft_consensus.cc:614] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:01.863273 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:01.858541 17854 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260709 12:26:01.869518 17844 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:01.892702 12457 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:01.893869 12505 auto_rebalancer.cc:893] Removing replace marker failed: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
W20260709 12:26:01.894285 12505 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:26:01.894589 12505 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:26:01.895040 12457 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 7 to 8, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 8 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.900295 12457 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:01.888482 17844 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:01.907586 12457 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:01.906337 17844 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:01.950357 17936 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:26:01.986965 12451 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 10 to 11, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
W20260709 12:26:02.008136 12457 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 322) took 33994 ms (client timeout 15000 ms). Trace:
I20260709 12:26:01.998528 12451 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.012017 12451 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.017061 17746 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.017644 17746 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.019804 17746 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:02.008685 12457 rpcz_store.cc:269] 0709 12:25:28.013921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:28.016647 (+  2726us) service_pool.cc:224] Handling call
0709 12:26:02.008041 (+33991394us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:01.912770 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:01.913334 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:01.913369 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:26:01.913389 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:01.913950 (+   561us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:01.914007 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:01.914033 (+    26us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:26:01.914393 (+   360us) tablet.cc:701] Row locks acquired
0709 12:26:01.914411 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:26:01.914529 (+   118us) write_op.cc:270] Start()
0709 12:26:01.914627 (+    98us) write_op.cc:276] Timestamp: P: 1783599961914497 usec, L: 0
0709 12:26:01.914647 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:01.921909 (+  7262us) log.cc:844] Serialized 1682 byte log entry
0709 12:26:01.924117 (+  2208us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.924557 (+   440us) write_op.cc:301] APPLY: starting
0709 12:26:01.924638 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:01.927954 (+  3316us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:01.928057 (+   103us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.933500 (+  5443us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.933689 (+   189us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=0,mrs_lookups=0
0709 12:26:01.933826 (+   137us) write_op.cc:312] APPLY: finished
0709 12:26:01.934071 (+   245us) log.cc:844] Serialized 49 byte log entry
0709 12:26:01.934851 (+   780us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.934955 (+   104us) write_op.cc:454] Released schema lock
0709 12:26:01.934999 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.935373 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.935405 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":386104,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":6423,"apply.run_wall_time_us":10756,"cfile_cache_hit":16,"cfile_cache_hit_bytes":16752,"num_ops":4,"prepare.queue_time_us":114,"prepare.run_cpu_time_us":2963,"prepare.run_wall_time_us":9425,"replication_time_us":9333}]]}
I20260709 12:26:02.022789 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.015262 12451 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 8 to 12, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:02.025084 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.025728 12632 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:26:02.025492 12451 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 11 to 14, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.027529 12451 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 11 to 15, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 15 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:02.029810 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:02.029913 12451 catalog_manager.cc:5697] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 10 to 13, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 13 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.042960 12451 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.045564 17746 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:02.046815 17746 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.047260 17746 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.055158 17746 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.073614 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:02.069674 12451 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 11 to 14, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 14 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:02.079241 12451 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 9 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:02.081861 12451 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 9 to 12, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:02.084760 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:02.085448 12632 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.084704 12451 catalog_manager.cc:5697] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 9 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:02.083576 17746 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:02.092736 12632 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 16.
I20260709 12:26:02.094120 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:02.095394 17746 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:02.096578 17746 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 16 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:02.094084 12451 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:02.097923 17746 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.099216 12451 catalog_manager.cc:5697] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 4 to 10, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 10 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:02.116858 17854 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.117470 17854 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.122172 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.122857 12553 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:02.123430 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.124035 13227 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:02.124321 12600 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.125209 17847 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:02.125316 17854 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.125641 17847 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.126001 17847 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.137717 17554 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.138258 17554 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.140786 17554 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:02.141664 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.142292 12632 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 15.
I20260709 12:26:02.142871 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.143374 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.145463 17554 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:02.145982 17554 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.146386 17554 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.146946 17847 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.147482 13227 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:26:02.149529 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:02.150056 12556 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.150161 17854 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:02.157140 17554 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.165299 17854 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.166026 17854 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:02.168614 17854 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:02.169588 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.170038 17554 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:02.170207 12703 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:02.171427 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:02.173072 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:02.173686 12632 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.175258 17441 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:02.175657 17441 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.176023 17441 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.177516 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:02.184381 12706 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:26:02.186895 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.189319 17854 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:02.191601 17441 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:02.192059 17825 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.192643 17825 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.195091 17825 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.200670 17694 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.201504 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.202098 13232 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 7.
I20260709 12:26:02.201220 17694 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.204705 17694 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:02.206602 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.207278 12626 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:02.206602 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.209465 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.210510 17694 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:02.210924 17694 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.211314 17694 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:02.213583 17825 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:02.214006 17825 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.214470 17825 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:02.220062 12703 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:02.226440 12632 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 16.
I20260709 12:26:02.228899 17825 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.230373 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:02.233666 17825 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.234543 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:02.235129 13232 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:02.236500 12703 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:02.237875 17844 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:02.243867 13232 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 8.
I20260709 12:26:02.245069 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.245929 17825 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:02.247116 17825 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:02.247825 17893 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:02.248370 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:02.248944 13232 raft_consensus.cc:3060] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.248370 17893 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:02.250337 17893 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.253774 17441 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:02.259662 17844 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:02.260253 17844 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.257957 17847 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.261895 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:02.262516 12704 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.264634 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.265287 12558 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:02.268556 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:02.270994 12704 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:26:02.276490 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:02.271234 12556 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:02.271440 17825 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.272115 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.279894 12632 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:02.280023 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.280786 12626 raft_consensus.cc:2393] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:02.280918 17847 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:02.282742 17847 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:02.283664 17847 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:02.285526 17869 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:02.286072 17869 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.288996 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:02.289072 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.289880 12704 raft_consensus.cc:2393] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:02.296672 17869 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.301738 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.302420 13226 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:02.303593 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:02.305514 17854 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:02.305876 17854 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:02.306198 17854 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:02.314918 17854 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.317587 17901 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:02.318442 17854 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.321502 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:02.320459 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:02.325951 12708 raft_consensus.cc:2393] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 9: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:02.332446 13232 raft_consensus.cc:2468] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:02.360562 12597 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.369609 17847 raft_consensus.cc:2804] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:02.354224 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.371596 17847 raft_consensus.cc:697] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:02.372582 17847 consensus_queue.cc:237] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.351749 17844 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.370600 13232 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:02.377590 17844 consensus_queue.cc:1059] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.378721 17901 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:02.379179 17901 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:02.380025 17901 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.381006 17901 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:02.333221 13226 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:02.386701 17670 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:02.387279 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:02.387400 17670 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:02.391209 17670 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:02.391637 17441 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:02.392273 17441 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:02.393227 17441 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.396623 17670 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:02.397204 17670 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.400316 17670 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:02.401835 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.402084 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.402572 12708 raft_consensus.cc:2368] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:26:02.402719 12704 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 19: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:02.404837 12523 leader_election.cc:400] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:26:02.405158 12523 leader_election.cc:403] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:02.405834 17844 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.451467 12629 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:02.540627 17694 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.551616 13228 raft_consensus.cc:2368] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13.
I20260709 12:26:02.552400 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.554816 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:02.555763 12556 raft_consensus.cc:2410] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 12:26:02.568220 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.568953 12626 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 19.
I20260709 12:26:02.574955 12522 leader_election.cc:400] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13.
I20260709 12:26:02.575332 12522 leader_election.cc:403] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:02.551256 17788 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.568708 17847 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:02.594096 17847 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.617388 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.618557 13227 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:26:02.629585 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 76947.3us
I20260709 12:26:02.596985 17847 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.592962 17788 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.642148 17956 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:02.649221 17670 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:02.657691 17962 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:26:02.658813 17694 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:02.658630 17670 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.660929 17670 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.653488 17956 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.665982 17956 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:02.663326 17959 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:02.668752 17959 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.669653 17962 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 12. Current term is 13.
W20260709 12:26:02.712657 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 137579us
I20260709 12:26:02.720530 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.721951 12555 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
W20260709 12:26:02.753489 17902 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:02.768738 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.769552 17788 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:26:02.774245 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.776312 12629 raft_consensus.cc:2368] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16.
I20260709 12:26:02.784827 17746 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.786376 17746 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:02.784703 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 67320.9us
I20260709 12:26:02.784741 17961 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:02.793571 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:02.794349 12553 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.794543 12626 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:02.797856 17961 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.799984 17959 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.800900 17961 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:02.789767 17970 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:02.802381 17970 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.805850 17869 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:02.806744 17869 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.807204 12454 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 13, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 13 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:02.809000 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.809882 12630 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:26:02.805122 17970 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.832720 12558 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:26:02.833329 12558 pending_rounds.cc:85] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 7
I20260709 12:26:02.833678 12558 pending_rounds.cc:107] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:26:02.834040 12558 raft_consensus.cc:2889] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:02.843536 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.844276 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.844645 12706 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:26:02.845183 12704 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:26:02.849227 17746 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.824261 17869 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:02.854377 17844 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 10. Current term is 11.
I20260709 12:26:02.854892 12454 catalog_manager.cc:5697] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 13 to 14, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 14 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:02.856007 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
W20260709 12:26:02.859472 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 85047.4us
I20260709 12:26:02.859974 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.860924 13226 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 11: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:02.866832 12626 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
W20260709 12:26:02.865609 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 247701us
I20260709 12:26:02.870601 17959 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:02.871080 17959 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:02.871590 17959 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:02.878898 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.879807 12551 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:02.884267 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:02.885864 13228 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:02.888532 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:02.889676 12551 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:02.898379 12555 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:02.900952 13198 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.905383 12553 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:02.903471 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:02.913203 17788 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:02.916330 12555 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:02.918639 17825 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:02.920631 12522 leader_election.cc:400] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16.
I20260709 12:26:02.922343 12522 leader_election.cc:403] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:02.927412 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:02.928066 13228 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:02.928196 12703 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:26:02.928318 13232 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:02.929260 13232 raft_consensus.cc:606] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:02.929668 13232 raft_consensus.cc:614] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:02.931377 17788 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:02.932740 17788 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:02.934213 12551 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:02.923101 17954 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 15. Current term is 16.
I20260709 12:26:02.939015 13226 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:02.940398 12632 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:02.940985 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:02.945492 17972 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:02.945484 17954 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.946146 17972 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:02.946691 17972 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.946643 17954 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.950182 17832 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:02.953194 13201 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:02.953696 13226 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEARNER]: Advancing to term 11
I20260709 12:26:02.954290 17954 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:02.955191 17958 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:02.955688 17958 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.956054 17958 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:02.974848 17847 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
I20260709 12:26:02.984367 17893 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.985143 17893 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:02.987738 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 59245.4us
I20260709 12:26:02.990233 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:02.991180 12629 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:26:02.992537 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:02.993728 17956 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:02.993839 17844 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.994285 17956 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.994905 17956 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:02.994676 17844 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:02.997766 17844 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.000922 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:03.003649 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:03.003860 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:03.004530 12708 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:26:03.004724 12702 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:03.010051 13227 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:03.010927 13227 raft_consensus.cc:606] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:03.011467 13227 raft_consensus.cc:614] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:03.012086 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:03.012729 12699 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:26:03.015367 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.016531 12629 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:03.018085 17847 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:03.022075 17966 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:02.966627 17832 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:26:03.001331 13226 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:03.038987 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:03.039916 12555 raft_consensus.cc:2393] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 11: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:26:03.039819 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:03.041471 17441 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:03.041916 17441 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:03.042346 17441 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.055964 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.056495 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.056674 12633 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:26:03.057286 12626 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:26:03.058346 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:03.059010 12553 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:26:03.062879 17958 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.067075 17893 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.067814 17963 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 12:26:03.074608 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:03.074916 12598 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:03.075452 13226 raft_consensus.cc:2368] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:26:03.077215 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.078253 17869 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:03.078698 17869 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:03.079084 17869 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.078138 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:03.084128 17972 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.088440 12706 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:03.112545 12558 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:03.101219 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:03.126384 12626 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:03.110957 17972 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.162937 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793f816912494728bf76dd612942dc4c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:03.170409 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:03.179713 12706 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:03.177935 13228 raft_consensus.cc:606] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:03.180557 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.189545 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.192699 12699 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.181941 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:03.200459 17970 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:03.201189 17970 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:03.201778 17970 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:03.202735 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62427.3us
I20260709 12:26:03.182746 17958 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:26:03.221567 12704 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:03.163892 17869 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.231856 17441 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.235700 17968 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:03.220715 17972 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.245790 17986 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:26:03.246465 12633 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:03.254021 17441 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.241380 17968 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:03.256016 17968 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.244944 12522 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:03.259145 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:03.260051 17844 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:03.260455 17844 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.260650 12699 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:03.260861 17844 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.254902 12550 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:03.265533 17959 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:03.265600 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 102789us
I20260709 12:26:03.266650 17869 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.273521 17972 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.276367 17972 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.273538 12671 leader_election.cc:400] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:26:03.278343 12671 leader_election.cc:403] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:03.283385 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 55055.7us
I20260709 12:26:03.284184 17961 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for earlier term 11. Current term is 12.
I20260709 12:26:03.288823 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.289760 12699 raft_consensus.cc:2393] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 11: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:03.294234 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.277273 17956 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.310557 17969 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.311697 17964 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:03.312175 17964 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting leader election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:03.312587 17964 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.299957 17746 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.316466 17877 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:26:03.316556 17746 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.318682 17746 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.320587 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:03.330200 13226 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:03.329339 12550 raft_consensus.cc:1275] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:03.311213 17969 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:03.335850 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 76348.5us
I20260709 12:26:03.330678 17788 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:26:03.356408 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 179299us
I20260709 12:26:03.359346 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:03.362958 17970 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.367544 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:03.336608 17959 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.370121 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:03.371886 12550 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.374393 12705 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
W20260709 12:26:03.377748 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 80678us
I20260709 12:26:03.379711 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:03.380334 12553 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:03.378446 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.385923 12630 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 19.
I20260709 12:26:03.368738 17788 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:03.367274 17969 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:03.357570 17987 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 12:26:03.396589 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.405123 17989 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.405524 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:03.406219 12554 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 19.
I20260709 12:26:03.407847 17847 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:03.405851 17989 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.389372 17956 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.433436 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.411592 17982 consensus_queue.cc:1048] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:03.437245 12522 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:03.397214 17969 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:03.443639 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 54102.4us
I20260709 12:26:03.451822 17844 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.452849 17788 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.453897 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.454596 12626 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 19.
I20260709 12:26:03.458150 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:03.460126 17989 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.463898 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.464653 12703 raft_consensus.cc:2393] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 19: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:03.466841 17960 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:03.446969 17969 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.470386 17969 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.478333 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:03.481321 13226 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:26:03.482872 13228 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:03.483371 12550 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:03.479326 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.485224 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.483585 13228 raft_consensus.cc:606] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:03.470397 17970 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:03.486176 17746 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:03.493794 12633 raft_consensus.cc:2393] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
W20260709 12:26:03.497960 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52211.4us
I20260709 12:26:03.501868 17972 raft_consensus.cc:993] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:03.502353 17972 raft_consensus.cc:1081] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:03.508363 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.509704 17968 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.496109 17746 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.514627 17746 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.521737 12552 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:26:03.521898 17844 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:03.528051 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.537811 12699 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 13.
I20260709 12:26:03.509217 17958 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:03.547636 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.545868 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.552938 12700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "793f816912494728bf76dd612942dc4c"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:03.553730 12700 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:03.554157 12700 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.567587 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.568400 12626 raft_consensus.cc:3060] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.567472 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:03.528656 17968 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.569986 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.571152 12707 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.570571 12629 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:03.593151 17960 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:03.595326 17958 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:03.606652 12707 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:26:03.609510 12626 raft_consensus.cc:2468] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:03.610234 12523 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.621620 17973 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:03.624253 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:03.625139 13233 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:03.625722 13227 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:03.625964 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:03.626421 13227 raft_consensus.cc:2368] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12.
I20260709 12:26:03.626708 13233 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:03.626930 17973 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:03.627909 17973 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.629767 13234 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:03.631469 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:03.632215 12708 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:03.637040 12597 leader_election.cc:400] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12.
I20260709 12:26:03.637336 12597 leader_election.cc:403] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:26:03.638175 17996 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12.
I20260709 12:26:03.610899 17961 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.646157 17996 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:03.647882 17961 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:03.648348 17961 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.653539 17746 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.655877 17746 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:03.658212 12700 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.666141 12700 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.662201 17958 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.594566 17960 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.694766 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:03.699848 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:03.699954 17968 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:03.700251 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.700932 12629 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:03.708156 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:03.713099 13235 raft_consensus.cc:3055] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:03.714160 13235 raft_consensus.cc:740] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:03.722280 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:03.777667 13235 consensus_queue.cc:260] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.794144 13235 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.781591 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
W20260709 12:26:03.784811 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 63928.1us
I20260709 12:26:03.789486 17964 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.790899 17969 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.796880 17969 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:03.797153 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "793f816912494728bf76dd612942dc4c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:03.797783 12705 raft_consensus.cc:2368] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12.
I20260709 12:26:03.797845 12551 raft_consensus.cc:3060] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.800729 13226 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:03.801309 13226 raft_consensus.cc:606] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:03.802752 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:26:03.823932 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 101771us
W20260709 12:26:03.824740 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 104464us
I20260709 12:26:03.829584 12629 raft_consensus.cc:2468] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 20.
I20260709 12:26:03.831300 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:03.832530 17847 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:03.835201 12552 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Rejecting Update request from peer c6795b140b3247279a2231c6b9360d24 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:03.829670 13198 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:03.835112 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 58774.7us
I20260709 12:26:03.839840 13198 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:03.839239 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.841468 12629 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.846905 12551 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:03.827265 17989 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:03.848925 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:03.849823 13226 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:03.850517 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.851523 12630 raft_consensus.cc:2393] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 13: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:03.850396 18007 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:03.852574 17989 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.875366 12625 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:03.869535 17958 raft_consensus.cc:2804] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:03.886468 18007 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:03.906337 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.906497 18007 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.886647 17989 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.914465 12629 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 14.
I20260709 12:26:03.924788 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:03.925545 12558 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:03.929569 12554 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:03.937664 12674 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:03.941635 13235 raft_consensus.cc:2468] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:03.911362 17958 raft_consensus.cc:697] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:03.948431 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:03.952873 12555 raft_consensus.cc:1240] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:03.951767 12671 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.962661 17967 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:03.969990 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 226) took 2063 ms. Trace:
I20260709 12:26:03.971853 12598 leader_election.cc:400] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Vote denied by peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633) with higher term. Message: Invalid argument: T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12.
I20260709 12:26:03.973572 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:03.974452 12628 raft_consensus.cc:2393] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:03.970415 12671 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:03.962352 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:03.983122 17967 raft_consensus.cc:2804] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:03.983716 17967 raft_consensus.cc:697] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:03.984860 17967 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:03.974457 17966 raft_consensus.cc:2804] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:03.986186 17966 raft_consensus.cc:697] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:03.987381 17966 consensus_queue.cc:237] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:03.998998 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:03.971911 12454 rpcz_store.cc:276] 0709 12:26:01.906843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.914963 (+  8120us) service_pool.cc:224] Handling call
0709 12:26:03.969844 (+2054881us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:03.149486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:03.150615 (+  1129us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:03.150702 (+    87us) write_op.cc:435] Acquired schema lock
0709 12:26:03.150752 (+    50us) tablet.cc:662] Decoding operations
0709 12:26:03.151518 (+   766us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:03.151637 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:03.151680 (+    43us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:26:03.152192 (+   512us) tablet.cc:701] Row locks acquired
0709 12:26:03.152256 (+    64us) write_op.cc:260] PREPARE: finished
0709 12:26:03.152493 (+   237us) write_op.cc:270] Start()
0709 12:26:03.152680 (+   187us) write_op.cc:276] Timestamp: P: 1783599963152407 usec, L: 0
0709 12:26:03.152706 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:26:03.153727 (+  1021us) log.cc:844] Serialized 907 byte log entry
0709 12:26:03.186960 (+ 33233us) op_driver.cc:464] REPLICATION: finished
0709 12:26:03.260096 (+ 73136us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b1800241060. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e91978c0a 00007f0e9b0b8219 00007f0e91a00a40 00007f0e919fb4e4 00007f0e919fdc02 00007f0e98521ef0 00007f0e98522489 00007f0e9852471a 00007f0e985246a8
0709 12:26:03.398095 (+137999us) write_op.cc:301] APPLY: starting
0709 12:26:03.398201 (+   106us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:03.400198 (+  1997us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:03.400234 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:03.401644 (+  1410us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:03.401950 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0709 12:26:03.402010 (+    60us) write_op.cc:312] APPLY: finished
0709 12:26:03.402325 (+   315us) log.cc:844] Serialized 33 byte log entry
0709 12:26:03.433673 (+ 31348us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:03.433804 (+   131us) write_op.cc:454] Released schema lock
0709 12:26:03.433887 (+    83us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:03.434636 (+   749us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:03.434687 (+    51us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":479146,"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":210828,"apply.run_cpu_time_us":5180,"apply.run_wall_time_us":36387,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12503,"mutex_wait_us":10904,"num_ops":2,"prepare.queue_time_us":102547,"prepare.run_cpu_time_us":4808,"prepare.run_wall_time_us":31318,"replication_time_us":34007,"spinlock_wait_cycles":50813824,"thread_start_us":226280,"threads_started":2}]]}
W20260709 12:26:04.023836 12451 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 323) took 13387 ms (client timeout 15000 ms). Trace:
I20260709 12:26:04.033396 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:26:04.071151 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 133940us
W20260709 12:26:04.155381 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 96785.8us
W20260709 12:26:04.154521 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 107470us
W20260709 12:26:04.221295 17980 log.cc:927] Time spent T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:26:04.024384 12451 rpcz_store.cc:269] 0709 12:25:50.643409 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.657170 (+ 13761us) service_pool.cc:224] Handling call
0709 12:26:04.023621 (+13366451us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:02.133429 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:02.133993 (+   564us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:02.134027 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:26:02.134047 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:02.135227 (+  1180us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:02.135285 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:02.135321 (+    36us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:26:02.136646 (+  1325us) tablet.cc:701] Row locks acquired
0709 12:26:02.136668 (+    22us) write_op.cc:260] PREPARE: finished
0709 12:26:02.136809 (+   141us) write_op.cc:270] Start()
0709 12:26:02.136947 (+   138us) write_op.cc:276] Timestamp: P: 1783599962136768 usec, L: 0
0709 12:26:02.136972 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:26:02.137719 (+   747us) log.cc:844] Serialized 5498 byte log entry
0709 12:26:02.153640 (+ 15921us) op_driver.cc:464] REPLICATION: finished
0709 12:26:02.154043 (+   403us) write_op.cc:301] APPLY: starting
0709 12:26:02.154121 (+    78us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:02.262945 (+108824us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:02.263044 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:02.636262 (+373218us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:02.653104 (+ 16842us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0709 12:26:02.653164 (+    60us) write_op.cc:312] APPLY: finished
0709 12:26:02.661586 (+  8422us) log.cc:844] Serialized 129 byte log entry
0709 12:26:02.663498 (+  1912us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:02.667361 (+  3863us) write_op.cc:454] Released schema lock
0709 12:26:02.667416 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:02.667746 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:02.667773 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":92510,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":227,"apply.run_cpu_time_us":19356,"apply.run_wall_time_us":513652,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58632,"num_ops":14,"prepare.queue_time_us":6097,"prepare.run_cpu_time_us":4578,"prepare.run_wall_time_us":6139,"replication_time_us":16529}]]}
I20260709 12:26:04.222978 17991 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:26:04.225785 17993 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:26:04.147912 17788 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:26:04.233104 17989 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.234627 12706 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:04.235736 17989 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:04.172075 17958 consensus_queue.cc:237] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.262867 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:04.281953 17963 raft_consensus.cc:1064] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
W20260709 12:26:04.312408 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 145926us
I20260709 12:26:04.351034 12632 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:04.370061 12626 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:04.373776 18033 raft_consensus.cc:993] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:04.378135 17957 raft_consensus.cc:1081] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:04.379024 18005 raft_consensus.cc:993] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:04.379815 18005 raft_consensus.cc:1081] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:04.393565 17968 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:04.396034 13200 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.312356 17963 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 7, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.411175 12700 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:04.412001 12700 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:04.412443 12700 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:04.396015 18022 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:26:04.428393 12701 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:04.430752 12701 raft_consensus.cc:493] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:04.431181 12701 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:04.439139 18018 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.269s	user 0.003s	sys 0.000s
W20260709 12:26:04.447314 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.448112 12701 raft_consensus.cc:515] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.450318 12701 leader_election.cc:290] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:04.453269 12555 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:26:04.455829 12599 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:04.433058 17961 consensus_meta.cc:287] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: Time spent flushing consensus metadata: real 0.784s	user 0.013s	sys 0.000s
I20260709 12:26:04.459301 12700 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.467921 12559 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:04.478478 12701 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:04.484815 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:04.486070 12700 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:04.487622 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:04.488485 12557 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:04.498811 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:04.499604 13235 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:04.499959 13235 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:04.488088 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:04.504213 12554 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:04.504314 12559 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:04.520521 13235 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.463186 17961 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.537434 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:04.538153 13229 raft_consensus.cc:3055] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:04.538468 13229 raft_consensus.cc:740] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:04.539331 13229 consensus_queue.cc:260] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.540285 18028 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:26:04.541464 18028 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:04.541819 18028 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:04.542831 18028 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:04.544436 18028 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.545115 17964 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:04.545845 18025 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:26:04.547801 18003 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:26:04.551865 12557 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
W20260709 12:26:04.522454 18007 consensus_meta.cc:287] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent flushing consensus metadata: real 0.615s	user 0.014s	sys 0.000s
I20260709 12:26:04.555848 12559 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:26:04.561900 18004 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:04.562683 12554 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 18.
I20260709 12:26:04.576706 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:04.578075 12705 raft_consensus.cc:1240] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 LEADER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:04.585876 12699 raft_consensus.cc:1240] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:04.587000 12701 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:26:04.609861 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 82331.3us
W20260709 12:26:04.619187 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 121402us
I20260709 12:26:04.575765 18007 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.622743 17847 raft_consensus.cc:1027] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: attempt to promote peer 155b5b0a0b6d4b499edfe2797ffa5b91: there is already a config change operation in progress. Unable to promote follower until it completes. Doing nothing.
I20260709 12:26:04.626149 18007 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:04.603269 17968 consensus_queue.cc:1059] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
W20260709 12:26:04.635846 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 83437.1us
I20260709 12:26:04.636929 18036 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 12:26:04.646085 12704 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:04.646734 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:04.647329 12625 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.675933 13234 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEARNER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:04.702673 12699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45130 (request call id 2510) took 1037 ms. Trace:
I20260709 12:26:04.703372 12699 rpcz_store.cc:276] 0709 12:26:03.664862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.664974 (+   112us) service_pool.cc:224] Handling call
0709 12:26:03.665254 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:04.586311 (+921057us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.702351 (+116040us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54000fcdd4. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94aebe01 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2 00007f0e92e2648c 00007f0e92e258c6
0709 12:26:04.702588 (+   237us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2116818688}
I20260709 12:26:04.666002 17968 consensus_queue.cc:1243] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer c6795b140b3247279a2231c6b9360d24 log is divergent from this leader: its last log entry 20.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:26:04.747021 17961 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:04.731269 18021 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:26:04.753046 18024 log.cc:927] Time spent T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.469s	user 0.005s	sys 0.000s
I20260709 12:26:04.758931 12625 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:26:04.762614 18037 raft_consensus.cc:3055] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:04.763266 18037 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:04.772893 12700 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17.
I20260709 12:26:04.764411 18037 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:04.826344 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 148021us
W20260709 12:26:04.830683 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.778473 18007 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:26:04.780795 18003 consensus_queue.cc:1059] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.049s
I20260709 12:26:04.837203 18047 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.056s
W20260709 12:26:04.839500 18046 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.274s	user 0.005s	sys 0.000s
I20260709 12:26:04.826447 17959 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:04.826624 18050 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:04.855958 18003 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:04.856402 18003 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:04.857311 18003 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:04.858749 18003 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:04.847981 17959 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:04.847970 18050 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:04.866199 17959 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:04.868144 18050 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:04.847388 18037 raft_consensus.cc:3060] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:04.916167 12626 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:26:04.921031 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:04.931917 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:04.935565 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:04.941354 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:04.950627 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:04.951254 12705 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.984549 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:04.958043 17969 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:26:05.005861 12705 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
W20260709 12:26:05.007892 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52374.8us
W20260709 12:26:05.008193 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 61133.9us
I20260709 12:26:05.011199 13199 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:05.017113 17971 raft_consensus.cc:2804] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:05.026528 17873 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:05.042961 12699 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:05.063901 12674 leader_election.cc:304] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:05.064826 17967 raft_consensus.cc:2804] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:05.064895 12674 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:05.072516 17873 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:05.072995 17873 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:05.073963 17873 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.065871 17967 raft_consensus.cc:697] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:05.068867 18048 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:05.078753 12556 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260709 12:26:05.079242 12556 pending_rounds.cc:85] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Aborting all ops after (but not including) 12
I20260709 12:26:05.079460 12556 pending_rounds.cc:107] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260709 12:26:05.069032 18050 consensus_queue.cc:1059] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:05.075310 12550 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:26:05.080503 18050 raft_consensus.cc:3055] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:05.079689 12556 raft_consensus.cc:2889] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:05.080906 18050 raft_consensus.cc:740] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:05.078652 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.084650 12553 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:05.085783 12674 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:05.091989 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:05.093240 12556 raft_consensus.cc:1240] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:26:05.093708 18039 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:05.095971 18034 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:05.096539 18034 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:05.097484 18034 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.097709 18050 consensus_queue.cc:260] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:05.108100 13199 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.098862 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:05.109910 12557 raft_consensus.cc:3060] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.112887 12632 raft_consensus.cc:1275] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:26:05.172598 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 157017us
I20260709 12:26:05.171217 12699 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:05.176667 12557 raft_consensus.cc:2468] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:26:05.076407 17967 consensus_queue.cc:237] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.165458 17788 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:05.179000 17970 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260709 12:26:05.199707 12456 catalog_manager.cc:5697] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.205864 18062 consensus_queue.cc:1048] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 12:26:05.206100 17788 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.181435 18050 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:05.183216 17969 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:26:05.180641 17971 raft_consensus.cc:697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:05.233074 18047 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:05.234419 18047 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:05.284229 17788 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:05.283658 17971 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.246040 17996 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.302944 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:05.307338 18047 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:05.310688 18045 raft_consensus.cc:493] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:05.311316 18045 raft_consensus.cc:515] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:05.317592 17996 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.319585 18045 leader_election.cc:290] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:05.320026 17996 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:05.321789 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:05.332361 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:05.334337 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.337800 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:05.341280 12598 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:05.353034 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:05.362993 12551 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:05.334918 18068 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:05.304986 18048 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Committing config change with OpId 11.9: config changed from index 7 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:05.368465 12444 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 23740bafdb794232879a0bb6884f7a68 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:05.357453 12706 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:05.372218 13201 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:05.385324 17746 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:05.382031 18068 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:05.391634 18068 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:05.400571 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:05.407761 13228 raft_consensus.cc:1275] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:05.410998 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:05.428426 17844 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:05.432698 17844 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:05.435225 17844 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:05.432718 12554 raft_consensus.cc:1240] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:05.443295 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.394109 18067 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:05.419543 18037 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:05.456027 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.478737 17901 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:05.479327 17901 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.480060 18042 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:05.484213 18042 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:05.485152 18042 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:05.448487 18045 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:05.453174 17996 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:05.528370 17996 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.477133 18062 consensus_queue.cc:1059] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:26:05.538237 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:05.540410 12671 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.530668 17996 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:05.542979 17901 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:05.562637 13229 raft_consensus.cc:3060] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:05.588063 12671 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 606f6695c1e84da291559cacabfa82bc. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:05.613095 18028 consensus_queue.cc:1048] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:05.643663 13229 raft_consensus.cc:2468] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:26:05.645205 13229 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1180) took 1191 ms. Trace:
I20260709 12:26:05.645570 13229 rpcz_store.cc:276] 0709 12:26:04.452520 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.458118 (+  5598us) service_pool.cc:224] Handling call
0709 12:26:05.343919 (+885801us) spinlock_profiling.cc:243] Waited 478 ms on lock 0x7b180006cde0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94b26646 00007f0e94a6058e 00007f0e94ae1f9e 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:26:05.562121 (+218202us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b58008801d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:26:05.644255 (+ 82134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1599240704}
I20260709 12:26:05.617743 17746 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:05.669696 12553 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:26:05.674192 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 265637us
I20260709 12:26:05.683022 12600 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:05.685918 12632 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:05.692802 13235 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:05.692916 12557 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:05.696540 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:05.674261 17746 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:05.722838 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.687183 17994 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:26:05.738015 17877 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:26:05.690430 17982 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:26:05.746207 17746 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:05.753789 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 45319.7us
W20260709 12:26:05.812731 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 72584.4us
I20260709 12:26:05.816283 13235 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 18.
W20260709 12:26:05.817035 13235 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50990 (request call id 1181) took 1329 ms (client timeout 1646 ms). Trace:
W20260709 12:26:05.817577 13235 rpcz_store.cc:269] 0709 12:26:04.487724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.498566 (+ 10842us) service_pool.cc:224] Handling call
0709 12:26:05.665260 (+1166694us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b58009815d0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e94a54571 00007f0e94a470aa 00007f0e94ac9447 00007f0e94ae1fe7 00007f0e94ae37de 00007f0e94aef27c 00007f0e99ab0b17 00007f0e9302b6d4 00007f0e9302b662 00007f0e9302b591 00007f0e9302b50c
0709 12:26:05.816975 (+151715us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1287365376}
I20260709 12:26:05.819924 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.840430 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:05.846904 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 92169.1us
I20260709 12:26:05.817169 18069 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.865557 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:05.868860 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:05.830402 18085 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:05.876775 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:05.883527 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:05.865100 18050 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:05.870450 17746 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:05.864162 18069 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.894484 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:05.895503 18032 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:26:05.897536 18050 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:05.904897 18050 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:05.916422 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:05.922771 18047 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:05.923388 18047 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:05.922994 13231 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:05.925603 18047 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:05.927055 13234 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:05.928433 13232 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:26:05.928987 13232 pending_rounds.cc:85] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting all ops after (but not including) 10
I20260709 12:26:05.932924 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:05.929231 13232 pending_rounds.cc:107] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:26:05.935084 13232 raft_consensus.cc:2889] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:05.936609 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.953578 12550 raft_consensus.cc:1275] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:26:05.962409 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:05.962796 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.966862 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28c65936613f4ee89e3dc89d06a91776" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:05.975580 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:05.986696 18026 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:26:05.988446 18091 log.cc:927] Time spent T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
I20260709 12:26:05.989027 17961 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:05.951001 18068 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:05.966001 18087 log.cc:927] Time spent T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.142s	user 0.000s	sys 0.001s
I20260709 12:26:05.997539 12699 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 17: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:26:06.008939 12554 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:06.019088 12629 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:06.022063 18099 ts_tablet_manager.cc:933] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:06.028625 17972 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:26:06.036593 12699 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:06.037698 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:06.038300 13235 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:06.009028 18064 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:06.039806 17972 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:06.025254 18068 consensus_queue.cc:1048] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 12:26:06.058308 12629 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:06.051882 17973 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:06.076658 18069 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:06.084542 18099 tablet_copy_client.cc:323] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:26:06.095291 12703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33230 (request call id 1406) took 1131 ms. Trace:
I20260709 12:26:06.095736 12703 rpcz_store.cc:276] 0709 12:26:04.950326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.955494 (+  5168us) service_pool.cc:224] Handling call
0709 12:26:04.955802 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:05.185339 (+229537us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:05.185372 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:05.860361 (+674989us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b2c0003d958. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e933e4a11 00007f0e933f4372 00007f0e94b26a01 00007f0e94aeb43a 00007f0e94aea83e 00007f0e99aaf419 00007f0e93026bd4 00007f0e93026b62 00007f0e93026a91 00007f0e93026a0c 00007f0e93025cc2
0709 12:26:05.867130 (+  6769us) log.cc:844] Serialized 26 byte log entry
0709 12:26:06.005930 (+138800us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:06.005976 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.006059 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:06.079335 (+ 73276us) raft_consensus.cc:1685] finished
0709 12:26:06.079355 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:06.081963 (+  2608us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":24858,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89,"spinlock_wait_cycles":3269504,"thread_start_us":329095,"threads_started":2,"wal-append.queue_time_us":180449}
I20260709 12:26:06.100785 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:06.101743 13230 raft_consensus.cc:606] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:06.081828 17973 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:06.106232 17973 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:06.144336 17788 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:06.194265 13230 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:06.337421 17788 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:06.441190 17788 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:06.466437 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:06.467501 13235 raft_consensus.cc:606] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:06.480406 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 287437us
I20260709 12:26:06.475493 12551 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:06.490485 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:26:06.494786 13231 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.009s	sys 0.003s
W20260709 12:26:06.502133 13231 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.009s	sys 0.003s
I20260709 12:26:06.495777 17961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41610 (request call id 0) took 1390 ms. Trace:
I20260709 12:26:06.527092 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:06.508780 17963 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:06.531149 17963 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:06.543702 17963 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:06.570349 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:06.592324 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:06.595511 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:06.599462 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:06.591853 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 606f6695c1e84da291559cacabfa82bc from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:26:06.625000 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 606f6695c1e84da291559cacabfa82bc from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-606f6695c1e84da291559cacabfa82bc
W20260709 12:26:06.660987 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 55053.7us
I20260709 12:26:06.662909 13201 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.663691 18063 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:06.679198 18064 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.679795 18064 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:06.682477 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 181244us
I20260709 12:26:06.525085 17961 rpcz_store.cc:276] 0709 12:26:05.097454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.112862 (+ 15408us) service_pool.cc:224] Handling call
0709 12:26:05.222969 (+110107us) log.cc:844] Serialized 492 byte log entry
0709 12:26:06.487993 (+1265024us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11949,"raft.queue_time_us":14000,"raft.run_cpu_time_us":1813,"raft.run_wall_time_us":1811,"thread_start_us":56463,"threads_started":1,"wal-append.queue_time_us":170737}
I20260709 12:26:06.682171 18064 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:06.691118 18109 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260709 12:26:06.704526 17788 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:06.691262 18102 log.cc:927] Time spent T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260709 12:26:06.714371 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 230754us
W20260709 12:26:06.732383 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 48786us
I20260709 12:26:06.738389 18069 raft_consensus.cc:993] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:06.739003 18069 raft_consensus.cc:1081] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:06.721215 17988 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.740371 17988 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:06.746029 18004 raft_consensus.cc:993] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
W20260709 12:26:06.750738 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 147804us
W20260709 12:26:06.752105 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 186199us
I20260709 12:26:06.751421 12551 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Committing config change with OpId 11.9: config changed from index 7 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:06.752851 12600 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.744575 17988 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:06.757223 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:06.757990 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:06.762194 12705 raft_consensus.cc:2393] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:06.766034 12600 leader_election.cc:304] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.767338 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:06.768035 13229 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:06.769521 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:06.770650 18111 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:06.771054 18111 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.771450 18111 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:06.772055 12718 tablet_copy_source_session.cc:215] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:06.768486 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:06.773943 17963 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:06.780331 18107 log.cc:927] Time spent T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.236s	user 0.006s	sys 0.000s
I20260709 12:26:06.780802 17988 raft_consensus.cc:2749] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:06.781077 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:06.765388 18047 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.784353 18004 raft_consensus.cc:1081] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:06.791843 12625 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.793303 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:06.794346 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.796834 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:06.793910 13231 raft_consensus.cc:606] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.803253 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:06.804472 12703 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:06.806348 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:06.807179 12706 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:06.809453 12625 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:06.811193 17901 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:06.811909 17901 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:06.818061 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.813262 18061 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:06.827284 13231 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:06.827917 13231 raft_consensus.cc:606] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:06.813540 18006 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:06.832021 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:06.833568 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:06.830438 18045 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:06.829442 18099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 606f6695c1e84da291559cacabfa82bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:06.830201 17901 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:06.837719 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:06.828166 18111 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:06.839417 12627 raft_consensus.cc:2368] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11.
I20260709 12:26:06.836798 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:06.845778 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:06.846377 13230 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:26:06.861040 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:06.862800 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:06.863557 12700 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:06.861763 12628 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 17.
I20260709 12:26:06.842998 18042 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:06.872553 18113 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260709 12:26:06.876999 12600 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:06.878413 12600 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:06.884228 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:06.846556 18111 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:06.889192 17988 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:06.896662 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:06.894502 13230 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:26:06.900542 18114 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:06.900974 18114 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:06.901793 18121 log.cc:927] Time spent T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.132s	user 0.002s	sys 0.000s
I20260709 12:26:06.901337 18114 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:06.884637 18119 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:06.905869 12505 auto_rebalancer.cc:629] Failed to schedule move for tablet af0709be9e0d4bf39ce083c7af243837: Illegal state: Replica a2a8d71f644447218c1afc3e5f7716cd is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:06.913779 12700 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:26:06.915844 17844 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:06.919344 12597 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:06.926390 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:06.927289 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:06.911008 18114 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:06.954092 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 92708us
I20260709 12:26:06.931486 18111 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:07.005584 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:07.004235 18111 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:07.036094 12627 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:26:07.036769 12627 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.037334 12627 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.043151 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:07.059590 12627 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.064021 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:07.064630 13231 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:07.064935 13231 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:07.027622 18130 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:07.067888 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:07.068490 12550 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.065539 12627 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:07.074923 18129 log.cc:927] Time spent T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:26:07.031822 17901 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260709 12:26:07.081980 18122 raft_consensus.cc:993] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:07.082522 18122 raft_consensus.cc:1081] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:07.082823 13231 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.083751 13231 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.084704 18111 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.090996 12626 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:07.095613 12630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:26:07.096153 12630 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.096490 12630 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:07.098330 12550 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:07.099993 12600 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:07.115517 13198 leader_election.cc:400] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11.
I20260709 12:26:07.115903 13198 leader_election.cc:403] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:07.115866 13231 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:07.123554 18118 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:07.124687 18118 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:07.130157 12630 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.139879 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:07.140633 12550 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:07.151678 12550 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 17.
I20260709 12:26:07.126714 18038 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669) with higher term. Message: Invalid argument: T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 10. Current term is 11.
I20260709 12:26:07.153816 12600 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:07.160881 12706 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:07.164237 12706 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.164590 12706 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:26:07.167354 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 52005us
I20260709 12:26:07.173063 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:07.173666 13229 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:07.173993 13229 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:07.175028 12554 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:07.167987 18047 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:07.182732 18047 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:07.183421 13229 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.183656 18047 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.184448 13229 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:07.185951 12703 raft_consensus.cc:1240] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Rejecting Update request from peer 23740bafdb794232879a0bb6884f7a68 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:26:07.192924 13229 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 17.
I20260709 12:26:07.204880 18063 raft_consensus.cc:993] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:07.205437 18063 raft_consensus.cc:1081] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:07.201620 18118 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.213884 17893 raft_consensus.cc:993] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:07.214452 17893 raft_consensus.cc:1081] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:07.218968 12706 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.221953 18114 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:07.223133 17973 consensus_queue.cc:1059] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:07.223986 17973 raft_consensus.cc:3055] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:07.224331 17973 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
W20260709 12:26:07.224937 13198 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.225139 17973 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:07.227887 17973 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.232028 12630 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:07.232939 12557 raft_consensus.cc:1240] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:07.247040 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:07.255636 12706 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:07.264995 12456 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 347) took 16851 ms (client timeout 15000 ms). Trace:
I20260709 12:26:07.268020 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:07.269739 12630 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:07.281177 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:07.288429 13229 raft_consensus.cc:3055] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:07.288816 13229 raft_consensus.cc:740] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:07.289836 13229 consensus_queue.cc:260] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.290092 12630 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:26:07.291448 13229 raft_consensus.cc:3060] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:07.280820 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:07.298471 12628 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:07.298630 18113 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:07.299618 12453 catalog_manager.cc:5697] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 7 to 11, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:07.303663 12671 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:07.318413 18099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50990 (request call id 1193) took 1404 ms. Trace:
W20260709 12:26:07.318686 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 54680.6us
I20260709 12:26:07.318917 18099 rpcz_store.cc:276] 0709 12:26:05.914437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.914548 (+   111us) service_pool.cc:224] Handling call
0709 12:26:06.022433 (+107885us) ts_tablet_manager.cc:934] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
0709 12:26:06.800352 (+777919us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:07.059862 (+259510us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:07.059984 (+   122us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:07.317654 (+257670us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:07.317946 (+   292us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:07.318256 (+   310us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:07.318330 (+    74us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":1313,"tablet-copy.queue_time_us":91509,"thread_start_us":94000,"threads_started":2}
I20260709 12:26:07.321596 13229 raft_consensus.cc:2468] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 8.
I20260709 12:26:07.334249 18026 raft_consensus.cc:2804] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:07.335012 18026 raft_consensus.cc:697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:07.336203 18026 consensus_queue.cc:237] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.342229 18137 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:26:07.344213 12522 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 39edb149903d45b5a17cbbc4dd12850b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.348711 12706 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:26:07.272159 12456 rpcz_store.cc:269] 0709 12:25:50.413507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.413822 (+   315us) service_pool.cc:224] Handling call
0709 12:26:07.264900 (+16851078us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:05.540994 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:05.602504 (+ 61510us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:05.602547 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:26:05.602569 (+    22us) tablet.cc:662] Decoding operations
0709 12:26:05.603119 (+   550us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:05.603180 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:05.603211 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:05.603529 (+   318us) tablet.cc:701] Row locks acquired
0709 12:26:05.603548 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:05.603713 (+   165us) write_op.cc:270] Start()
0709 12:26:05.603838 (+   125us) write_op.cc:276] Timestamp: P: 1783599965603660 usec, L: 0
0709 12:26:05.603861 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:26:05.604631 (+   770us) log.cc:844] Serialized 535 byte log entry
0709 12:26:05.889856 (+285225us) op_driver.cc:464] REPLICATION: finished
0709 12:26:06.025392 (+135536us) write_op.cc:301] APPLY: starting
0709 12:26:06.035830 (+ 10438us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:06.056600 (+ 20770us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:06.056750 (+   150us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:06.128944 (+ 72194us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:06.137197 (+  8253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0709 12:26:06.137283 (+    86us) write_op.cc:312] APPLY: finished
0709 12:26:06.137584 (+   301us) log.cc:844] Serialized 25 byte log entry
0709 12:26:06.137770 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:06.137847 (+    77us) write_op.cc:454] Released schema lock
0709 12:26:06.137885 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:06.138321 (+   436us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:06.138370 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":272,"reported_tablets":48,"child_traces":[["op",{"apply.queue_time_us":119227,"apply.run_cpu_time_us":4374,"apply.run_wall_time_us":119992,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8315,"num_ops":1,"prepare.queue_time_us":126753,"prepare.run_cpu_time_us":38114,"prepare.run_wall_time_us":277502,"raft.queue_time_us":56425,"raft.run_cpu_time_us":8121,"raft.run_wall_time_us":16277,"replication_time_us":285744,"thread_start_us":232873,"threads_started":4,"wal-append.queue_time_us":223614,"wal-append.run_cpu_time_us":11569,"wal-append.run_wall_time_us":1311825}]]}
I20260709 12:26:07.321337 18099 tablet_copy_client.cc:806] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:07.353513 18006 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:07.371152 12453 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 7 to 8, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 8 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:07.380136 18099 tablet_copy_client.cc:670] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:07.401283 12453 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:07.415650 18099 tablet_copy_client.cc:538] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:07.419245 12630 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:26:07.420035 12630 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.420603 12630 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:07.422346 12628 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:26:07.422878 12628 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:07.423219 12628 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.444438 12630 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.455322 12629 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:07.458088 12628 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.464313 18038 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:07.465629 18038 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:07.466040 18038 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:07.466992 18038 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.468387 18038 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:07.470681 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:07.471330 12552 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:07.478916 12552 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:07.479401 18099 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:26:07.480494 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:07.481182 12552 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.485634 12600 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:07.488097 18118 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:07.488641 18118 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:07.489583 18118 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.489972 17973 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:07.497985 12552 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:07.502156 12600 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:07.495244 12703 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:07.511948 12630 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:07.525336 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:07.525784 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:07.537040 13235 raft_consensus.cc:3055] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:07.537462 13235 raft_consensus.cc:740] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:07.543345 13235 consensus_queue.cc:260] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.544931 12628 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:07.512697 18147 raft_consensus.cc:2804] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:07.547016 13235 raft_consensus.cc:3060] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.558712 12703 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:07.552894 18147 raft_consensus.cc:697] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:07.575232 17982 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:07.583457 18147 consensus_queue.cc:237] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:07.593678 12625 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:07.627691 12552 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:07.629580 17982 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:07.633359 13231 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:07.635255 18118 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:07.640667 13235 raft_consensus.cc:2468] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:07.642445 13230 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:07.674603 13229 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:07.676575 17982 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:07.678176 12628 raft_consensus.cc:1240] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:07.684885 13235 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:07.692390 17988 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:07.716355 12552 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:07.723279 18147 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:07.772162 12703 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:07.823583 18099 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:07.824688 18099 tablet_bootstrap.cc:492] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:26:07.833485 18099 ts_tablet_manager.cc:1403] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.354s	user 0.044s	sys 0.004s
I20260709 12:26:07.869158 12625 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:07.871088 18115 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.003s
I20260709 12:26:07.875602 12557 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:07.878429 17994 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:07.881989 18166 ts_tablet_manager.cc:933] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
W20260709 12:26:07.890380 12671 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 28c65936613f4ee89e3dc89d06a91776. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:07.918607 18166 tablet_copy_client.cc:323] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:26:07.925735 17967 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:07.928151 12568 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet 39edb149903d45b5a17cbbc4dd12850b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:26:07.928804 12568 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet 39edb149903d45b5a17cbbc4dd12850b from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-39edb149903d45b5a17cbbc4dd12850b
I20260709 12:26:07.928655 18099 raft_consensus.cc:359] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:07.929582 18099 raft_consensus.cc:740] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:26:07.933213 12628 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:26:07.939157 12568 tablet_copy_source_session.cc:215] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:07.932408 12552 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:07.930282 18099 consensus_queue.cc:260] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:07.950991 18099 ts_tablet_manager.cc:1434] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.112s	user 0.007s	sys 0.000s
I20260709 12:26:07.954222 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-606f6695c1e84da291559cacabfa82bc received from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:07.954710 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-606f6695c1e84da291559cacabfa82bc on tablet 606f6695c1e84da291559cacabfa82bc with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:07.976349 13229 raft_consensus.cc:1275] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:26:07.971907 18115 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:07.993064 18166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39edb149903d45b5a17cbbc4dd12850b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:07.999884 13230 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:07.983925 12451 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:08.002637 18118 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:08.009958 12451 catalog_manager.cc:5697] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:08.014626 12453 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 325) took 23870 ms (client timeout 15000 ms). Trace:
I20260709 12:26:08.013216 12451 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 11, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.016633 12451 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 9, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:08.019524 12552 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:08.021354 17988 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:08.028069 12629 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Committing config change with OpId 15.9: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:08.018311 12451 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:08.015082 12453 rpcz_store.cc:269] 0709 12:25:44.144825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.146032 (+  1207us) service_pool.cc:224] Handling call
0709 12:26:08.014549 (+23868517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:07.540122 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:07.540672 (+   550us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:07.540708 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:26:07.540734 (+    26us) tablet.cc:662] Decoding operations
0709 12:26:07.541266 (+   532us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:07.541337 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:07.541362 (+    25us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:07.541702 (+   340us) tablet.cc:701] Row locks acquired
0709 12:26:07.541722 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:07.541849 (+   127us) write_op.cc:270] Start()
0709 12:26:07.541965 (+   116us) write_op.cc:276] Timestamp: P: 1783599967541804 usec, L: 0
0709 12:26:07.541987 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:07.546751 (+  4764us) log.cc:844] Serialized 1294 byte log entry
0709 12:26:07.861235 (+314484us) op_driver.cc:464] REPLICATION: finished
0709 12:26:07.907701 (+ 46466us) write_op.cc:301] APPLY: starting
0709 12:26:07.907787 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:07.926678 (+ 18891us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:07.926793 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:07.929238 (+  2445us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:07.929529 (+   291us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=0,mrs_lookups=0
0709 12:26:07.929582 (+    53us) write_op.cc:312] APPLY: finished
0709 12:26:07.929805 (+   223us) log.cc:844] Serialized 41 byte log entry
0709 12:26:07.931577 (+  1772us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:07.931672 (+    95us) write_op.cc:454] Released schema lock
0709 12:26:07.931715 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:07.937560 (+  5845us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:07.937593 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64184,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":46156,"apply.run_cpu_time_us":6613,"apply.run_wall_time_us":29843,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16691,"num_ops":3,"prepare.queue_time_us":54264,"prepare.run_cpu_time_us":27201,"prepare.run_wall_time_us":222129,"raft.queue_time_us":40908,"raft.run_cpu_time_us":8592,"raft.run_wall_time_us":43770,"replication_time_us":319103,"thread_start_us":321768,"threads_started":4,"wal-append.queue_time_us":248956}]]}
I20260709 12:26:08.046129 12451 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.048918 12451 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 6 to 8, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 8 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:08.056813 18026 consensus_queue.cc:1048] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
W20260709 12:26:08.109982 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46222.4us
I20260709 12:26:08.104732 12451 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:08.130759 12451 catalog_manager.cc:5697] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 12, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.137787 12451 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.141969 18166 tablet_copy_client.cc:806] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:08.146014 18166 tablet_copy_client.cc:670] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:08.164083 18166 tablet_copy_client.cc:538] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:08.188235 12556 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:26:08.193508 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 124739us
I20260709 12:26:08.197548 18147 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 12:26:08.215998 13235 raft_consensus.cc:1275] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:08.223170 18180 consensus_queue.cc:1048] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:08.245517 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.282876 13229 raft_consensus.cc:1217] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.8->[12.9-12.9]   Dedup: 12.9->[]
I20260709 12:26:08.315182 18166 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:26:08.315361 18099 ts_tablet_manager.cc:933] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:08.315737 12451 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 227) took 3479 ms. Trace:
I20260709 12:26:08.318293 12451 rpcz_store.cc:276] 0709 12:26:04.836776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:04.841166 (+  4390us) service_pool.cc:224] Handling call
0709 12:26:08.315657 (+3474491us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.257981 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.258462 (+   481us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.258490 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:26:08.258507 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:08.261331 (+  2824us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.261388 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.261434 (+    46us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:26:08.262172 (+   738us) tablet.cc:701] Row locks acquired
0709 12:26:08.262189 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:08.262321 (+   132us) write_op.cc:270] Start()
0709 12:26:08.262468 (+   147us) write_op.cc:276] Timestamp: P: 1783599968262279 usec, L: 0
0709 12:26:08.262495 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.263085 (+   590us) log.cc:844] Serialized 3981 byte log entry
0709 12:26:08.265286 (+  2201us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.265765 (+   479us) write_op.cc:301] APPLY: starting
0709 12:26:08.265852 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.275381 (+  9529us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.275473 (+    92us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.281191 (+  5718us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.281444 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=20,key_file_lookups=20,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.281499 (+    55us) write_op.cc:312] APPLY: finished
0709 12:26:08.281819 (+   320us) log.cc:844] Serialized 97 byte log entry
0709 12:26:08.283945 (+  2126us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.284146 (+   201us) write_op.cc:454] Released schema lock
0709 12:26:08.284201 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.288766 (+  4565us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.288800 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44226,"reported_tablets":13,"child_traces":[["op",{"apply.queue_time_us":271,"apply.run_cpu_time_us":12841,"apply.run_wall_time_us":22912,"cfile_cache_hit":40,"cfile_cache_hit_bytes":41880,"num_ops":10,"prepare.queue_time_us":1403,"prepare.run_cpu_time_us":3574,"prepare.run_wall_time_us":5347,"replication_time_us":2650}]]}
I20260709 12:26:08.350785 12452 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 13 to 18, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 18 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:08.362735 18099 tablet_copy_client.cc:323] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:26:08.367872 12452 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:08.369768 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 28c65936613f4ee89e3dc89d06a91776 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:26:08.370369 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 28c65936613f4ee89e3dc89d06a91776 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-28c65936613f4ee89e3dc89d06a91776
I20260709 12:26:08.370352 12452 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.391419 12718 tablet_copy_source_session.cc:215] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:08.387370 12452 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 10 to 12, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.400586 18099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28c65936613f4ee89e3dc89d06a91776. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:08.414454 12452 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 10 to 15, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 15 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:08.416445 12452 catalog_manager.cc:5697] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:08.430157 12452 catalog_manager.cc:5697] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 9 to 14, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 14 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.442858 12452 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 8 to 15. New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:08.479152 12452 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 12 to 14, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:08.543366 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:08.543978 13235 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:08.544288 13235 raft_consensus.cc:614] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:08.560592 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:08.561218 13235 raft_consensus.cc:606] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:08.566478 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:08.567044 13230 raft_consensus.cc:606] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:08.567377 13230 raft_consensus.cc:614] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:08.578671 18099 tablet_copy_client.cc:806] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:08.578730 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:08.579957 13235 raft_consensus.cc:606] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:08.580490 13235 raft_consensus.cc:614] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:08.583597 13235 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:08.584295 13235 raft_consensus.cc:606] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:08.584769 13235 raft_consensus.cc:614] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:08.586400 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:08.579445 18099 tablet_copy_client.cc:670] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:08.594383 12452 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 326) took 8390 ms. Trace:
I20260709 12:26:08.595614 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:08.595511 18099 tablet_copy_client.cc:538] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:08.600510 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.613178 18099 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:26:08.631770 18166 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:08.594734 12452 rpcz_store.cc:276] 0709 12:26:00.204048 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.204256 (+   208us) service_pool.cc:224] Handling call
0709 12:26:08.594325 (+8390069us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:08.528157 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:08.528686 (+   529us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:08.528719 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:26:08.528736 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:08.529607 (+   871us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:08.529658 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:08.529686 (+    28us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:26:08.530395 (+   709us) tablet.cc:701] Row locks acquired
0709 12:26:08.530409 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:26:08.530543 (+   134us) write_op.cc:270] Start()
0709 12:26:08.530652 (+   109us) write_op.cc:276] Timestamp: P: 1783599968530501 usec, L: 0
0709 12:26:08.530674 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:08.531267 (+   593us) log.cc:844] Serialized 3648 byte log entry
0709 12:26:08.534157 (+  2890us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.534502 (+   345us) write_op.cc:301] APPLY: starting
0709 12:26:08.534579 (+    77us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:08.539181 (+  4602us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:08.539276 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:08.546057 (+  6781us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:08.546363 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=0,mrs_lookups=0
0709 12:26:08.546437 (+    74us) write_op.cc:312] APPLY: finished
0709 12:26:08.546800 (+   363us) log.cc:844] Serialized 89 byte log entry
0709 12:26:08.547550 (+   750us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.547671 (+   121us) write_op.cc:454] Released schema lock
0709 12:26:08.547719 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:08.559216 (+ 11497us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:08.559247 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":197668,"reported_tablets":47,"spinlock_wait_cycles":1358080,"child_traces":[["op",{"apply.queue_time_us":113,"apply.run_cpu_time_us":11271,"apply.run_wall_time_us":24674,"cfile_cache_hit":36,"cfile_cache_hit_bytes":37692,"num_ops":9,"prepare.queue_time_us":13085,"prepare.run_cpu_time_us":3383,"prepare.run_wall_time_us":3383,"replication_time_us":3329}]]}
I20260709 12:26:08.617681 12454 catalog_manager.cc:5697] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 11 to 12, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 12 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:09.262378 12454 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:09.100759 18166 tablet_bootstrap.cc:492] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:26:09.265134 18166 ts_tablet_manager.cc:1403] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.952s	user 0.047s	sys 0.043s
I20260709 12:26:09.196920 18099 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=9 overwritten=0 applied=9 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:09.268491 18099 tablet_bootstrap.cc:492] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:26:09.268512 18166 raft_consensus.cc:359] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:09.269253 18099 ts_tablet_manager.cc:1403] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.656s	user 0.044s	sys 0.007s
I20260709 12:26:09.269507 18166 raft_consensus.cc:740] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:26:09.270241 18166 consensus_queue.cc:260] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:09.272190 18099 raft_consensus.cc:359] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:09.272701 18166 ts_tablet_manager.cc:1434] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:26:09.273015 18099 raft_consensus.cc:740] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:26:09.230726 18190 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.274431 18190 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.276232 18190 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.278357 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 18 to 19, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 19 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.280138 12454 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:09.281720 18099 consensus_queue.cc:260] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:09.281755 12454 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 14 to 15, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:09.283725 18099 ts_tablet_manager.cc:1434] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:26:09.284050 12454 catalog_manager.cc:5697] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:09.383910 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-28c65936613f4ee89e3dc89d06a91776 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:09.384375 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-28c65936613f4ee89e3dc89d06a91776 on tablet 28c65936613f4ee89e3dc89d06a91776 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:09.427747 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:09.432698 13230 raft_consensus.cc:1217] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
I20260709 12:26:09.428601 12704 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 18.
W20260709 12:26:09.487825 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 46874.6us
I20260709 12:26:09.444422 18210 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:09.604010 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 180858us
W20260709 12:26:09.622040 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 179868us
W20260709 12:26:09.628440 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 138779us
I20260709 12:26:09.523277 18210 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.662119 18211 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.678944 18211 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.687283 12523 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:09.674578 18196 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.674098 18194 raft_consensus.cc:493] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:09.679354 18195 raft_consensus.cc:993] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower c6795b140b3247279a2231c6b9360d24 to start an election
I20260709 12:26:09.687552 18202 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:09.722478 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 98819.2us
I20260709 12:26:09.715022 18218 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:09.730965 12568 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-39edb149903d45b5a17cbbc4dd12850b received from {username='slave'} at 127.0.0.1:36566
I20260709 12:26:09.709929 18196 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.713619 18194 raft_consensus.cc:515] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.682699 18211 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.750851 18218 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.734184 18195 raft_consensus.cc:1081] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Signalling peer c6795b140b3247279a2231c6b9360d24 to start an election
W20260709 12:26:09.782698 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 59091.7us
I20260709 12:26:09.788020 18238 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.748324 18223 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:26:09.796404 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 63354.6us
I20260709 12:26:09.777781 12568 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-39edb149903d45b5a17cbbc4dd12850b on tablet 39edb149903d45b5a17cbbc4dd12850b with peer 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:26:09.797029 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 107595us
I20260709 12:26:09.729323 18202 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.790750 18189 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.812278 18217 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:09.818624 18189 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.818987 18217 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.823616 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:09.825435 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:09.822048 18226 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:09.797147 18218 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:09.798944 18238 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.833097 18231 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.831346 18239 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:09.836704 13230 raft_consensus.cc:1217] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 LEARNER]: Deduplicated request from leader. Original: 15.8->[15.9-15.9]   Dedup: 15.9->[]
I20260709 12:26:09.836563 18231 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.836766 18239 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.837530 18238 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:09.838307 18217 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.838708 18231 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:09.839429 18239 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.840404 18194 leader_election.cc:290] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.849680 18202 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:09.832075 18226 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.850556 18196 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.851600 18226 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.830700 18242 raft_consensus.cc:493] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:09.852502 18242 raft_consensus.cc:515] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.855187 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:09.856828 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:09.857661 12628 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 9.
I20260709 12:26:09.861169 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:09.863019 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:09.875105 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:09.875147 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:09.875728 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:09.876262 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:09.876885 18242 leader_election.cc:290] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.818111 18223 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.879813 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:09.885795 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:09.861785 18210 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:09.861210 18241 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.866858 18193 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.912371 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:09.871778 18213 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.917559 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:09.884321 18189 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.877905 18243 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:09.926932 12625 raft_consensus.cc:2410] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:26:09.889900 18194 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.927783 12552 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:09.931862 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:09.878106 18246 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:09.932862 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:09.889586 18237 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.915391 18210 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.910744 18226 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.922072 18222 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.942775 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:09.924589 18232 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.923424 18224 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:09.928704 18250 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.935390 18246 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.938668 18189 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.923187 18193 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.963344 18224 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:09.945890 18210 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.958406 18222 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.958604 18232 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.977949 18216 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.937152 18194 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.962188 18238 raft_consensus.cc:493] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:09.962030 18196 raft_consensus.cc:493] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.994498 18196 raft_consensus.cc:515] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.994961 18222 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.996438 18251 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:09.996549 18196 leader_election.cc:290] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.989516 12558 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 9.
I20260709 12:26:09.936879 18243 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:09.998787 18227 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:09.999348 18243 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.987299 18256 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.000500 18256 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.990249 18253 raft_consensus.cc:493] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:10.002489 18253 raft_consensus.cc:515] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.929481 18213 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:09.971292 18189 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.004611 18253 leader_election.cc:290] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.942515 18237 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.005075 18189 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.005266 18238 raft_consensus.cc:515] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.006807 18237 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.007237 18194 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.964672 18250 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.007490 18238 leader_election.cc:290] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:09.915145 18241 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.008975 18210 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.990667 18216 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.009202 18250 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.965444 18246 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.010092 18241 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.955236 18226 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.002847 18193 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.991722 13198 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:09.992522 18254 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.032425 18254 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.026310 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.038570 18254 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.041970 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.005312 18192 raft_consensus.cc:1064] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:26:10.045162 12705 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:10.078059 12705 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:10.078598 12705 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.046859 18238 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.047559 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:10.047808 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 56175.4us
I20260709 12:26:10.048292 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8cad0ce0b1e4401c95e8abd3bbbdd60b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.048475 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "75aab4686614449489ce5c08d0860bd6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.052205 13226 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.082557 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:10.052718 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.052945 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.054261 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.054611 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.048311 18208 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:09.996979 18251 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.056242 18257 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.058027 18223 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.059208 18224 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.059826 18216 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.062636 18232 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.064100 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.068759 18218 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.093592 12553 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:10.042032 18217 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.076531 18226 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:09.999382 18227 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.002882 18256 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.078910 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.084520 18222 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.085358 13199 leader_election.cc:304] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.055586 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.087183 13198 leader_election.cc:304] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.030479 18212 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.005105 18213 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.091480 18214 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:10.052520 18205 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.098645 12703 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:10.086629 18238 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.113301 18229 raft_consensus.cc:2749] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:10.104931 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50021.1us
I20260709 12:26:10.106491 12552 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 19: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:26:10.120673 18262 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.128806 18247 raft_consensus.cc:2749] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:10.120498 18255 raft_consensus.cc:493] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:10.098784 18217 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.106886 18256 raft_consensus.cc:493] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:10.152823 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.119400 18260 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.122761 18218 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.128422 18251 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.125847 18192 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.095114 18257 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.120131 12523 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.100104 18212 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.120322 18193 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.133061 18205 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.163213 18218 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.163766 18205 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.134398 13234 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 8.
I20260709 12:26:10.135576 18238 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.137320 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.118849 18227 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.164845 12554 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:26:10.165994 13201 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:10.166827 18238 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:10.167186 18238 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.167541 18238 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:10.151645 18262 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.172271 18262 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.153756 18255 raft_consensus.cc:515] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.177744 18193 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.179889 18193 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.161392 18260 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.103327 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.105891 12705 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.150417 13235 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:26:10.186151 12705 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.187672 18257 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.189844 18255 leader_election.cc:290] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:10.149238 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 64005.9us
I20260709 12:26:10.153647 12553 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:10.147914 18191 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.192652 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:10.163865 18256 raft_consensus.cc:515] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:10.193212 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 89958.7us
I20260709 12:26:10.197747 18207 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.198161 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.202329 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.106432 18214 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.199251 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:10.205529 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.206157 12554 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:10.198294 18191 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.202884 12556 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:10.203540 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:26:10.206233 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 119092us
I20260709 12:26:10.209312 18193 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:10.210686 18193 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.210740 18264 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.211158 18193 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.211378 18264 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:10.121255 18246 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.213150 18243 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.213505 18260 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.213661 18243 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.214196 12704 raft_consensus.cc:1240] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Rejecting Update request from peer 155b5b0a0b6d4b499edfe2797ffa5b91 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:10.214596 18246 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.204008 18216 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.217218 18216 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.207401 18231 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:10.218770 18231 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.219254 18231 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.220988 18212 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.208842 18214 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.225982 18217 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.106071 18222 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.242647 18243 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.244164 18191 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.244872 18216 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.245105 18264 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.245471 18206 raft_consensus.cc:493] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:10.246080 18206 raft_consensus.cc:515] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.247596 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:10.248107 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:10.248737 18217 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:10.249177 12553 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.249433 18217 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.250749 18217 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.251753 18266 raft_consensus.cc:493] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:10.252378 18266 raft_consensus.cc:515] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.253260 18256 leader_election.cc:290] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.254040 18258 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:10.254555 18258 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.248152 18206 leader_election.cc:290] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.245388 18212 raft_consensus.cc:493] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:10.259379 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.262529 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.263161 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.264328 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.264633 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.264331 18212 raft_consensus.cc:515] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.264664 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.265978 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.267627 18212 leader_election.cc:290] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.259388 18258 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.263164 12626 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 17.
I20260709 12:26:10.270251 18266 leader_election.cc:290] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.294684 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.295012 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.295251 12558 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.295658 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.295950 12555 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.296648 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.272042 18238 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.273895 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.277267 18231 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.278585 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.279341 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.298504 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.298776 13226 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:10.299556 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.300298 18231 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.286525 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.300645 12705 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.298501 12703 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 18: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:10.280318 12701 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.305158 18238 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.306866 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.288995 18217 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.289897 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:10.310773 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 361704us
I20260709 12:26:10.311404 18217 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.315227 18193 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.291172 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.336663 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.292745 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.339866 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.300215 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.340930 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.287257 12706 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.341957 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.342363 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04a769018c454aa685eae73d74c89abb" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.342928 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.343417 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.343899 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.283859 18222 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.318704 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.344789 12626 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:10.318156 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.344354 12451 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 16 to 17, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 17 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.319962 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.320107 13199 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.346272 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "613ed3057bf74d02a48d823635fd0b6a" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.320657 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.346989 18242 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.321302 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8bd8b4df5594ab89b5028f708332757" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.322690 18214 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.290868 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.348284 13230 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:10.337477 12554 raft_consensus.cc:1240] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:10.337960 13235 raft_consensus.cc:1240] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:10.347121 13199 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:10.338058 18193 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.338527 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.339005 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.353024 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.339118 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.361694 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.362078 12631 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.353348 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.355358 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.364622 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.339210 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.365671 18192 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:10.367710 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.367992 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.368520 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.368714 18192 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.290752 12553 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:26:10.319337 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d457e0ba678747fba0ac2a4c1b42649e" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.319471 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.369843 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.371497 12634 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.371878 12629 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "08834ef951b049b39c60e46c2ed865e9" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.372571 12628 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.373543 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "74acfff7189b45af8e177ff563645d9d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.376628 12631 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 19.
I20260709 12:26:10.358029 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.340646 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.378551 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.377394 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.348569 12451 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 12, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.379962 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:10.380571 13228 raft_consensus.cc:3055] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:10.380923 13228 raft_consensus.cc:740] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:10.381738 13228 consensus_queue.cc:260] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.383575 18242 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:10.383980 18242 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.384322 18242 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:10.382867 13228 raft_consensus.cc:3060] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.391844 18242 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.388195 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.394152 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:10.388100 18215 consensus_queue.cc:1059] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:10.396677 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
W20260709 12:26:10.400974 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 91509.5us
I20260709 12:26:10.401626 18231 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:10.402956 12522 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.354738 18214 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.404485 18193 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:10.404409 12597 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:10.404798 18231 raft_consensus.cc:3055] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:10.405196 18231 raft_consensus.cc:740] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:10.405718 18235 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:10.407617 12451 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 17 to 18, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 18 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.409152 12451 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 7 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.409927 12522 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.410841 18211 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:10.410790 12451 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 13 to 14, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 14 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.411854 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.412588 18211 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:10.414218 12522 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:10.414408 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.414965 18211 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:10.409653 18193 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:10.416492 18211 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:10.411700 18235 consensus_queue.cc:1059] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:10.420258 18235 raft_consensus.cc:3055] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:10.420585 18235 raft_consensus.cc:740] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:10.421380 18235 consensus_queue.cc:260] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.422576 18235 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.424401 18211 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:10.406006 18231 consensus_queue.cc:260] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.414640 12630 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.428017 18242 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:10.430680 18231 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.441166 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.443264 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.444788 12522 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.448946 12600 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:10.451330 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:10.451568 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:10.452178 12553 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 14: Already voted for candidate 23740bafdb794232879a0bb6884f7a68 in this term.
I20260709 12:26:10.451956 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:10.460263 18248 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.461448 12454 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:36664 (request call id 324) took 5408 ms. Trace:
I20260709 12:26:10.453745 18193 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:10.454609 18222 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.454677 18258 consensus_queue.cc:1059] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:26:10.456246 18192 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.454859 18266 consensus_queue.cc:1059] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 12:26:10.460831 18248 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.474318 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.479076 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.479609 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f25843830014b4c8c5707696cddc7f0" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.481031 13235 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c5facffc88a94bc58f10135f6686804c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:10.514546 18193 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:10.519397 18193 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:10.481911 13233 raft_consensus.cc:1240] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:10.520823 18248 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:10.482467 12522 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.483038 18211 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:10.521687 18260 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:10.486090 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:10.486716 13230 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:10.522431 13232 raft_consensus.cc:2393] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 14: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:10.491194 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d75a6f40c324994a517c98816b2afc4" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.491832 12704 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.492230 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.492825 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0116b2408a7241828256061551a36f1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.493443 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:10.524977 12708 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:10.525264 18266 raft_consensus.cc:3055] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:10.525660 18266 raft_consensus.cc:740] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:10.526446 18258 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:10.526819 18258 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:10.527585 18258 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.529570 18243 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.495747 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:10.496917 12451 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:10.503657 12597 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.507002 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:10.532867 12631 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:10.509253 12600 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:10.537674 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 63440.6us
I20260709 12:26:10.532464 12451 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 14, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 14 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:10.538501 12598 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.538852 13199 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:10.539861 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 57462.1us
I20260709 12:26:10.539371 12451 catalog_manager.cc:5697] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.540284 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.511317 13228 raft_consensus.cc:2468] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:26:10.541260 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.512755 13201 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.514688 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d04f0e851d04dab8ea27bcfbdbb46e1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.508327 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:10.540732 12451 catalog_manager.cc:5697] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 11, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.543780 12451 catalog_manager.cc:5697] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 9, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 9 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.545272 18212 consensus_queue.cc:1059] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:10.546034 18191 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:10.546574 18222 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.546689 18216 raft_consensus.cc:3055] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:10.547140 18216 raft_consensus.cc:740] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:10.547957 18216 consensus_queue.cc:260] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.548484 18248 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:10.549157 18248 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:10.546278 18212 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.549121 18216 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:10.550437 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.551529 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.552184 18269 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:10.555855 12708 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 19.
I20260709 12:26:10.561725 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.562237 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.562963 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.564546 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.564801 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.570322 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.571238 12557 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.571677 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c12120af627b4866b9f483d6cd9f30f5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.572763 12451 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 8 to 9, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 9 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.573292 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.574891 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:10.576277 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.574173 12451 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:10.526414 18266 consensus_queue.cc:260] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.608013 13201 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.586433 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e18a3c206d6646e69fba42e3b74572a6" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.610208 12451 catalog_manager.cc:5697] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 8 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.514290 12454 rpcz_store.cc:276] 0709 12:26:05.052608 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:05.052755 (+   147us) service_pool.cc:224] Handling call
0709 12:26:10.461336 (+5408581us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:09.319926 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:09.320600 (+   674us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:09.320643 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:26:09.320663 (+    20us) tablet.cc:662] Decoding operations
0709 12:26:09.326047 (+  5384us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:09.326125 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:09.326152 (+    27us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:26:09.326673 (+   521us) tablet.cc:701] Row locks acquired
0709 12:26:09.326692 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:09.326828 (+   136us) write_op.cc:270] Start()
0709 12:26:09.326943 (+   115us) write_op.cc:276] Timestamp: P: 1783599969326781 usec, L: 0
0709 12:26:09.326965 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:09.327633 (+   668us) log.cc:844] Serialized 2446 byte log entry
0709 12:26:09.346270 (+ 18637us) op_driver.cc:464] REPLICATION: finished
0709 12:26:09.368293 (+ 22023us) write_op.cc:301] APPLY: starting
0709 12:26:09.372501 (+  4208us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:09.682079 (+309578us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:09.682193 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:09.710935 (+ 28742us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:09.711191 (+   256us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0709 12:26:09.711257 (+    66us) write_op.cc:312] APPLY: finished
0709 12:26:09.711593 (+   336us) log.cc:844] Serialized 65 byte log entry
0709 12:26:09.731308 (+ 19715us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:09.739479 (+  8171us) write_op.cc:454] Released schema lock
0709 12:26:09.745701 (+  6222us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:09.782001 (+ 36300us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:09.785302 (+  3301us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10772,"reported_tablets":35,"child_traces":[["op",{"apply.queue_time_us":21764,"apply.run_cpu_time_us":11694,"apply.run_wall_time_us":398395,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29255,"num_ops":6,"prepare.queue_time_us":13776,"prepare.run_cpu_time_us":3685,"prepare.run_wall_time_us":25859,"replication_time_us":19099,"thread_start_us":47663,"threads_started":2}]]}
I20260709 12:26:10.593684 12600 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:10.615468 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.580518 12598 leader_election.cc:304] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.616575 12600 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.592198 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "23f3709af552426ebb55ecf39265cc47" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:10.618957 12600 leader_election.cc:304] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.619971 12598 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.622687 18257 raft_consensus.cc:2749] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.622725 18224 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:10.625288 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 63144.8us
I20260709 12:26:10.541774 18258 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:10.631395 12708 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:10.631742 12674 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:10.571472 18256 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:10.580716 18235 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:10.576893 18242 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:10.583575 18243 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.591564 18214 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:10.617946 18231 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.624965 18264 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.625075 18222 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:10.633894 18246 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:10.625473 18206 raft_consensus.cc:2749] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:10.642781 12598 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.647367 18254 raft_consensus.cc:2804] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 12:26:10.699316 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 56622.6us
I20260709 12:26:10.649528 18223 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:10.700155 12598 leader_election.cc:304] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.696725 12671 leader_election.cc:304] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:10.700887 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44028.8us
I20260709 12:26:10.706575 12523 leader_election.cc:304] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.707765 12523 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.650250 18266 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:10.709427 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:10.713188 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.713879 18192 raft_consensus.cc:2749] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:10.706492 18200 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.734346 12598 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.720443 18206 raft_consensus.cc:2749] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.722712 18211 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:10.728106 18207 raft_consensus.cc:2749] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:10.742549 18220 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:10.764240 13256 debug-util.cc:398] Leaking SignalData structure 0x7b080034bbe0 after lost signal to thread 11395
I20260709 12:26:10.738087 18226 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:10.765427 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef6a0 after lost signal to thread 12491
W20260709 12:26:10.772859 13256 debug-util.cc:398] Leaking SignalData structure 0x7b0800336140 after lost signal to thread 12583
W20260709 12:26:10.774006 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef4a0 after lost signal to thread 12658
W20260709 12:26:10.774315 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08002ef4c0 after lost signal to thread 12659
W20260709 12:26:10.775308 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08003844a0 after lost signal to thread 12732
W20260709 12:26:10.776432 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08001eba20 after lost signal to thread 13259
W20260709 12:26:10.776710 13256 debug-util.cc:398] Leaking SignalData structure 0x7b080024dce0 after lost signal to thread 13260
W20260709 12:26:10.777012 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08003c22c0 after lost signal to thread 18114
W20260709 12:26:10.777267 13256 debug-util.cc:398] Leaking SignalData structure 0x7b0800322da0 after lost signal to thread 18149
W20260709 12:26:10.777660 13256 debug-util.cc:398] Leaking SignalData structure 0x7b080034e740 after lost signal to thread 18161
W20260709 12:26:10.777912 13256 debug-util.cc:398] Leaking SignalData structure 0x7b08003c0260 after lost signal to thread 18164
I20260709 12:26:10.765345 18193 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.820026 18193 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:10.830957 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:10.835543 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:10.836635 13230 raft_consensus.cc:2393] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 9: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:10.829056 18211 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.841624 12632 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 9.
I20260709 12:26:10.849826 12522 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:10.852834 18251 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:10.852401 13229 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.853386 18251 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:10.855764 13232 raft_consensus.cc:1240] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:10.859591 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 151904us
W20260709 12:26:10.860491 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 143471us
I20260709 12:26:10.860709 12523 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.862293 12523 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.863693 12523 leader_election.cc:304] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.881461 12523 leader_election.cc:304] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:10.894690 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 198058us
I20260709 12:26:10.895548 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.897769 18192 raft_consensus.cc:2749] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.898226 12523 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:10.899120 18192 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:10.899912 18251 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.868654 18260 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.867336 18218 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.920894 18275 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:10.881193 18276 raft_consensus.cc:2749] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.929363 12671 leader_election.cc:304] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.894096 18220 consensus_queue.cc:1059] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:26:10.932854 18220 raft_consensus.cc:3055] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:10.933218 18220 raft_consensus.cc:740] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:10.934068 18220 consensus_queue.cc:260] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.935370 18277 raft_consensus.cc:2749] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:10.935459 18223 consensus_queue.cc:1175] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "23740bafdb794232879a0bb6884f7a68" responder_term: 11 status { last_received { term: 11 index: 9 } last_committed_idx: 9 last_received_current_leader { term: 11 index: 9 } }
I20260709 12:26:10.937433 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.939095 18197 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:10.945575 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.867630 18254 raft_consensus.cc:697] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:10.937752 18220 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:10.947016 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:10.947754 18234 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:10.967111 18197 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:10.973850 12633 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:10.979437 18207 raft_consensus.cc:1064] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:26:10.983413 18277 raft_consensus.cc:1064] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:26:11.000931 18254 consensus_queue.cc:237] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:10.992966 18277 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 7, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.049216 18207 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.063493 12626 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:11.071301 12703 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:11.074687 18218 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:26:11.069697 18191 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.011s
I20260709 12:26:11.082556 18256 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:11.122870 13230 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:11.123859 12632 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:11.124974 12559 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:11.125706 18236 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:11.126603 18202 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:11.127602 18279 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:11.143676 12708 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.192970 12559 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:11.206326 12626 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:11.197867 18236 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:26:11.222018 13230 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:11.227636 18279 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:11.227286 18202 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.229008 13230 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.245020 12557 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.254858 18236 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:26:11.310694 13230 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0e137b72ba4847d6ad89da17af64db7d"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:11.311357 13230 raft_consensus.cc:606] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:11.311790 13230 raft_consensus.cc:614] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.316236 12626 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.326310 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4719532adf46473495ced717a908a078"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:11.326947 13229 raft_consensus.cc:606] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:11.329659 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "793f816912494728bf76dd612942dc4c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:11.330143 13229 raft_consensus.cc:606] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:11.330456 13229 raft_consensus.cc:614] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.336405 18277 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.345328 13230 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.348171 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9257ace92110474f9ba7f25a16b03161"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "c6795b140b3247279a2231c6b9360d24"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:11.348770 13229 raft_consensus.cc:606] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Received request to transfer leadership to TS c6795b140b3247279a2231c6b9360d24
I20260709 12:26:11.349103 13229 raft_consensus.cc:614] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.355111 12632 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.362591 13229 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:57436
I20260709 12:26:11.363210 13229 raft_consensus.cc:606] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:11.368518 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:11.370007 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:11.370790 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:11.380224 18269 raft_consensus.cc:993] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:26:11.380810 18269 raft_consensus.cc:1081] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:26:11.382588 12559 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4719532adf46473495ced717a908a078"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:36566
I20260709 12:26:11.383128 12559 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.383468 12559 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.394656 12559 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.408521 12559 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:11.409677 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:11.410044 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:11.410339 13229 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:11.410640 12708 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.410699 13229 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:11.411626 13229 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.412760 13229 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.420418 12626 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:11.421331 18224 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:11.421856 18224 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.423924 18224 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:11.426671 18255 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:11.427870 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:11.428594 12703 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:11.431094 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:11.431671 13232 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:11.435267 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:11.436533 13229 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:26:11.436698 18257 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:11.442878 18257 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:11.443327 18257 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:11.446172 12522 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:11.450659 18256 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:11.451140 18256 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:11.451944 18256 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.461040 18269 raft_consensus.cc:993] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:11.461503 18269 raft_consensus.cc:1081] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:11.463382 12632 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:40560
I20260709 12:26:11.463878 12556 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Committing config change with OpId 15.10: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.463905 12632 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:11.471458 12632 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.476107 13230 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:11.479353 18191 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:11.486099 12454 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 9, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:11.488098 12454 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 19 to 20, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 20 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } }
I20260709 12:26:11.500880 12454 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 8 to 9, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 9 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.494699 12632 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.494392 12708 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 13.
I20260709 12:26:11.509632 12454 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 14 to 19, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 19 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:11.514499 12454 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 11, VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:11.524441 12632 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:11.526703 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:11.527505 13230 raft_consensus.cc:3055] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:11.527812 13230 raft_consensus.cc:740] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:11.528534 12451 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:34372 (request call id 228) took 3179 ms. Trace:
I20260709 12:26:11.528929 12451 rpcz_store.cc:276] 0709 12:26:08.348528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:08.353543 (+  5015us) service_pool.cc:224] Handling call
0709 12:26:08.406340 (+ 52797us) spinlock_profiling.cc:243] Waited 12.9 ms on lock 0x7b5400002490. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c7640 00007f0e9a89e846 00007f0e9a9a890e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc 00007f0e98e68392 00007f0e92e2648c 00007f0e92e258c6
0709 12:26:11.523903 (+3117563us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:10.849699 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:10.850241 (+   542us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:10.850290 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:26:10.850316 (+    26us) tablet.cc:662] Decoding operations
0709 12:26:10.851443 (+  1127us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:10.851521 (+    78us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:10.851546 (+    25us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:26:10.852587 (+  1041us) tablet.cc:701] Row locks acquired
0709 12:26:10.852614 (+    27us) write_op.cc:260] PREPARE: finished
0709 12:26:10.852770 (+   156us) write_op.cc:270] Start()
0709 12:26:10.852904 (+   134us) write_op.cc:276] Timestamp: P: 1783599970852718 usec, L: 0
0709 12:26:10.852926 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:10.880968 (+ 28042us) log.cc:844] Serialized 5238 byte log entry
0709 12:26:11.147498 (+266530us) op_driver.cc:464] REPLICATION: finished
0709 12:26:11.270004 (+122506us) write_op.cc:301] APPLY: starting
0709 12:26:11.273980 (+  3976us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:11.352516 (+ 78536us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:11.352624 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:11.436432 (+ 83808us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:11.436683 (+   251us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=0,mrs_lookups=0
0709 12:26:11.436726 (+    43us) write_op.cc:312] APPLY: finished
0709 12:26:11.437085 (+   359us) log.cc:844] Serialized 121 byte log entry
0709 12:26:11.437232 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:11.437370 (+   138us) write_op.cc:454] Released schema lock
0709 12:26:11.460713 (+ 23343us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:11.473792 (+ 13079us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:11.473821 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":100167,"reported_tablets":15,"spinlock_wait_cycles":29753600,"child_traces":[["op",{"apply.queue_time_us":104765,"apply.run_cpu_time_us":18058,"apply.run_wall_time_us":204320,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58571,"num_ops":13,"prepare.queue_time_us":197464,"prepare.run_cpu_time_us":16191,"prepare.run_wall_time_us":169445,"raft.queue_time_us":165355,"raft.run_cpu_time_us":23910,"raft.run_wall_time_us":127169,"replication_time_us":290437,"spinlock_wait_cycles":967552,"thread_start_us":462728,"threads_started":4,"wal-append.queue_time_us":76172}]]}
I20260709 12:26:11.533950 13230 consensus_queue.cc:260] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.547823 13230 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.594046 13230 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:11.600976 12597 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:11.627357 18266 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.629328 18266 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.631688 18266 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:11.632727 13230 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:11.633380 13230 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:11.634411 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:11.635187 18266 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.635555 18266 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.635876 18266 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.606501 18220 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:11.645282 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:11.646184 12556 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
W20260709 12:26:11.646849 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 111384us
I20260709 12:26:11.672951 12556 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:26:11.629356 18257 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.684871 13230 raft_consensus.cc:1275] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:26:11.707036 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:11.707728 12699 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:11.711548 18303 log.cc:927] Time spent T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:26:11.694003 18234 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:26:11.725571 18257 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:11.728571 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 101496us
I20260709 12:26:11.728984 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:11.740199 12699 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:11.751302 18266 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.751458 18207 consensus_queue.cc:1048] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:26:11.754572 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:11.761221 12708 raft_consensus.cc:2393] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate a2a8d71f644447218c1afc3e5f7716cd in current term 10: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:11.773819 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:11.774564 13233 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:11.786571 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 94720.2us
W20260709 12:26:11.789621 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 142453us
I20260709 12:26:11.778249 18266 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:11.835683 13229 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:11.839392 12559 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:11.840119 12559 raft_consensus.cc:3060] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.843664 13233 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
W20260709 12:26:11.844491 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 58582.7us
W20260709 12:26:11.848618 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 70445.6us
I20260709 12:26:11.850361 12597 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: c6795b140b3247279a2231c6b9360d24
I20260709 12:26:11.848693 12559 raft_consensus.cc:2468] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:11.851835 12597 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:11.852540 18257 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:11.853020 18257 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:11.853950 18257 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.856760 18224 raft_consensus.cc:2804] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:11.857474 18224 raft_consensus.cc:697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:11.858516 18224 consensus_queue.cc:237] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.859838 18220 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:11.860839 18220 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.875144 12451 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.877651 12451 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 9 to 10, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:11.956231 18216 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.956841 18216 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:11.960127 18216 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:11.962584 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:11.963320 13229 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:11.964470 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:11.965351 18216 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.965785 18216 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.966156 18216 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.973102 12699 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:11.977193 12551 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:11.984375 13229 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:11.986403 18260 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:11.998656 18216 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.000918 18216 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:12.002185 12454 catalog_manager.cc:5697] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 9 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 10 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.004791 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:12.010186 13228 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.012147 12454 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 12 to 13, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 13 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.015390 18260 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:12.028421 13228 raft_consensus.cc:2468] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:12.029616 12597 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:12.030961 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:12.036574 18220 raft_consensus.cc:2804] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:12.037221 18220 raft_consensus.cc:697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:12.038174 18220 consensus_queue.cc:237] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.067454 18260 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:12.068089 18260 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.076344 12556 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.076864 12626 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:12.074086 18260 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:12.080792 13228 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:12.081543 13228 raft_consensus.cc:2368] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 14. Current term is 15.
I20260709 12:26:12.083248 12522 leader_election.cc:400] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 14. Current term is 15.
I20260709 12:26:12.083577 12522 leader_election.cc:403] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:12.084493 18251 raft_consensus.cc:3060] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.097955 18251 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323) with higher term. Message: Invalid argument: T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 for earlier term 14. Current term is 15.
I20260709 12:26:12.109050 12457 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46184 (request call id 348) took 5015 ms. Trace:
I20260709 12:26:12.109483 12457 rpcz_store.cc:276] 0709 12:26:07.093202 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:07.106297 (+ 13095us) service_pool.cc:224] Handling call
0709 12:26:12.108879 (+5002582us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32810,"reported_tablets":48}
I20260709 12:26:12.133805 12452 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:46190 (request call id 327) took 1750 ms. Trace:
I20260709 12:26:12.134202 12452 rpcz_store.cc:276] 0709 12:26:10.383026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:10.383143 (+   117us) service_pool.cc:224] Handling call
0709 12:26:10.419728 (+ 36585us) spinlock_profiling.cc:243] Waited 28 ms on lock 0x7b5400002490. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e91886db1 00007f0e919c7640 00007f0e9a89e846 00007f0e9a9a890e 00007f0e98e692a4 00007f0e98e69232 00007f0e98e69161 00007f0e98e690dc 00007f0e98e68392 00007f0e92e2648c 00007f0e92e258c6
0709 12:26:12.133744 (+1714016us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":87091,"reported_tablets":22,"spinlock_wait_cycles":64460928}
I20260709 12:26:12.164954 18220 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.165591 18220 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.167078 12699 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:12.169355 13228 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:12.171808 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:12.175791 13233 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 12.
I20260709 12:26:12.170348 18251 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:26:12.178725 18220 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:12.172171 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:12.181350 18260 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:12.174520 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:12.193215 12598 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:12.194527 18216 raft_consensus.cc:2749] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.200330 18251 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.207567 12708 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.231997 12699 consensus_queue.cc:237] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.235010 13233 raft_consensus.cc:2955] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 11 to 12, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.270557 13233 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:12.272904 12556 raft_consensus.cc:1275] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:12.271911 12452 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 11 to 12, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 14 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.278271 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 39edb149903d45b5a17cbbc4dd12850b with cas_config_opid_index 11: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:12.275902 18202 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:12.290383 13228 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:12.291291 18310 consensus_queue.cc:1048] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:12.283346 18216 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.292433 18216 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.294914 18216 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:12.304834 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 39edb149903d45b5a17cbbc4dd12850b with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:55074
I20260709 12:26:12.312038 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:12.312765 13233 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:12.312387 18254 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.314217 12708 consensus_queue.cc:237] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.314899 18223 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:12.315092 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:12.316315 18223 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:12.316686 18223 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.317040 18223 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.318003 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:12.318825 12556 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:12.325068 18223 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.336277 13233 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:12.336925 13233 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.338167 12699 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:12.342073 13229 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.344674 13233 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:26:12.345526 18223 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:12.350052 12597 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:12.351277 18216 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:12.351550 18311 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:12.351811 18216 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:12.352221 18311 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.353631 18325 tablet_replica.cc:333] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:12.356117 18325 raft_consensus.cc:2243] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.352662 18216 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.357899 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:12.364086 13232 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:12.364259 18325 raft_consensus.cc:2272] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.367698 18325 ts_tablet_manager.cc:1916] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:12.373003 18311 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:12.368799 18220 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:12.385499 12559 raft_consensus.cc:2955] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Committing config change with OpId 15.11: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.390970 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:12.391683 12632 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:26:12.392709 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:12.393357 12556 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.395247 12452 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 9 to 10, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.399420 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 28c65936613f4ee89e3dc89d06a91776 with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:12.409526 13228 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:12.412704 18309 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:12.431380 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:12.432077 12699 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 11.
I20260709 12:26:12.440084 12523 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:12.431424 18325 ts_tablet_manager.cc:1929] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:26:12.441215 18325 log.cc:1199] T 39edb149903d45b5a17cbbc4dd12850b P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/39edb149903d45b5a17cbbc4dd12850b
I20260709 12:26:12.443434 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 39edb149903d45b5a17cbbc4dd12850b (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:12.444425 18251 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:12.444890 18251 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:12.445317 18251 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.436764 12451 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 14 to 15, leader changed from 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 15 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.451079 12699 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:12.452127 12451 catalog_manager.cc:5697] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.464432 12451 catalog_manager.cc:5697] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.495774 12556 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 11.
I20260709 12:26:12.462925 18220 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
W20260709 12:26:12.510643 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44278.5us
I20260709 12:26:12.543102 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:12.559111 13232 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:12.566710 12559 raft_consensus.cc:1275] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:12.575073 18207 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:12.580160 12457 catalog_manager.cc:5697] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:12.605870 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 129118us
I20260709 12:26:12.609045 12559 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:12.610473 12556 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:12.634500 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 39edb149903d45b5a17cbbc4dd12850b with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 11 (current committed config index is 12)) from {username='slave'} at 127.0.0.1:55074
W20260709 12:26:12.644673 18329 log.cc:927] Time spent T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:26:12.621570 18234 consensus_queue.cc:1048] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:26:12.667393 18251 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:12.630200 18309 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 12:26:12.683373 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 51927.7us
I20260709 12:26:12.684628 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 39edb149903d45b5a17cbbc4dd12850b (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:12.640728 18337 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:26:12.693753 13232 raft_consensus.cc:1275] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:12.698123 18337 consensus_queue.cc:1048] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:26:12.730461 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 90829.9us
I20260709 12:26:12.731673 12451 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:12.742292 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 28c65936613f4ee89e3dc89d06a91776 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55074
I20260709 12:26:12.743638 18325 tablet_replica.cc:333] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:12.744930 18325 raft_consensus.cc:2243] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:12.756626 18325 raft_consensus.cc:2272] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:12.759604 18325 ts_tablet_manager.cc:1916] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:26:12.772910 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 132882us
I20260709 12:26:12.782270 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:12.783003 12700 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.789988 12700 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
I20260709 12:26:12.783324 18336 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:12.829562 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:12.902159 12632 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 12.
W20260709 12:26:12.905862 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 112737us
I20260709 12:26:12.937742 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:12.938623 13229 raft_consensus.cc:2393] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 23740bafdb794232879a0bb6884f7a68 in current term 12: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
W20260709 12:26:12.951718 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 54819.3us
W20260709 12:26:13.091648 18350 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 12:26:13.110173 18251 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:13.158530 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 222005us
I20260709 12:26:13.160573 12522 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:13.229499 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 69327.1us
I20260709 12:26:13.261439 18331 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:13.262413 18331 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:13.264356 18331 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:13.345882 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 45283.7us
W20260709 12:26:13.358355 18368 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: Append to log took a long time: real 0.126s	user 0.000s	sys 0.004s
I20260709 12:26:13.387466 13233 raft_consensus.cc:1275] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:13.403281 12550 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:13.469847 13233 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:13.480953 18338 consensus_queue.cc:1048] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:13.486515 18333 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:13.487128 18362 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.487392 18333 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:13.490942 18333 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:13.517369 12625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:26:13.518270 12625 raft_consensus.cc:606] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:13.520025 13232 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:13.589429 12625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:26:13.590253 12625 raft_consensus.cc:606] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:13.595604 12625 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:43778
I20260709 12:26:13.537484 13234 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:13.596405 12625 raft_consensus.cc:606] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:26:13.616616 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 46605.4us
I20260709 12:26:13.605813 18336 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:45128 (request call id 92) took 1263 ms. Trace:
I20260709 12:26:13.621598 12707 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:13.599352 18325 ts_tablet_manager.cc:1929] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 15.10
I20260709 12:26:13.632853 12559 raft_consensus.cc:2955] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:13.621960 18336 rpcz_store.cc:276] 0709 12:26:12.310612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.312019 (+  1407us) service_pool.cc:224] Handling call
0709 12:26:12.316872 (+  4853us) log.cc:844] Serialized 487 byte log entry
0709 12:26:12.562449 (+245577us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b18004377a0. stack: 00007f0e919cc343 00007f0e919cc240 00007f0e9135b1d4 00007f0e9b099304 00007f0e9b099299 00007f0e9a8c6ab1 00007f0e9a8d3281 00007f0e919fe3f3 00007f0e91a007c1 00007f0e91a00779 00007f0e91a00709 00007f0e91a006d1 00007f0e919ff9cd 0000000000388634 0000000000388479 00007f0e919e183a
0709 12:26:13.565499 (+1003050us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":39970,"raft.run_cpu_time_us":1367,"raft.run_wall_time_us":33352,"spinlock_wait_cycles":5349120,"thread_start_us":284089,"threads_started":2,"wal-append.queue_time_us":173055}
I20260709 12:26:13.655109 18325 log.cc:1199] T 28c65936613f4ee89e3dc89d06a91776 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/28c65936613f4ee89e3dc89d06a91776
I20260709 12:26:13.677482 18346 raft_consensus.cc:993] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:13.678120 18346 raft_consensus.cc:1081] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
W20260709 12:26:13.681304 18385 log.cc:927] Time spent T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:13.681664 18334 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.692137 12457 catalog_manager.cc:5697] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 10 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:13.705638 12454 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 11 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 12 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:13.711104 13234 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:13.714745 13234 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:26:13.715580 13234 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:13.716058 13234 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:13.722092 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 44199.9us
I20260709 12:26:13.722589 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 28c65936613f4ee89e3dc89d06a91776 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:13.724210 18331 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.724447 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 606f6695c1e84da291559cacabfa82bc with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:13.766535 13234 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:13.773320 12703 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:13.777323 12598 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:13.781533 12554 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "606f6695c1e84da291559cacabfa82bc" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "23740bafdb794232879a0bb6884f7a68" is_pre_election: true
I20260709 12:26:13.784821 18331 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
I20260709 12:26:13.788987 18333 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.809950 12627 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:13.875831 13234 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:13.884610 18353 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
W20260709 12:26:13.926574 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 56179.6us
W20260709 12:26:13.955180 18390 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
W20260709 12:26:14.033072 18391 log.cc:927] Time spent T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
W20260709 12:26:14.041379 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 72974.3us
W20260709 12:26:14.133944 18386 log.cc:927] Time spent T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:26:14.137548 18282 log.cc:927] Time spent T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:26:14.148895 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:14.149614 12553 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.186250 18223 raft_consensus.cc:993] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.186923 18257 raft_consensus.cc:1081] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.194000 18346 raft_consensus.cc:993] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.194494 18346 raft_consensus.cc:1081] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.197115 13230 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:26:14.197177 13229 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50978
I20260709 12:26:14.197763 13230 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.197844 13229 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.198153 13230 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.198313 13229 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:14.227726 13230 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.233577 12553 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:14.263732 13201 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:14.265388 18374 raft_consensus.cc:2804] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:14.266242 18374 raft_consensus.cc:697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:14.267365 18374 consensus_queue.cc:237] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.281904 12708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:42564
I20260709 12:26:14.282543 12708 raft_consensus.cc:606] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:14.287128 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:14.299240 12703 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:42564
I20260709 12:26:14.299860 12703 raft_consensus.cc:606] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:14.302476 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:14.304991 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.301640 12553 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.312893 13230 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:14.310560 13229 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:14.314136 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 112921us
I20260709 12:26:14.329344 13229 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:14.353564 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 122421us
I20260709 12:26:14.393399 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:14.395632 12633 raft_consensus.cc:3055] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:14.396226 12553 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 15.
I20260709 12:26:14.396898 12550 raft_consensus.cc:1240] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:14.395848 12633 raft_consensus.cc:740] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:14.399042 12633 consensus_queue.cc:260] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.402173 12633 raft_consensus.cc:3060] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.404910 13231 raft_consensus.cc:1240] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Rejecting Update request from peer a2a8d71f644447218c1afc3e5f7716cd for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:14.407044 18365 raft_consensus.cc:993] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.407562 18365 raft_consensus.cc:1081] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.412724 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 606f6695c1e84da291559cacabfa82bc with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55074
I20260709 12:26:14.403713 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.431344 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:14.432241 12550 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:14.433723 12454 catalog_manager.cc:5697] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 11 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 12 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.432225 12633 raft_consensus.cc:2468] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
I20260709 12:26:14.438869 13201 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:14.440174 12550 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 18.
I20260709 12:26:14.448642 18415 consensus_queue.cc:1059] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:14.449213 18357 raft_consensus.cc:2804] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:14.449802 18357 raft_consensus.cc:697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:14.450270 18371 raft_consensus.cc:3055] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:14.450673 18371 raft_consensus.cc:740] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:14.450764 18357 consensus_queue.cc:237] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.451787 18371 consensus_queue.cc:260] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.454012 18371 raft_consensus.cc:3060] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:14.464313 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 66746.8us
I20260709 12:26:14.465910 13231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:26:14.466460 13231 raft_consensus.cc:493] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.466812 13231 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:14.487792 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:14.488574 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:14.489179 12625 raft_consensus.cc:3055] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:14.489526 12625 raft_consensus.cc:740] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Becoming Follower/Learner. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:14.491556 12625 consensus_queue.cc:260] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.492579 13201 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:14.492775 12625 raft_consensus.cc:3060] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:14.493888 18407 raft_consensus.cc:2804] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:14.494555 18407 raft_consensus.cc:697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:14.495433 18407 consensus_queue.cc:237] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.500777 13231 raft_consensus.cc:515] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.506337 12550 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:14.506958 12550 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:14.507139 18335 raft_consensus.cc:993] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.507710 18335 raft_consensus.cc:1081] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:14.509253 12633 raft_consensus.cc:2468] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 15.
I20260709 12:26:14.514413 12550 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:14.515811 12625 raft_consensus.cc:2468] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 18.
I20260709 12:26:14.518091 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936a02b62f0d46168b0550920bd53ed3" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:14.518278 13201 leader_election.cc:304] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68; no voters: 
I20260709 12:26:14.518684 12703 raft_consensus.cc:3055] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:14.519040 12703 raft_consensus.cc:740] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:14.519104 18374 raft_consensus.cc:2804] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:14.519627 18374 raft_consensus.cc:697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:14.519982 12703 consensus_queue.cc:260] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.520527 18374 consensus_queue.cc:237] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.521170 12703 raft_consensus.cc:3060] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:14.524433 13231 leader_election.cc:290] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:14.548560 13232 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50990
I20260709 12:26:14.549322 13232 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:14.549784 13232 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.615775 13232 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.619287 13232 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:14.620023 18421 tablet_replica.cc:333] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:14.621107 18421 raft_consensus.cc:2243] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:14.621620 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:14.622115 18421 raft_consensus.cc:2272] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:14.622263 12700 raft_consensus.cc:3055] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:14.622581 12700 raft_consensus.cc:740] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:14.623430 12700 consensus_queue.cc:260] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.624565 12700 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.635390 12700 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 19.
I20260709 12:26:14.632186 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:14.657925 12556 raft_consensus.cc:3060] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.625778 18421 ts_tablet_manager.cc:1916] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:14.667250 13199 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:14.676890 18357 raft_consensus.cc:2804] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:14.682027 18357 raft_consensus.cc:697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:14.682973 18357 consensus_queue.cc:237] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.687461 12553 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:14.692771 12556 raft_consensus.cc:2468] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 19.
I20260709 12:26:14.705503 12452 catalog_manager.cc:5697] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 14 to 15, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 15 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.713361 12452 catalog_manager.cc:5697] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 17 to 18, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 18 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:14.691023 18424 log.cc:927] Time spent T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.069s	user 0.009s	sys 0.018s
W20260709 12:26:14.690864 18423 log.cc:927] Time spent T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: Append to log took a long time: real 0.058s	user 0.009s	sys 0.009s
I20260709 12:26:14.715806 12703 raft_consensus.cc:2468] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:14.722815 12452 catalog_manager.cc:5697] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 13, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 13 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.734062 13230 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:14.735613 12631 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:14.736816 12702 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:14.738366 18407 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:14.742494 18191 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:14.750725 18353 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:14.788093 18331 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Committing config change with OpId 12.11: config changed from index 9 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:14.807013 13231 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 9 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:14.821869 12444 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 700a61b9aeed45869b2d882368e99824 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:14.824577 12702 raft_consensus.cc:2955] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Committing config change with OpId 12.11: config changed from index 9 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:14.845556 12631 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:14.845322 12452 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index 9 to 11, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 12 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.859053 12454 catalog_manager.cc:5697] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 18 to 19, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 19 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.861033 18357 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:14.866837 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 700a61b9aeed45869b2d882368e99824 with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 11) from {username='slave'} at 127.0.0.1:55074
I20260709 12:26:14.870510 12553 raft_consensus.cc:1275] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:14.884874 18407 consensus_queue.cc:1048] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:26:14.899710 12553 raft_consensus.cc:1275] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:14.939181 12699 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:14.940848 18412 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:14.924721 18407 consensus_queue.cc:1048] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260709 12:26:14.966485 18421 ts_tablet_manager.cc:1929] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:26:14.967099 18421 log.cc:1199] T 606f6695c1e84da291559cacabfa82bc P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/606f6695c1e84da291559cacabfa82bc
I20260709 12:26:14.968896 18421 tablet_replica.cc:333] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:14.999081 12625 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:14.988687 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 606f6695c1e84da291559cacabfa82bc (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:15.004469 18357 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:15.036114 18421 raft_consensus.cc:2243] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:15.036945 18421 raft_consensus.cc:2272] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:15.054113 12556 raft_consensus.cc:1275] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:15.055971 18412 consensus_queue.cc:1048] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:15.054327 18421 ts_tablet_manager.cc:1916] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:15.069188 12551 raft_consensus.cc:1275] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:15.088768 18412 consensus_queue.cc:1048] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:15.133850 18421 ts_tablet_manager.cc:1929] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.10
I20260709 12:26:15.134336 18421 log.cc:1199] T 700a61b9aeed45869b2d882368e99824 P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/700a61b9aeed45869b2d882368e99824
I20260709 12:26:15.142551 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 700a61b9aeed45869b2d882368e99824 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:15.231921 12556 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:15.233860 18399 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:15.280520 12703 raft_consensus.cc:1275] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:26:15.287267 18238 consensus_queue.cc:1048] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:15.579952 12703 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:26:15.610641 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d75a6f40c324994a517c98816b2afc4. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:15.614046 12625 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:15.619046 12551 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:26:15.620918 18254 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:15.622682 18411 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:15.679399 18411 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:15.684543 12551 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:15.684165 12625 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:15.703972 12452 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 14, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 20 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:15.878185 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:15.965698 12702 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
W20260709 12:26:15.971220 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 83008.8us
W20260709 12:26:16.013906 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 86213us
W20260709 12:26:16.057566 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 50872.4us
W20260709 12:26:16.201350 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 77561.5us
W20260709 12:26:16.258756 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 144894us
W20260709 12:26:16.264976 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 221812us
W20260709 12:26:16.307016 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 60556.1us
I20260709 12:26:16.333900 18477 ts_tablet_manager.cc:933] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:16.354203 12551 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:16.363125 18254 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:26:16.372124 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2d04f0e851d04dab8ea27bcfbdbb46e1. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.384544 12632 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:16.399350 18454 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:26:16.435086 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52371.6us
I20260709 12:26:16.430506 18477 tablet_copy_client.cc:323] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:26:16.457890 18447 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.461167 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 7d75a6f40c324994a517c98816b2afc4 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:26:16.461794 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 7d75a6f40c324994a517c98816b2afc4 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-7d75a6f40c324994a517c98816b2afc4
I20260709 12:26:16.495944 12553 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:34684
I20260709 12:26:16.496575 12553 raft_consensus.cc:606] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Received request to transfer leadership to TS a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:16.503521 12708 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef"
dest_uuid: "c6795b140b3247279a2231c6b9360d24"
mode: GRACEFUL
new_leader_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:42564
I20260709 12:26:16.504125 12708 raft_consensus.cc:606] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Received request to transfer leadership to TS 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:16.505350 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:26:16.507393 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:16.508129 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:16.517791 12632 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.520509 12718 tablet_copy_source_session.cc:215] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.542960 18477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d75a6f40c324994a517c98816b2afc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.553092 12452 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index -1 to 8, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.612039 12556 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:16.628497 18454 raft_consensus.cc:993] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: : Instructing follower 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:26:16.629170 18453 raft_consensus.cc:1081] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Signalling peer 23740bafdb794232879a0bb6884f7a68 to start an election
I20260709 12:26:16.630998 12554 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
 from {username='slave'} at 127.0.0.1:38728
I20260709 12:26:16.631542 12554 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.631893 12554 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.644649 12632 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:16.646061 12708 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:16.646950 18376 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:16.648219 18460 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 12:26:16.656548 12522 consensus_peers.cc:597] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 -> Peer 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323): Couldn't send request to peer 155b5b0a0b6d4b499edfe2797ffa5b91. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a10e3ca41dda44bc9e0c04ad3cc65f57. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:16.657830 12553 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Committing config change with OpId 12.8: config changed from index -1 to 8, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.649093 12554 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:16.662925 12554 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:16.670205 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:16.670982 12633 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.670282 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:16.672075 12708 raft_consensus.cc:3055] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:16.672394 12708 raft_consensus.cc:740] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:16.678961 12708 consensus_queue.cc:260] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:16.665726 18477 tablet_copy_client.cc:806] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.680227 18477 tablet_copy_client.cc:670] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.680368 12708 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.690635 12633 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:26:16.693972 12522 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:16.698910 18477 tablet_copy_client.cc:538] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.706295 18376 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:16.710855 18376 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 16 LEADER]: Becoming Leader. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:16.711920 18376 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:16.723861 12708 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 23740bafdb794232879a0bb6884f7a68 in term 16.
I20260709 12:26:16.724622 18486 ts_tablet_manager.cc:933] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:16.740839 18486 tablet_copy_client.cc:323] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.3:43633
I20260709 12:26:16.742906 12718 tablet_copy_service.cc:140] P c6795b140b3247279a2231c6b9360d24: Received BeginTabletCopySession request for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:33230)
I20260709 12:26:16.743505 12718 tablet_copy_service.cc:161] P c6795b140b3247279a2231c6b9360d24: Beginning new tablet copy session on tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:33230: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-2d04f0e851d04dab8ea27bcfbdbb46e1
I20260709 12:26:16.748176 18445 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.751632 12718 tablet_copy_source_session.cc:215] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:16.758677 12454 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 reported cstate change: term changed from 15 to 16, leader changed from c6795b140b3247279a2231c6b9360d24 (127.11.32.3) to 23740bafdb794232879a0bb6884f7a68 (127.11.32.1). New cstate: current_term: 16 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.764819 18486 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:16.768311 18477 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:26:16.774053 12632 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.814867 12708 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Committing config change with OpId 19.12: config changed from index -1 to 12, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } } }
I20260709 12:26:16.833664 12454 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 reported cstate change: config changed from index -1 to 12, NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) added. New cstate: current_term: 19 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:16.879072 18446 raft_consensus.cc:993] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: : Instructing follower a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:16.879627 18446 raft_consensus.cc:1081] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Signalling peer a2a8d71f644447218c1afc3e5f7716cd to start an election
I20260709 12:26:16.881444 12633 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a"
dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
 from {username='slave'} at 127.0.0.1:55098
I20260709 12:26:16.882051 12633 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:16.882404 12633 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.907668 12633 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:16.924815 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:16.925582 12702 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.929313 18486 tablet_copy_client.cc:806] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:16.931147 12553 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20e379fdd40947f39c461038e088ea1a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:16.945212 12553 raft_consensus.cc:3055] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:16.945636 12553 raft_consensus.cc:740] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:16.933349 12702 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:16.936638 12633 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:16.948776 18486 tablet_copy_client.cc:670] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:16.951364 12598 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:16.952422 12553 consensus_queue.cc:260] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:16.960721 12553 raft_consensus.cc:3060] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.969164 12553 raft_consensus.cc:2468] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
I20260709 12:26:16.959533 18414 raft_consensus.cc:2804] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:16.978425 18486 tablet_copy_client.cc:538] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:16.992839 18414 raft_consensus.cc:697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:17.023259 18486 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:26:17.017674 18414 consensus_queue.cc:237] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:17.066854 12452 catalog_manager.cc:5697] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 13 to 14, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 14 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:17.096755 12632 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:17.098161 18460 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:17.218317 12702 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:17.227026 18446 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:17.344002 18498 ts_tablet_manager.cc:933] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: Initiating tablet copy from peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:26:17.346988 18477 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.348161 18477 tablet_bootstrap.cc:492] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:26:17.348996 18477 ts_tablet_manager.cc:1403] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.581s	user 0.042s	sys 0.023s
I20260709 12:26:17.360037 18477 raft_consensus.cc:359] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:17.374277 18477 raft_consensus.cc:740] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:26:17.400521 18498 tablet_copy_client.cc:323] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Beginning tablet copy session from remote peer at address 127.11.32.1:45107
I20260709 12:26:17.431674 12568 tablet_copy_service.cc:140] P 23740bafdb794232879a0bb6884f7a68: Received BeginTabletCopySession request for tablet a10e3ca41dda44bc9e0c04ad3cc65f57 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 ({username='slave'} at 127.0.0.1:36566)
I20260709 12:26:17.432330 12568 tablet_copy_service.cc:161] P 23740bafdb794232879a0bb6884f7a68: Beginning new tablet copy session on tablet a10e3ca41dda44bc9e0c04ad3cc65f57 from peer 155b5b0a0b6d4b499edfe2797ffa5b91 at {username='slave'} at 127.0.0.1:36566: session id = 155b5b0a0b6d4b499edfe2797ffa5b91-a10e3ca41dda44bc9e0c04ad3cc65f57
I20260709 12:26:17.438210 12553 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:26:17.448794 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 51985.9us
I20260709 12:26:17.447059 12568 tablet_copy_source_session.cc:215] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:17.451937 18371 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
W20260709 12:26:17.466030 18499 log.cc:927] Time spent T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:26:17.465165 18477 consensus_queue.cc:260] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:17.474906 18477 ts_tablet_manager.cc:1434] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.126s	user 0.008s	sys 0.000s
I20260709 12:26:17.484027 18498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a10e3ca41dda44bc9e0c04ad3cc65f57. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:17.503638 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 46401us
I20260709 12:26:17.512516 18486 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:17.513698 18486 tablet_bootstrap.cc:492] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
W20260709 12:26:17.527864 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 130548us
I20260709 12:26:17.540377 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-7d75a6f40c324994a517c98816b2afc4 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:17.546464 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-7d75a6f40c324994a517c98816b2afc4 on tablet 7d75a6f40c324994a517c98816b2afc4 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
W20260709 12:26:17.559268 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 185988us
I20260709 12:26:17.562170 12708 raft_consensus.cc:1275] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:17.547492 18486 ts_tablet_manager.cc:1403] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.524s	user 0.029s	sys 0.016s
I20260709 12:26:17.580729 18486 raft_consensus.cc:359] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:17.598127 18486 raft_consensus.cc:740] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
W20260709 12:26:17.606832 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 62971.1us
I20260709 12:26:17.595781 18504 consensus_queue.cc:1048] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:26:17.618134 18486 consensus_queue.cc:260] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:17.628584 18486 ts_tablet_manager.cc:1434] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:26:17.639063 12718 tablet_copy_service.cc:342] P c6795b140b3247279a2231c6b9360d24: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-2d04f0e851d04dab8ea27bcfbdbb46e1 received from {username='slave'} at 127.0.0.1:33230
I20260709 12:26:17.639509 12718 tablet_copy_service.cc:434] P c6795b140b3247279a2231c6b9360d24: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-2d04f0e851d04dab8ea27bcfbdbb46e1 on tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:17.640825 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.655514 13230 raft_consensus.cc:1217] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Deduplicated request from leader. Original: 12.7->[12.8-12.8]   Dedup: 12.8->[]
I20260709 12:26:17.659153 13231 raft_consensus.cc:1217] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
W20260709 12:26:17.664157 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 68468.5us
I20260709 12:26:17.745678 12556 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4719532adf46473495ced717a908a078"
dest_uuid: "23740bafdb794232879a0bb6884f7a68"
mode: GRACEFUL
new_leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:34684
I20260709 12:26:17.746577 12556 raft_consensus.cc:606] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Received request to transfer leadership to TS 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:17.748059 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:26:17.751303 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:17.752090 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:17.779939 18501 raft_consensus.cc:993] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: : Instructing follower 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:17.781818 18376 raft_consensus.cc:1081] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Signalling peer 155b5b0a0b6d4b499edfe2797ffa5b91 to start an election
I20260709 12:26:17.795728 13231 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4719532adf46473495ced717a908a078"
dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
 from {username='slave'} at 127.0.0.1:50962
I20260709 12:26:17.796406 13231 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:17.797058 13231 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:17.803658 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 87358.9us
I20260709 12:26:17.824398 13231 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:17.834331 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:17.834914 13231 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Requested vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107)
I20260709 12:26:17.834941 12702 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:17.842536 12556 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: true dest_uuid: "23740bafdb794232879a0bb6884f7a68"
I20260709 12:26:17.843196 12556 raft_consensus.cc:3055] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:17.843497 12556 raft_consensus.cc:740] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 23740bafdb794232879a0bb6884f7a68, State: Running, Role: LEADER
I20260709 12:26:17.844413 12556 consensus_queue.cc:260] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:17.845804 12556 raft_consensus.cc:3060] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:17.858304 12702 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:26:17.859652 13199 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:17.860810 18506 raft_consensus.cc:2804] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:17.861323 18506 raft_consensus.cc:697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:17.862263 18506 consensus_queue.cc:237] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:17.879074 18498 tablet_copy_client.cc:806] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:17.925516 18498 tablet_copy_client.cc:670] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:17.936419 18498 tablet_copy_client.cc:538] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:17.940320 12452 catalog_manager.cc:5697] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 13 to 14, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 14 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:17.916450 12556 raft_consensus.cc:2468] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 14.
I20260709 12:26:18.029560 18498 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap starting.
I20260709 12:26:18.044221 18453 raft_consensus.cc:1064] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:26:18.046926 18453 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:18.114382 13231 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:18.115939 18454 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:18.136343 12632 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:18.137955 18447 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:18.146337 12556 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:18.151384 18447 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:26:18.198341 18447 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.199415 12633 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.242964 12452 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: config changed from index 14 to 15, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.280541 12551 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.277185 18503 raft_consensus.cc:1064] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:26:18.291211 18503 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 6, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:18.298588 12703 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:26:18.300313 18357 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:18.356536 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 66334us
I20260709 12:26:18.396159 12556 raft_consensus.cc:1275] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 12:26:18.397634 18502 consensus_queue.cc:1048] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:18.398136 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 50108us
W20260709 12:26:18.447855 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 81751.4us
W20260709 12:26:18.457640 12523 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 52571.6us
W20260709 12:26:18.491082 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 44828.2us
I20260709 12:26:18.507627 12632 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:18.518625 13231 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.530133 13232 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEARNER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:18.544222 18498 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=0 applied=12 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:18.549722 18498 tablet_bootstrap.cc:492] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: Bootstrap complete.
I20260709 12:26:18.549932 12551 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:18.553864 18498 ts_tablet_manager.cc:1403] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent bootstrapping tablet: real 0.556s	user 0.058s	sys 0.008s
I20260709 12:26:18.556166 18454 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:18.557322 18453 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:18.580353 18503 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:26:18.641618 12708 consensus_queue.cc:237] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:18.641942 18498 raft_consensus.cc:359] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:18.642765 18498 raft_consensus.cc:740] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 LEARNER]: Becoming Follower/Learner. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Initialized, Role: LEARNER
I20260709 12:26:18.643447 18498 consensus_queue.cc:260] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: NON_VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: true } }
I20260709 12:26:18.647437 13232 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:26:18.649102 18453 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:26:18.660386 12632 raft_consensus.cc:1275] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:26:18.664950 18498 ts_tablet_manager.cc:1434] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: Time spent starting tablet: real 0.110s	user 0.006s	sys 0.000s
I20260709 12:26:18.685628 18534 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.688948 18453 consensus_queue.cc:1048] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:18.685631 18533 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.691221 13232 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.711375 12625 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.712879 13231 raft_consensus.cc:1217] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 LEARNER]: Deduplicated request from leader. Original: 19.11->[19.12-19.12]   Dedup: 19.12->[]
I20260709 12:26:18.716037 12556 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.725916 12452 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 8 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:18.740132 12632 raft_consensus.cc:2955] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.753944 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d75a6f40c324994a517c98816b2afc4 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:18.754715 12568 tablet_copy_service.cc:342] P 23740bafdb794232879a0bb6884f7a68: Request end of tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-a10e3ca41dda44bc9e0c04ad3cc65f57 received from {username='slave'} at 127.0.0.1:36566
I20260709 12:26:18.755204 12568 tablet_copy_service.cc:434] P 23740bafdb794232879a0bb6884f7a68: ending tablet copy session 155b5b0a0b6d4b499edfe2797ffa5b91-a10e3ca41dda44bc9e0c04ad3cc65f57 on tablet a10e3ca41dda44bc9e0c04ad3cc65f57 with peer 155b5b0a0b6d4b499edfe2797ffa5b91
I20260709 12:26:18.753597 12452 catalog_manager.cc:5697] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 15 to 16, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 20 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:18.770395 13231 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Committing config change with OpId 12.9: config changed from index 8 to 9, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } attrs { replace: true } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:18.851537 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d75a6f40c324994a517c98816b2afc4 with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:58000
I20260709 12:26:18.889614 12703 consensus_queue.cc:237] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:18.904376 18539 tablet_replica.cc:333] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:18.917488 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:18.905989 13231 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:18.909799 12632 raft_consensus.cc:1275] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:18.918599 18539 raft_consensus.cc:2243] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:18.927183 18539 raft_consensus.cc:2272] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:18.936699 18539 ts_tablet_manager.cc:1916] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:18.965348 18534 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:18.968374 18453 consensus_queue.cc:1048] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:19.028309 18453 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:19.073974 12632 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:19.078822 13231 raft_consensus.cc:2955] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Committing config change with OpId 12.10: config changed from index 9 to 10, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:19.085632 12442 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 with cas_config_opid_index 9: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:19.094635 12451 catalog_manager.cc:5697] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 reported cstate change: config changed from index 9 to 10, VOTER 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) evicted. New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:19.149271 12541 tablet_service.cc:1558] Processing DeleteTablet for tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 with delete_type TABLET_DATA_TOMBSTONED (TS 23740bafdb794232879a0bb6884f7a68 not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:58000
I20260709 12:26:19.169571 18539 ts_tablet_manager.cc:1929] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.15
I20260709 12:26:19.177711 18539 log.cc:1199] T 7d75a6f40c324994a517c98816b2afc4 P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/7d75a6f40c324994a517c98816b2afc4
I20260709 12:26:19.179697 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 7d75a6f40c324994a517c98816b2afc4 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:19.174645 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:26:19.181962 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:19.182789 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.185999 18539 tablet_replica.cc:333] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:19.187301 18539 raft_consensus.cc:2243] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:19.188163 18539 raft_consensus.cc:2272] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:19.196341 18539 ts_tablet_manager.cc:1916] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:19.267587 18539 ts_tablet_manager.cc:1929] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 12.9
I20260709 12:26:19.269860 18539 log.cc:1199] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 23740bafdb794232879a0bb6884f7a68: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/wals/2d04f0e851d04dab8ea27bcfbdbb46e1
I20260709 12:26:19.277810 12444 catalog_manager.cc:5028] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): tablet 2d04f0e851d04dab8ea27bcfbdbb46e1 (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:19.300307 18376 raft_consensus.cc:1064] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: attempting to promote NON_VOTER 155b5b0a0b6d4b499edfe2797ffa5b91 to VOTER
I20260709 12:26:19.302997 18376 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:19.392593 13231 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 LEARNER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:19.394593 18532 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:19.400055 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:19.484922 12703 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:19.486936 18528 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:19.492898 12632 raft_consensus.cc:1275] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Refusing update from remote peer 23740bafdb794232879a0bb6884f7a68: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:19.495240 18532 consensus_queue.cc:1048] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:19.523612 18528 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:19.567353 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
W20260709 12:26:19.570374 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 48526us
I20260709 12:26:19.576018 13231 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:19.590078 13201 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:26:19.640776 12451 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 12 to 13, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New cstate: current_term: 19 leader_uuid: "23740bafdb794232879a0bb6884f7a68" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:19.698120 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 108060us
W20260709 12:26:19.707576 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 85285us
W20260709 12:26:19.750304 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.752008 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.811115 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:19.810029 12703 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:19.815887 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.829634 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.848102 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.897466 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.929141 12600 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 58273.2us
I20260709 12:26:19.936964 12632 raft_consensus.cc:2955] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Committing config change with OpId 19.13: config changed from index 12 to 13, 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
W20260709 12:26:19.945803 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:19.989315 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.027125 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.027755 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.034970 12600 consensus_peers.cc:597] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.052657 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.053367 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.053952 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.054536 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.054471 12600 consensus_peers.cc:597] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.056543 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.057825 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.058669 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.059461 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.071151 12600 consensus_peers.cc:597] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.089255 12600 consensus_peers.cc:597] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.091140 12600 consensus_peers.cc:597] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.092607 12600 consensus_peers.cc:597] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.093242 12600 consensus_peers.cc:597] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.093820 12600 consensus_peers.cc:597] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.108649 12600 consensus_peers.cc:597] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.117807 12600 consensus_peers.cc:597] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:20.124679 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:20.206902 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:20.208707 11392 tablet_replica.cc:333] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.210458 11392 raft_consensus.cc:2243] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.211175 11392 raft_consensus.cc:2272] T f8bd8b4df5594ab89b5028f708332757 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:20.225382 12444 catalog_manager.cc:4755] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:20.222987 11392 tablet_replica.cc:333] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.235337 11392 raft_consensus.cc:2243] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.236469 11392 raft_consensus.cc:2272] T f768a2094f5744cfa0dec019647ccb13 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.300137 11392 tablet_replica.cc:333] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.310254 11392 raft_consensus.cc:2243] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.327459 11392 raft_consensus.cc:2272] T c12120af627b4866b9f483d6cd9f30f5 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.411404 11392 tablet_replica.cc:333] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.412652 11392 raft_consensus.cc:2243] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.414194 11392 raft_consensus.cc:2272] T 28c65936613f4ee89e3dc89d06a91776 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:20.426680 12522 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 62164.8us
I20260709 12:26:20.512619 11392 tablet_replica.cc:333] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.513731 11392 raft_consensus.cc:2243] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.517740 18566 raft_consensus.cc:493] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:20.518303 18566 raft_consensus.cc:515] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.521351 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:20.522172 18566 leader_election.cc:290] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.522389 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6ad0911475a422ab0936b28dc4c93f1" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.526396 12522 leader_election.cc:304] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:20.529209 18566 raft_consensus.cc:2749] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:20.532176 11392 raft_consensus.cc:2272] T 8acfb123196f471d9fa81328e89997cc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.550925 11392 tablet_replica.cc:333] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.551813 11392 raft_consensus.cc:2243] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.552479 11392 raft_consensus.cc:2272] T 0116b2408a7241828256061551a36f1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.569751 11392 tablet_replica.cc:333] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.581481 11392 raft_consensus.cc:2243] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.582121 11392 raft_consensus.cc:2272] T 75aab4686614449489ce5c08d0860bd6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.584795 11392 tablet_replica.cc:333] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.589141 11392 raft_consensus.cc:2243] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.590118 11392 raft_consensus.cc:2272] T d472a3f71a5d430fafa4a535ed826f18 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.592739 11392 tablet_replica.cc:333] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.593612 11392 raft_consensus.cc:2243] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.594161 11392 raft_consensus.cc:2272] T 20e379fdd40947f39c461038e088ea1a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.596745 11392 tablet_replica.cc:333] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.597573 11392 raft_consensus.cc:2243] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 7 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.607055 11392 raft_consensus.cc:2272] T d9812250f15d4075a3c8831ca5f3ed41 P 23740bafdb794232879a0bb6884f7a68 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.615332 11392 tablet_replica.cc:333] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.616132 11392 raft_consensus.cc:2243] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.616739 11392 raft_consensus.cc:2272] T 23f3709af552426ebb55ecf39265cc47 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.623461 18544 raft_consensus.cc:493] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:20.624040 18544 raft_consensus.cc:515] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.626823 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:20.631358 18544 leader_election.cc:290] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.633430 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "91e9b98dfcc94a4f87b33617aa6df487" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.635350 11392 tablet_replica.cc:333] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.635223 12522 leader_election.cc:304] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:20.637544 18544 raft_consensus.cc:2749] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:20.646356 11392 raft_consensus.cc:2243] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.647360 18544 raft_consensus.cc:493] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:20.647964 18544 raft_consensus.cc:515] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.647562 11392 raft_consensus.cc:2272] T d5554b3483384c14898b46be0dbd5ae5 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.652621 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.654949 11392 tablet_replica.cc:333] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.655759 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3f9ecf42cca34c34954029c3568e54b2" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.656102 11392 raft_consensus.cc:2243] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.655781 18544 leader_election.cc:290] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.656859 11392 raft_consensus.cc:2272] T 793f816912494728bf76dd612942dc4c P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.657238 12522 leader_election.cc:304] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:20.661580 18566 raft_consensus.cc:493] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:20.662081 18566 raft_consensus.cc:515] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:20.664947 18566 leader_election.cc:290] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:20.665190 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:20.665830 18544 raft_consensus.cc:2749] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:20.668313 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6a602467dda4cb0bbfb59098cf973c9" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.670060 12522 leader_election.cc:304] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:20.674687 11392 tablet_replica.cc:333] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.676124 11392 raft_consensus.cc:2243] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.677177 11392 raft_consensus.cc:2272] T bc86699922844edbae89cb65c328e3ce P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.682212 18544 raft_consensus.cc:2749] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:20.687599 11392 tablet_replica.cc:333] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.688458 11392 raft_consensus.cc:2243] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.689038 11392 raft_consensus.cc:2272] T c6a602467dda4cb0bbfb59098cf973c9 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.703547 11392 tablet_replica.cc:333] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.704258 11392 raft_consensus.cc:2243] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.704806 11392 raft_consensus.cc:2272] T e19c569fe6e34f969a722bd2495c3a89 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.706645 18566 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:20.707141 18566 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:20.709139 18566 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:20.710364 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:20.712182 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e25848d0a4024deda42b246d049b5be0" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.713717 18567 raft_consensus.cc:493] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:20.719007 18567 raft_consensus.cc:515] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.721305 18567 leader_election.cc:290] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.722985 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.725034 12522 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:20.726164 18567 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:20.727018 11392 tablet_replica.cc:333] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.727669 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df7bcc0f7c2a4fc0a36e8605f87a3a0b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.727975 11392 raft_consensus.cc:2243] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.728967 12522 leader_election.cc:304] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:20.729212 11392 raft_consensus.cc:2272] T ef8bfbfb91b54571bed5f5d44534395a P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.730134 18567 raft_consensus.cc:2749] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:20.734316 18567 raft_consensus.cc:493] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:20.737264 11392 tablet_replica.cc:333] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.735407 18567 raft_consensus.cc:515] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } attrs { replace: true } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.738204 11392 raft_consensus.cc:2243] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.739526 11392 raft_consensus.cc:2272] T 39edb149903d45b5a17cbbc4dd12850b P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.740149 18567 leader_election.cc:290] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.740447 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:20.743505 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.745227 12522 leader_election.cc:304] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:20.748456 18544 raft_consensus.cc:2749] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:20.746408 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54ae52ca0f5e4e988dcd22a9651ec1bd" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.750399 11392 tablet_replica.cc:333] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.751221 11392 raft_consensus.cc:2243] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.751995 11392 raft_consensus.cc:2272] T 606f6695c1e84da291559cacabfa82bc P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.768734 11392 tablet_replica.cc:333] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.769814 11392 raft_consensus.cc:2243] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.770551 11392 raft_consensus.cc:2272] T a6ad0911475a422ab0936b28dc4c93f1 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.773533 11392 tablet_replica.cc:333] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.774286 11392 raft_consensus.cc:2243] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.774930 11392 raft_consensus.cc:2272] T 0e137b72ba4847d6ad89da17af64db7d P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.777590 11392 tablet_replica.cc:333] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.778326 11392 raft_consensus.cc:2243] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.779254 11392 raft_consensus.cc:2272] T 04a769018c454aa685eae73d74c89abb P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.795660 11392 tablet_replica.cc:333] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.796506 11392 raft_consensus.cc:2243] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.797134 11392 raft_consensus.cc:2272] T d457e0ba678747fba0ac2a4c1b42649e P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.799607 11392 tablet_replica.cc:333] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.800398 11392 raft_consensus.cc:2243] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.814039 11392 raft_consensus.cc:2272] T 91e9b98dfcc94a4f87b33617aa6df487 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.816884 11392 tablet_replica.cc:333] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.817821 11392 raft_consensus.cc:2243] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.818485 11392 raft_consensus.cc:2272] T 613ed3057bf74d02a48d823635fd0b6a P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.821357 11392 tablet_replica.cc:333] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.821439 18566 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:20.822139 11392 raft_consensus.cc:2243] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.822024 18566 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.822767 11392 raft_consensus.cc:2272] T 9257ace92110474f9ba7f25a16b03161 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.824246 18566 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.826372 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.827390 11392 tablet_replica.cc:333] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.828307 11392 raft_consensus.cc:2243] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.828575 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "140159e481364d9e99f0f034c42b7fda" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.829288 11392 raft_consensus.cc:2272] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 23740bafdb794232879a0bb6884f7a68 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.830588 12522 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:20.831975 18566 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:20.831959 11392 tablet_replica.cc:333] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.843287 11392 raft_consensus.cc:2243] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.844488 11392 raft_consensus.cc:2272] T 47430c4494f1431f8fb577cd8838f972 P 23740bafdb794232879a0bb6884f7a68 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.847400 11392 tablet_replica.cc:333] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.848141 11392 raft_consensus.cc:2243] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.849078 11392 raft_consensus.cc:2272] T 9e5ce7f361ff45268f58f04272a4a5ef P 23740bafdb794232879a0bb6884f7a68 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.851683 11392 tablet_replica.cc:333] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.861784 11392 raft_consensus.cc:2243] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.866896 11392 raft_consensus.cc:2272] T e18a3c206d6646e69fba42e3b74572a6 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.873606 11392 tablet_replica.cc:333] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.875676 11392 raft_consensus.cc:2243] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.886129 11392 raft_consensus.cc:2272] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.895210 11392 tablet_replica.cc:333] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.897687 11392 raft_consensus.cc:2243] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.898399 11392 raft_consensus.cc:2272] T 140159e481364d9e99f0f034c42b7fda P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.901015 11392 tablet_replica.cc:333] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.901831 11392 raft_consensus.cc:2243] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.909085 11392 raft_consensus.cc:2272] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 23740bafdb794232879a0bb6884f7a68 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.911772 11392 tablet_replica.cc:333] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.912566 11392 raft_consensus.cc:2243] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.930922 18567 raft_consensus.cc:493] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:20.931540 18567 raft_consensus.cc:515] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.933779 18567 leader_election.cc:290] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.935717 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.913137 11392 raft_consensus.cc:2272] T 936a02b62f0d46168b0550920bd53ed3 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.941874 11392 tablet_replica.cc:333] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.948844 11392 raft_consensus.cc:2243] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.947706 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ca7fa9a22ba4b0b8300a42169fced1c" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.947834 18546 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:20.952476 18546 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:20.956811 18546 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:20.958413 11392 raft_consensus.cc:2272] T cd26860ea4e84bd7851de4aaa5d02f01 P 23740bafdb794232879a0bb6884f7a68 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.961759 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:20.963402 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2514eba211b3456c96ca755c4c7c084b" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:20.964797 12522 leader_election.cc:304] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:20.966506 18566 raft_consensus.cc:2749] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:20.967361 11392 tablet_replica.cc:333] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.968225 11392 raft_consensus.cc:2243] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.968854 11392 raft_consensus.cc:2272] T 2ca7fa9a22ba4b0b8300a42169fced1c P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.973536 12522 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:20.974406 18566 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:20.981849 11392 tablet_replica.cc:333] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.982717 11392 raft_consensus.cc:2243] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:20.990250 11392 raft_consensus.cc:2272] T 52ac1951d6d64447869208058e8755b6 P 23740bafdb794232879a0bb6884f7a68 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:20.992758 11392 tablet_replica.cc:333] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:20.995563 11392 raft_consensus.cc:2243] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:20.996145 11392 raft_consensus.cc:2272] T 2514eba211b3456c96ca755c4c7c084b P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.004967 18546 raft_consensus.cc:493] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:21.005957 11392 tablet_replica.cc:333] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.006747 11392 raft_consensus.cc:2243] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.007684 11392 raft_consensus.cc:2272] T 700a61b9aeed45869b2d882368e99824 P 23740bafdb794232879a0bb6884f7a68 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.006016 18546 raft_consensus.cc:515] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.011061 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:21.018497 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0afb49cf962a46388bf387ad7b344c39" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:21.028286 12522 leader_election.cc:304] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:21.029197 18567 raft_consensus.cc:2749] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:21.030217 18567 raft_consensus.cc:493] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 155b5b0a0b6d4b499edfe2797ffa5b91)
I20260709 12:26:21.030738 18567 raft_consensus.cc:515] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.033556 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:21.034166 18567 leader_election.cc:290] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:21.036453 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4719532adf46473495ced717a908a078" candidate_uuid: "23740bafdb794232879a0bb6884f7a68" candidate_term: 15 candidate_status { last_received { term: 14 index: 14 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:21.037124 11392 tablet_replica.cc:333] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.037938 11392 raft_consensus.cc:2243] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.042703 12522 leader_election.cc:304] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 23740bafdb794232879a0bb6884f7a68; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:21.043080 11392 raft_consensus.cc:2272] T e25848d0a4024deda42b246d049b5be0 P 23740bafdb794232879a0bb6884f7a68 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.043993 18567 raft_consensus.cc:2749] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.049614 18546 leader_election.cc:290] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:21.053942 11392 tablet_replica.cc:333] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.054802 11392 raft_consensus.cc:2243] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.055593 11392 raft_consensus.cc:2272] T 0afb49cf962a46388bf387ad7b344c39 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.061659 11392 tablet_replica.cc:333] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.062290 11392 raft_consensus.cc:2243] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.063244 11392 raft_consensus.cc:2272] T 85949dbea3b742fea0cb31dfc53d5766 P 23740bafdb794232879a0bb6884f7a68 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.083384 11392 tablet_replica.cc:333] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.084050 11392 raft_consensus.cc:2243] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.084543 11392 raft_consensus.cc:2272] T 4719532adf46473495ced717a908a078 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.103180 11392 tablet_replica.cc:333] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.103866 11392 raft_consensus.cc:2243] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:21.104456 11392 raft_consensus.cc:2272] T 3f9ecf42cca34c34954029c3568e54b2 P 23740bafdb794232879a0bb6884f7a68 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.106931 11392 tablet_replica.cc:333] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68: stopping tablet replica
I20260709 12:26:21.107496 11392 raft_consensus.cc:2243] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:21.108513 11392 raft_consensus.cc:2272] T af0709be9e0d4bf39ce083c7af243837 P 23740bafdb794232879a0bb6884f7a68 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:21.507488 18553 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.508209 18553 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.511109 18553 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:21.529114 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:21.580549 12600 leader_election.cc:336] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.581135 12600 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:21.585191 18572 raft_consensus.cc:2749] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:21.644917 12444 catalog_manager.cc:4755] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.659838 18574 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.660413 18574 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.662560 18574 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:21.664021 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:21.664669 12632 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:26:21.667768 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:21.668845 18453 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:21.669181 18453 raft_consensus.cc:493] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.669517 18453 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.670811 18553 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.671384 18553 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:21.676420 12674 leader_election.cc:336] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.678823 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:21.674147 18553 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:21.684746 12600 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.685425 12600 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:21.686007 18453 raft_consensus.cc:515] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.686738 18553 raft_consensus.cc:2749] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:21.696419 12674 leader_election.cc:336] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.701481 12632 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f768a2094f5744cfa0dec019647ccb13" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:21.702062 12632 raft_consensus.cc:3060] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:21.711025 18453 leader_election.cc:290] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:21.711889 12632 raft_consensus.cc:2468] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:26:21.713197 12671 leader_election.cc:304] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:21.714500 18574 raft_consensus.cc:2804] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:21.743247 18574 raft_consensus.cc:697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:21.744164 18574 consensus_queue.cc:237] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.782367 18563 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.782929 18563 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.786309 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:21.787807 18563 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:21.790096 18575 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.790657 18575 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.792809 18575 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:21.798486 12600 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.799924 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:21.801266 12598 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:21.803164 13201 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.803957 13201 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:21.804759 18577 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.812873 18572 raft_consensus.cc:2749] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:21.813630 18572 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.814103 18572 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.815786 13231 consensus_queue.cc:237] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.817314 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:21.818305 18572 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:21.826010 12600 leader_election.cc:336] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.826592 12600 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:21.827435 18575 raft_consensus.cc:2749] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:21.828933 18534 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.829464 18534 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.832765 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:21.833379 12625 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:26:21.834858 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:21.841704 12703 raft_consensus.cc:1275] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 12:26:21.843076 12674 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.843189 18577 consensus_queue.cc:1048] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:21.843845 18453 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:21.856947 18453 raft_consensus.cc:493] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.857340 18453 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:21.860504 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:21.864104 18577 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.865749 18577 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.868209 18577 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:21.869194 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:21.869927 12625 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 7.
I20260709 12:26:21.871104 13198 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:21.872570 18534 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:21.878108 13201 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.892256 18577 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:21.897572 18577 raft_consensus.cc:493] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.896829 18453 raft_consensus.cc:515] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.899536 18574 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.901151 12453 catalog_manager.cc:5697] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 14 to 15, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:21.902550 18574 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.898337 18577 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:21.912676 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:21.919461 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d472a3f71a5d430fafa4a535ed826f18" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:21.920003 12625 raft_consensus.cc:3060] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:21.921669 12674 leader_election.cc:336] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:21.922271 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.922700 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:21.929766 18453 leader_election.cc:290] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:21.931838 12625 raft_consensus.cc:2468] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 13.
I20260709 12:26:21.932947 12671 leader_election.cc:304] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:21.934937 18574 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:21.936901 18530 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.937089 18581 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:21.937557 18530 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:21.941599 18572 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.942168 18572 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.944383 18572 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:21.950127 18530 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:21.956128 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:21.953456 18534 raft_consensus.cc:2804] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:21.958314 18563 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index 4 to 10, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:21.962234 18534 raft_consensus.cc:697] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:21.962409 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:21.963161 12625 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 17.
I20260709 12:26:21.964228 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 
I20260709 12:26:21.965191 12703 raft_consensus.cc:2955] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index 4 to 10, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } } }
I20260709 12:26:21.963225 18534 consensus_queue.cc:237] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:21.974102 13201 leader_election.cc:336] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:21.972311 18575 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.975049 18575 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.977118 18575 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:21.980424 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:21.981582 18572 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.982153 18572 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:21.984133 18572 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:21.985127 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:21.991714 18453 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:21.992403 18453 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.003412 18453 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.004889 18586 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:22.005380 18586 raft_consensus.cc:493] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.005788 18586 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:22.013266 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:22.013947 13231 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
W20260709 12:26:22.012048 12600 leader_election.cc:336] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.017798 12600 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:21.997866 18572 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.024075 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:22.033123 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 69818.7us
I20260709 12:26:22.033818 18581 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:22.034267 18581 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.034633 18581 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:22.027486 18553 raft_consensus.cc:2749] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:22.031118 12600 leader_election.cc:336] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.043795 12600 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
W20260709 12:26:22.044018 12674 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.044875 12600 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.045193 18575 raft_consensus.cc:2749] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:22.037781 18572 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.045991 12600 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:22.047796 18575 raft_consensus.cc:2749] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:22.051177 18586 raft_consensus.cc:515] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.052060 18572 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.052603 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:22.056252 12600 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.062044 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:22.064778 12441 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 12)
W20260709 12:26:22.083942 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 46514.7us
I20260709 12:26:22.083756 18553 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:22.092435 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:22.088407 18571 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.111459 18575 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.112056 18575 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.113847 18586 leader_election.cc:290] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.127981 18534 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.128553 18534 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.130988 18534 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:22.137262 12674 leader_election.cc:336] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.137346 18571 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.139816 18571 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.141736 18581 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.144109 18581 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:22.148434 12674 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.150041 13201 leader_election.cc:336] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.156939 12600 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.160709 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.163491 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.108737 18577 raft_consensus.cc:515] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.171583 18577 leader_election.cc:290] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.124284 18575 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:22.180867 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 94850.7us
W20260709 12:26:22.181519 12600 consensus_peers.cc:597] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.183060 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.183712 12625 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:26:22.193977 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39edb149903d45b5a17cbbc4dd12850b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:22.194597 13231 raft_consensus.cc:3060] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:22.196826 18534 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.197357 18534 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.199295 18534 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.201474 13231 raft_consensus.cc:2468] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:26:22.202457 12671 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.203459 18581 raft_consensus.cc:2804] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:22.203929 18581 raft_consensus.cc:697] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:22.204813 18581 consensus_queue.cc:237] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.208168 12451 catalog_manager.cc:5697] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: config changed from index 4 to 10, VOTER a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) evicted. New cstate: current_term: 14 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.218333 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:22.218900 12625 raft_consensus.cc:1275] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:22.218983 12703 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 14.
W20260709 12:26:22.219817 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.219967 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:26:22.222509 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 116152us
I20260709 12:26:22.226125 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.227401 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d5554b3483384c14898b46be0dbd5ae5" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.228086 12625 raft_consensus.cc:3060] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:22.225456 18594 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.230276 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9812250f15d4075a3c8831ca5f3ed41" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.230913 12627 raft_consensus.cc:3060] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:22.230720 18594 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.232851 18594 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.223930 18530 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:26:22.234412 12600 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.234473 18530 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.236617 18530 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:22.237254 12600 leader_election.cc:336] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.237527 13201 leader_election.cc:336] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.240850 12625 raft_consensus.cc:2468] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 18.
I20260709 12:26:22.242317 18575 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:22.242767 18575 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.243139 18575 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:22.249974 12627 raft_consensus.cc:2468] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 8.
I20260709 12:26:22.253438 18581 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.254031 18581 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.258097 18574 consensus_queue.cc:1048] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:22.262421 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:22.262845 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:22.263477 13232 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 9.
I20260709 12:26:22.263511 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.224143 18534 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:22.267588 12674 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.269338 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:26:22.271616 13201 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.297803 12598 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:22.271833 18530 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.273582 13198 leader_election.cc:304] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.277329 18582 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.279285 18575 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.302717 13198 leader_election.cc:304] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.285997 18553 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:26:22.287469 12600 consensus_peers.cc:597] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.291069 18581 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.312754 12621 tablet_service.cc:1558] Processing DeleteTablet for tablet 54ae52ca0f5e4e988dcd22a9651ec1bd with delete_type TABLET_DATA_TOMBSTONED (TS a2a8d71f644447218c1afc3e5f7716cd not found in new config with opid_index 10) from {username='slave'} at 127.0.0.1:55074
W20260709 12:26:22.311301 12600 consensus_peers.cc:597] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.310516 18599 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:22.294407 18534 raft_consensus.cc:493] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.310730 18597 raft_consensus.cc:2749] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:22.313783 18582 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.315080 18553 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.319734 18563 raft_consensus.cc:2804] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:22.327998 18582 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.316392 18596 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.328840 18596 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.311029 18530 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.331108 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.329622 18553 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.313679 18577 raft_consensus.cc:2804] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:22.351373 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:22.352476 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 70545.3us
I20260709 12:26:22.354702 18581 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:22.319303 18534 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:22.361609 18577 raft_consensus.cc:697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:22.362588 18577 consensus_queue.cc:237] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.369626 18575 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:22.381299 12597 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:37323, user_credentials={real_user=slave}} blocked reactor thread for 62322.3us
I20260709 12:26:22.384420 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:22.385100 13231 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:26:22.317544 18599 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.340137 18563 raft_consensus.cc:697] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:22.386801 12453 catalog_manager.cc:5697] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 12 to 13, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 13 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.394639 12453 catalog_manager.cc:5697] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 14 to 15, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.402890 18582 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.403472 18582 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:22.406764 12600 consensus_peers.cc:597] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.390208 18599 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:22.411237 18582 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.416229 18453 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.418692 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.418821 18582 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.419349 12633 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 16.
I20260709 12:26:22.420053 18596 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.419780 18582 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.416711 18453 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.425019 18563 consensus_queue.cc:237] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.428097 18582 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.434298 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:22.434940 12702 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 10.
I20260709 12:26:22.439033 18453 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.432590 18534 raft_consensus.cc:515] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.442965 18534 leader_election.cc:290] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.444947 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.446718 18590 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:22.447212 18590 raft_consensus.cc:493] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.447579 18590 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:22.455376 12600 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.455991 12600 consensus_peers.cc:597] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.456377 12600 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.465462 18590 raft_consensus.cc:515] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.477574 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52ac1951d6d64447869208058e8755b6" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:22.478188 12700 raft_consensus.cc:3060] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:22.486514 12700 raft_consensus.cc:2468] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 11.
I20260709 12:26:22.487414 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.489712 12627 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 17.
I20260709 12:26:22.488131 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:22.490553 13199 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.490762 13232 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 19.
I20260709 12:26:22.488539 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.491425 18586 raft_consensus.cc:2804] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:22.491804 12633 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 19.
I20260709 12:26:22.492151 18586 raft_consensus.cc:697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
W20260709 12:26:22.493147 12600 consensus_peers.cc:597] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.493094 18586 consensus_queue.cc:237] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:22.494982 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.495918 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc86699922844edbae89cb65c328e3ce" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 5 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.496462 12633 raft_consensus.cc:3060] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:22.498272 18591 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.499619 18605 tablet_replica.cc:333] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:22.500191 18591 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.491441 18599 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.501775 12625 raft_consensus.cc:2393] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 10: Already voted for candidate a2a8d71f644447218c1afc3e5f7716cd in this term.
I20260709 12:26:22.501811 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:22.502496 18591 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.502530 13232 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:26:22.509313 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:22.510265 13201 leader_election.cc:336] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.510349 18530 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.510771 18605 raft_consensus.cc:2243] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:22.511523 18605 raft_consensus.cc:2272] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:22.512993 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.513480 13201 leader_election.cc:336] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.513988 18534 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260709 12:26:22.514122 13201 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.514431 18534 raft_consensus.cc:493] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
W20260709 12:26:22.514778 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.514844 18534 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:22.522337 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:22.522974 12700 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 12.
W20260709 12:26:22.523722 13201 leader_election.cc:336] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.525068 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:22.525763 12708 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 19.
W20260709 12:26:22.529292 11392 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12580)
I20260709 12:26:22.530936 12633 raft_consensus.cc:2468] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:22.532830 13199 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:26:22.534420 12600 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.544261 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:22.545136 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.545585 18612 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:22.546017 18612 raft_consensus.cc:493] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.546392 18612 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:22.549041 12600 consensus_peers.cc:597] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.550331 12671 leader_election.cc:304] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.551512 18453 raft_consensus.cc:2804] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:22.552248 18453 raft_consensus.cc:697] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:22.529693 18599 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:22.538646 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 123419us
I20260709 12:26:22.539034 18530 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:22.541839 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "47430c4494f1431f8fb577cd8838f972" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:22.542165 18590 leader_election.cc:290] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.556141 18530 raft_consensus.cc:493] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.556293 13232 raft_consensus.cc:3060] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:22.556775 18530 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:22.554442 18453 consensus_queue.cc:237] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.563462 13232 raft_consensus.cc:2468] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 10.
I20260709 12:26:22.564158 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.565244 12633 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 19.
I20260709 12:26:22.566219 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:22.566722 12597 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.567004 18590 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:22.567545 18599 raft_consensus.cc:2804] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:22.568106 18599 raft_consensus.cc:697] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:22.569068 18599 consensus_queue.cc:237] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.574584 18605 ts_tablet_manager.cc:1916] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:22.586037 12671 leader_election.cc:304] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.585718 18530 raft_consensus.cc:515] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.590099 18574 raft_consensus.cc:2764] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:26:22.569051 13198 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.591593 18563 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:22.591995 18563 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.592353 18563 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:22.602267 18534 raft_consensus.cc:515] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.603483 12702 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef8bfbfb91b54571bed5f5d44534395a" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:22.604090 12702 raft_consensus.cc:3060] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:22.604408 18534 leader_election.cc:290] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.593737 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.607338 18612 raft_consensus.cc:515] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.609143 18453 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:22.609524 18453 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.609817 18453 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:22.611575 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:22.612335 18530 leader_election.cc:290] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.612201 12708 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:22.613344 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "700a61b9aeed45869b2d882368e99824" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
W20260709 12:26:22.613692 12600 consensus_peers.cc:597] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.614050 12699 raft_consensus.cc:3060] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:22.615432 12671 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:22.619978 13201 leader_election.cc:336] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.627064 12625 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e5ce7f361ff45268f58f04272a4a5ef" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.627669 12625 raft_consensus.cc:3060] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:22.628126 12702 raft_consensus.cc:2468] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 15.
I20260709 12:26:22.618975 18563 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:22.632459 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.632694 12699 raft_consensus.cc:2468] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 13.
I20260709 12:26:22.633438 18574 raft_consensus.cc:2764] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
W20260709 12:26:22.634032 12674 leader_election.cc:336] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.634178 13199 leader_election.cc:304] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
W20260709 12:26:22.636461 13201 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.637451 18530 raft_consensus.cc:2804] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:22.641891 12699 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:22.639438 18563 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 20 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.642788 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.653717 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd26860ea4e84bd7851de4aaa5d02f01" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.638206 12625 raft_consensus.cc:2468] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 17.
I20260709 12:26:22.654448 12633 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:22.650146 18612 leader_election.cc:290] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.654592 12627 raft_consensus.cc:3060] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:22.642585 18530 raft_consensus.cc:697] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:22.655680 18530 consensus_queue.cc:237] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:22.659958 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.662248 12633 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 20.
W20260709 12:26:22.653671 12600 consensus_peers.cc:597] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.666785 12451 catalog_manager.cc:5697] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 7 to 8, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 8 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.671603 18605 ts_tablet_manager.cc:1929] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.9
I20260709 12:26:22.672132 18605 log.cc:1199] T 54ae52ca0f5e4e988dcd22a9651ec1bd P a2a8d71f644447218c1afc3e5f7716cd: Deleting WAL directory at /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/wals/54ae52ca0f5e4e988dcd22a9651ec1bd
I20260709 12:26:22.663897 12454 catalog_manager.cc:5697] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 9 to 10, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 10 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.666424 12671 leader_election.cc:304] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.662365 12627 raft_consensus.cc:2468] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 18.
W20260709 12:26:22.674408 12600 consensus_peers.cc:597] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.674422 18582 raft_consensus.cc:2804] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:22.675365 18582 raft_consensus.cc:697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 17 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:22.675987 12671 leader_election.cc:304] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.676182 18582 consensus_queue.cc:237] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.676851 18612 raft_consensus.cc:2804] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:22.677587 18612 raft_consensus.cc:697] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:22.678491 18612 consensus_queue.cc:237] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.686275 12441 catalog_manager.cc:5028] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): tablet 54ae52ca0f5e4e988dcd22a9651ec1bd (table test-workload [id=7046dbd9643147cdb517cae3b4d0d344]) successfully deleted
I20260709 12:26:22.646400 18453 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:22.696607 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.697387 12633 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 20: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:22.701247 12699 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in current term 20: Already voted for candidate c6795b140b3247279a2231c6b9360d24 in this term.
I20260709 12:26:22.704732 13199 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:22.708997 18577 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:22.726955 12454 catalog_manager.cc:5697] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 17 to 18, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 18 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.728797 12454 catalog_manager.cc:5697] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 10 to 11, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.731706 12454 catalog_manager.cc:5697] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 16 to 17, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 17 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.744982 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:22.745841 13232 raft_consensus.cc:2393] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate c6795b140b3247279a2231c6b9360d24 in current term 20: Already voted for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in this term.
I20260709 12:26:22.747186 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:22.747998 18612 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:22.748463 18453 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:22.762094 12627 raft_consensus.cc:1275] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:22.764222 18563 consensus_queue.cc:1048] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:22.781888 18608 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.784032 18608 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.787264 18608 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.788226 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.789429 18599 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:22.789805 18599 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.790150 18599 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:22.798498 12633 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd" is_pre_election: true
I20260709 12:26:22.799237 12633 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 14.
I20260709 12:26:22.800791 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.802414 18608 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:22.802035 12451 catalog_manager.cc:5697] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 17 to 18, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 18 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.802841 18608 raft_consensus.cc:493] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 23740bafdb794232879a0bb6884f7a68)
I20260709 12:26:22.803368 18608 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:22.803762 12451 catalog_manager.cc:5697] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 10 to 11, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 11 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:22.804383 18599 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.806319 12598 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:22.807981 18575 raft_consensus.cc:2804] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:22.808584 18575 raft_consensus.cc:697] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
W20260709 12:26:22.810328 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:22.809794 12451 catalog_manager.cc:5697] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 12 to 13, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 13 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:22.822682 12674 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.823985 18575 consensus_queue.cc:237] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:22.827894 12600 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.808033 18599 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:22.829623 12633 raft_consensus.cc:1275] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:22.836985 18563 consensus_queue.cc:1048] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 12:26:22.821199 12444 catalog_manager.cc:4755] TS 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.824699 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.842115 12674 leader_election.cc:336] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.843406 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.850159 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 49463.9us
W20260709 12:26:22.863363 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.866662 18608 raft_consensus.cc:515] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.871495 12627 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af0709be9e0d4bf39ce083c7af243837" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "a2a8d71f644447218c1afc3e5f7716cd"
I20260709 12:26:22.872074 12627 raft_consensus.cc:3060] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:22.885499 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.891965 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 45277.5us
W20260709 12:26:22.896158 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:22.901067 18608 leader_election.cc:290] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:22.903388 12627 raft_consensus.cc:2468] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 15.
I20260709 12:26:22.904632 12671 leader_election.cc:304] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:22.905467 18608 raft_consensus.cc:2804] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:22.906179 18608 raft_consensus.cc:697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:22.907054 12454 catalog_manager.cc:5697] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 14 to 15, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 15 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:22.907006 18608 consensus_queue.cc:237] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:22.938551 12708 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85949dbea3b742fea0cb31dfc53d5766" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:22.939090 12708 raft_consensus.cc:3060] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:22.945713 12708 raft_consensus.cc:2468] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 16.
W20260709 12:26:22.948573 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.981727 12674 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:22.962101 12627 raft_consensus.cc:1275] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 12:26:22.982564 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.982995 12674 leader_election.cc:336] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.983636 12674 leader_election.cc:336] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.984275 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.984671 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:22.985327 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.985734 12674 leader_election.cc:336] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.986380 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.986760 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:22.987128 12674 leader_election.cc:336] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:22.987748 12674 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:23.002255 12598 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:23.008096 18571 raft_consensus.cc:2804] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:23.008860 18571 raft_consensus.cc:697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 16 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:23.009912 18571 consensus_queue.cc:237] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:23.022444 12451 catalog_manager.cc:5697] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 14 to 15, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 15 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:23.023209 18608 consensus_queue.cc:1048] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:22.981112 12699 raft_consensus.cc:1275] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:23.030197 18587 consensus_queue.cc:1048] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:23.032518 13229 raft_consensus.cc:1275] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:23.034705 18608 consensus_queue.cc:1048] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:23.045897 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 43759.4us
I20260709 12:26:23.046028 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
I20260709 12:26:23.047866 12627 raft_consensus.cc:1275] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
W20260709 12:26:23.047957 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.053922 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:23.054366 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:23.054864 12674 leader_election.cc:336] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:23.055518 12674 leader_election.cc:336] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:23.069794 18608 consensus_queue.cc:1048] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:26:23.105136 12454 catalog_manager.cc:5697] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 15 to 16, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 16 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:23.106408 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.136171 13229 raft_consensus.cc:1275] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:23.140300 18571 consensus_queue.cc:1048] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:23.150218 12600 consensus_peers.cc:597] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:23.298537 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.329371 12699 raft_consensus.cc:1275] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:23.335156 18577 consensus_queue.cc:1048] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:23.335687 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 158651us
I20260709 12:26:23.338788 12708 raft_consensus.cc:1275] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:23.340759 12625 raft_consensus.cc:1275] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260709 12:26:23.344461 12600 consensus_peers.cc:597] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.344616 12627 raft_consensus.cc:1275] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:23.352806 18453 consensus_queue.cc:1048] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:23.362138 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:23.362651 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.363785 18631 consensus_queue.cc:1048] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:23.375211 18608 consensus_queue.cc:1048] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:23.636888 12671 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 97502.8us
W20260709 12:26:23.662385 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.734815 12631 raft_consensus.cc:1275] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:26:23.745609 12600 consensus_peers.cc:597] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:23.782224 18574 consensus_queue.cc:1048] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:23.786425 12699 raft_consensus.cc:1275] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Refusing update from remote peer a2a8d71f644447218c1afc3e5f7716cd: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:23.799734 18571 consensus_queue.cc:1048] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:26:23.896397 12598 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 61014us
I20260709 12:26:24.344728 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
W20260709 12:26:24.365235 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.404884 18594 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.405481 18594 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:24.408525 18594 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:24.413622 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.415545 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:24.416317 13229 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 20.
W20260709 12:26:24.416939 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.420152 18582 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:24.420332 12600 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:24.420746 18582 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:24.423627 18582 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:24.425241 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:24.425863 12700 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 20.
W20260709 12:26:24.427574 12671 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:26:24.431229 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.428581 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:24.434967 13229 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 20.
W20260709 12:26:24.435657 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.442057 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.445256 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.448539 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.450676 12674 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:24.451130 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:24.451839 18582 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:24.453573 12598 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:24.455006 18631 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:24.455358 18631 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.455677 18631 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.464598 18631 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 21 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:24.473052 12600 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:24.499501 12703 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:24.500972 12703 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.511391 18631 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 21 election: Requested vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:24.512205 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "a2a8d71f644447218c1afc3e5f7716cd" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:24.512717 13229 raft_consensus.cc:3060] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:24.521714 12703 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 21.
W20260709 12:26:24.531558 12600 consensus_peers.cc:597] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.532199 12671 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.537262 13229 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a2a8d71f644447218c1afc3e5f7716cd in term 21.
I20260709 12:26:24.538889 12597 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68
I20260709 12:26:24.540218 18631 raft_consensus.cc:2804] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:24.540835 18631 raft_consensus.cc:697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 21 LEADER]: Becoming Leader. State: Replica: a2a8d71f644447218c1afc3e5f7716cd, State: Running, Role: LEADER
I20260709 12:26:24.541998 18631 consensus_queue.cc:237] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:24.551007 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.551628 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.562666 12671 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.563314 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.578722 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.579365 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.596084 12671 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 413 similar messages]
W20260709 12:26:24.602552 12600 consensus_peers.cc:597] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.602952 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.633988 12454 catalog_manager.cc:5697] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd reported cstate change: term changed from 19 to 21, leader changed from 23740bafdb794232879a0bb6884f7a68 (127.11.32.1) to a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2). New cstate: current_term: 21 leader_uuid: "a2a8d71f644447218c1afc3e5f7716cd" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:24.653117 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.668939 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.688753 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.692096 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.693377 12671 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.694128 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.715719 12600 consensus_peers.cc:597] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.728137 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.729035 12600 consensus_peers.cc:597] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.730800 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.799827 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.814656 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:24.816270 11392 tablet_replica.cc:333] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.817344 11392 raft_consensus.cc:2243] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:24.818504 11392 raft_consensus.cc:2272] T f8bd8b4df5594ab89b5028f708332757 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.821285 11392 tablet_replica.cc:333] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.822234 11392 raft_consensus.cc:2243] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:24.822359 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.822991 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:24.823150 11392 raft_consensus.cc:2272] T f768a2094f5744cfa0dec019647ccb13 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:24.830164 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:24.832281 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:24.831319 11392 tablet_replica.cc:333] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.842319 11392 raft_consensus.cc:2243] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.843227 11392 raft_consensus.cc:2272] T c12120af627b4866b9f483d6cd9f30f5 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.850281 11392 tablet_replica.cc:333] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.851533 11392 raft_consensus.cc:2243] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.852252 11392 raft_consensus.cc:2272] T 74acfff7189b45af8e177ff563645d9d P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.855029 11392 tablet_replica.cc:333] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.855867 11392 raft_consensus.cc:2243] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.856544 11392 raft_consensus.cc:2272] T 8acfb123196f471d9fa81328e89997cc P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:24.876593 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:24.876916 12600 consensus_peers.cc:597] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.877147 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:24.880731 11392 tablet_replica.cc:333] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.881778 11392 raft_consensus.cc:2243] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:24.883044 11392 raft_consensus.cc:2272] T 23f3709af552426ebb55ecf39265cc47 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.886063 11392 tablet_replica.cc:333] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.895328 11392 raft_consensus.cc:2243] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:24.896556 11392 raft_consensus.cc:2272] T 20e379fdd40947f39c461038e088ea1a P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.907456 11392 tablet_replica.cc:333] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.908432 11392 raft_consensus.cc:2243] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.909361 11392 raft_consensus.cc:2272] T d472a3f71a5d430fafa4a535ed826f18 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.912358 11392 tablet_replica.cc:333] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.913120 11392 raft_consensus.cc:2243] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.913810 11392 raft_consensus.cc:2272] T d9812250f15d4075a3c8831ca5f3ed41 P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:24.928452 12441 catalog_manager.cc:4755] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:26:24.934846 11392 tablet_replica.cc:333] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
W20260709 12:26:24.935468 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:24.935815 11392 raft_consensus.cc:2243] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.936582 11392 raft_consensus.cc:2272] T bc86699922844edbae89cb65c328e3ce P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:24.937258 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:24.939567 11392 tablet_replica.cc:333] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.940469 11392 raft_consensus.cc:2243] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.941354 11392 raft_consensus.cc:2272] T c6a602467dda4cb0bbfb59098cf973c9 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.944377 11392 tablet_replica.cc:333] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.945251 11392 raft_consensus.cc:2243] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.959169 11392 raft_consensus.cc:2272] T d5554b3483384c14898b46be0dbd5ae5 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.971938 11392 tablet_replica.cc:333] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.972886 11392 raft_consensus.cc:2243] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:24.974197 11392 raft_consensus.cc:2272] T ef8bfbfb91b54571bed5f5d44534395a P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.976963 11392 tablet_replica.cc:333] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.978063 11392 raft_consensus.cc:2243] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.978893 11392 raft_consensus.cc:2272] T 08834ef951b049b39c60e46c2ed865e9 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:24.982307 12600 consensus_peers.cc:597] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:24.983506 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:24.990271 11392 tablet_replica.cc:333] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.991294 11392 raft_consensus.cc:2243] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:24.992493 11392 raft_consensus.cc:2272] T 902b0c6b28a040c9902fea6547ffaa9f P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:24.995393 11392 tablet_replica.cc:333] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:24.996199 11392 raft_consensus.cc:2243] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:24.996893 11392 raft_consensus.cc:2272] T c8dc26a51db24f54ad0e0272c06d9306 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.011574 11392 tablet_replica.cc:333] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.012418 11392 raft_consensus.cc:2243] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.013079 11392 raft_consensus.cc:2272] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.015816 11392 tablet_replica.cc:333] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.016588 11392 raft_consensus.cc:2243] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.025796 11392 raft_consensus.cc:2272] T 33554b5715244a96b9faa863336bdc3b P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.029052 11392 tablet_replica.cc:333] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.029841 11392 raft_consensus.cc:2243] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.031406 11392 pending_rounds.cc:70] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Trying to abort 1 pending ops.
I20260709 12:26:25.031683 11392 pending_rounds.cc:77] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd: Aborting op as it isn't in flight: id { term: 21 index: 14 } timestamp: 7305625536702820352 op_type: NO_OP noop_request { }
I20260709 12:26:25.032069 11392 raft_consensus.cc:2889] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 21 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:26:25.032413 11392 raft_consensus.cc:2272] T a10e3ca41dda44bc9e0c04ad3cc65f57 P a2a8d71f644447218c1afc3e5f7716cd [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.058980 11392 tablet_replica.cc:333] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
W20260709 12:26:25.067585 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:25.068261 11392 raft_consensus.cc:2243] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.069624 11392 raft_consensus.cc:2272] T 140159e481364d9e99f0f034c42b7fda P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.075838 11392 tablet_replica.cc:333] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.081511 11392 raft_consensus.cc:2243] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.082201 11392 raft_consensus.cc:2272] T af0709be9e0d4bf39ce083c7af243837 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:25.084435 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:25.085292 11392 tablet_replica.cc:333] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.086249 11392 raft_consensus.cc:2243] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.089488 11392 raft_consensus.cc:2272] T 04a769018c454aa685eae73d74c89abb P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.100060 11392 tablet_replica.cc:333] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.101040 11392 raft_consensus.cc:2243] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.102306 11392 raft_consensus.cc:2272] T d457e0ba678747fba0ac2a4c1b42649e P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.107134 11392 tablet_replica.cc:333] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.107827 11392 raft_consensus.cc:2243] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:25.108250 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:25.108476 11392 raft_consensus.cc:2272] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P a2a8d71f644447218c1afc3e5f7716cd [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.112347 11392 tablet_replica.cc:333] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.113286 11392 raft_consensus.cc:2243] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.114441 11392 raft_consensus.cc:2272] T 5548d773e7254d74bd88a9092bf7567d P a2a8d71f644447218c1afc3e5f7716cd [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.116932 11392 tablet_replica.cc:333] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.118271 11392 raft_consensus.cc:2243] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.119335 11392 raft_consensus.cc:2272] T 0116b2408a7241828256061551a36f1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.121934 11392 tablet_replica.cc:333] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.122705 11392 raft_consensus.cc:2243] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.123335 11392 raft_consensus.cc:2272] T 1a59b6927edd4e21a78fe14b7acdad1c P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:25.116870 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:25.138180 11392 tablet_replica.cc:333] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.139104 11392 raft_consensus.cc:2243] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.140367 11392 raft_consensus.cc:2272] T 47430c4494f1431f8fb577cd8838f972 P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.143239 11392 tablet_replica.cc:333] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.144079 11392 raft_consensus.cc:2243] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.145287 11392 raft_consensus.cc:2272] T 85949dbea3b742fea0cb31dfc53d5766 P a2a8d71f644447218c1afc3e5f7716cd [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.147962 11392 tablet_replica.cc:333] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.148754 11392 raft_consensus.cc:2243] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.161267 11392 raft_consensus.cc:2272] T 7d75a6f40c324994a517c98816b2afc4 P a2a8d71f644447218c1afc3e5f7716cd [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.164268 11392 tablet_replica.cc:333] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.165117 11392 raft_consensus.cc:2243] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.165941 11392 raft_consensus.cc:2272] T 7f25843830014b4c8c5707696cddc7f0 P a2a8d71f644447218c1afc3e5f7716cd [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.168756 11392 tablet_replica.cc:333] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.169553 11392 raft_consensus.cc:2243] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.170207 11392 raft_consensus.cc:2272] T cd26860ea4e84bd7851de4aaa5d02f01 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:25.179193 12600 consensus_peers.cc:597] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:25.184620 11392 tablet_replica.cc:333] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.185542 11392 raft_consensus.cc:2243] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.186221 11392 raft_consensus.cc:2272] T 2ca7fa9a22ba4b0b8300a42169fced1c P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.188887 11392 tablet_replica.cc:333] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.189702 11392 raft_consensus.cc:2243] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:26:25.190443 12598 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.190721 11392 raft_consensus.cc:2272] T 94aed3506ab5437b8943521ce387d9e4 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:25.194751 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:25.201563 11392 tablet_replica.cc:333] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.202473 11392 raft_consensus.cc:2243] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.203457 11392 raft_consensus.cc:2272] T e25848d0a4024deda42b246d049b5be0 P a2a8d71f644447218c1afc3e5f7716cd [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.211082 11392 tablet_replica.cc:333] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.211819 11392 raft_consensus.cc:2243] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.212400 11392 raft_consensus.cc:2272] T 0afb49cf962a46388bf387ad7b344c39 P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.223083 11392 tablet_replica.cc:333] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.223836 11392 raft_consensus.cc:2243] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.224498 11392 raft_consensus.cc:2272] T c5facffc88a94bc58f10135f6686804c P a2a8d71f644447218c1afc3e5f7716cd [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.227141 11392 tablet_replica.cc:333] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.227849 11392 raft_consensus.cc:2243] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.228994 11392 raft_consensus.cc:2272] T e072821343d84e57b593eb6bc58c585a P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.231997 11392 tablet_replica.cc:333] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.232751 11392 raft_consensus.cc:2243] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 9 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.242049 11392 raft_consensus.cc:2272] T 613ed3057bf74d02a48d823635fd0b6a P a2a8d71f644447218c1afc3e5f7716cd [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.244896 11392 tablet_replica.cc:333] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.245678 11392 raft_consensus.cc:2243] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.264274 11392 raft_consensus.cc:2272] T 3f9ecf42cca34c34954029c3568e54b2 P a2a8d71f644447218c1afc3e5f7716cd [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.270941 11392 tablet_replica.cc:333] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.271804 11392 raft_consensus.cc:2243] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:25.273059 11392 raft_consensus.cc:2272] T 2514eba211b3456c96ca755c4c7c084b P a2a8d71f644447218c1afc3e5f7716cd [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.275782 11392 tablet_replica.cc:333] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.286041 11392 raft_consensus.cc:2243] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.287534 11392 raft_consensus.cc:2272] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P a2a8d71f644447218c1afc3e5f7716cd [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:25.296234 11392 tablet_replica.cc:333] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd: stopping tablet replica
I20260709 12:26:25.297027 11392 raft_consensus.cc:2243] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:25.297674 11392 raft_consensus.cc:2272] T 9e5ce7f361ff45268f58f04272a4a5ef P a2a8d71f644447218c1afc3e5f7716cd [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:25.326212 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.326669 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.334261 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.355264 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.372057 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.385950 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.390246 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.439222 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.468278 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.494910 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.560209 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:25.681456 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.688560 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:25.940784 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:26.071080 18582 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.071662 18582 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:26.072988 18655 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.073565 18655 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.075735 18655 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:26.076992 18582 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:26.079438 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:26.079695 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:26.084141 12671 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.085772 18582 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.086501 18582 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.092533 18582 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.093914 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
W20260709 12:26:26.106901 12671 leader_election.cc:336] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:26.108455 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.110682 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:26.111807 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:26.110092 12671 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 155b5b0a0b6d4b499edfe2797ffa5b91, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.111821 18659 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.119673 18582 raft_consensus.cc:2749] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.123528 18669 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:26.122677 13198 leader_election.cc:336] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.124517 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:26.125526 18669 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.128006 18669 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:26.134929 18655 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.136121 18655 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:26.140357 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.142418 18659 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:26.143466 13198 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.143165 18659 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:26.143913 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.142514 18673 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:26.144623 18669 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.146116 18659 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:26.149451 18655 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:26.150430 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:26.151469 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.151690 18674 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:26.154911 13198 leader_election.cc:336] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.159355 13199 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:26.162225 18655 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:26.158434 18674 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.172260 18674 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.176841 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:26.180421 13198 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.180950 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.182003 18674 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:26.176987 12671 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.182878 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.184227 18659 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.236243 18659 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.236838 18659 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:26.239212 18659 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.244179 12674 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:26.246958 12671 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.248229 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.249423 18659 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:26.270251 18674 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.270922 18674 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.275314 18674 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:26.278870 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:26.281081 13198 leader_election.cc:336] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.281702 13198 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:26.282616 18655 raft_consensus.cc:2749] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:26.293130 18655 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.293674 18655 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.295765 18655 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.301594 13201 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:26.302058 13198 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.302481 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.303567 18655 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.328205 18574 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.328781 18574 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.330996 18574 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.332331 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:26.332968 13229 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:26:26.334877 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
W20260709 12:26:26.337813 12671 leader_election.cc:336] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.338678 18574 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:26.339077 18574 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.339406 18574 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.357903 18669 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.358554 18669 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.358587 18574 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.360661 18574 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.360797 18669 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:26.363692 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:26.369280 13198 leader_election.cc:336] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.369753 13198 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:26.370925 18674 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:26.372731 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33554b5715244a96b9faa863336bdc3b" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:26.373339 13229 raft_consensus.cc:3060] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.380825 13229 raft_consensus.cc:2468] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:26.382169 12671 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:26.382899 18659 raft_consensus.cc:2804] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:26.383564 18659 raft_consensus.cc:697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:26.385706 18659 consensus_queue.cc:237] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:26.389314 12671 leader_election.cc:336] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.423949 18669 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.424479 18669 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.426573 18669 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.431874 13201 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.434780 12453 catalog_manager.cc:5697] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 10 to 11, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:26.438138 13198 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.442312 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.443827 18674 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:26.423619 18574 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.446722 18574 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.450538 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:26.449091 18574 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.451181 13229 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 10.
I20260709 12:26:26.453117 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:26.453378 18669 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.454196 18659 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:26.454592 18659 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.454962 18659 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.456609 18675 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.457132 18675 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:26.462497 18675 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.464030 12674 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:26.465015 12671 leader_election.cc:336] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.466125 18674 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.453898 18669 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.466665 18674 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.469103 18669 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.470394 12671 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.471194 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
W20260709 12:26:26.471909 11392 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:26.477080 13198 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.480623 12700 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 21.
W20260709 12:26:26.480731 13198 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.480377 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.484946 18582 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:26.488795 18675 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:26.489264 13201 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.489378 18675 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.491479 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.477461 18674 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:26.496356 12671 leader_election.cc:336] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.497761 18675 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.499074 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:26.498904 18659 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.499825 13229 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:26.505609 18655 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:26.506743 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.507997 18659 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
W20260709 12:26:26.506904 13201 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.508724 18659 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:26.508672 13201 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.509275 18659 raft_consensus.cc:493] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.509850 18669 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:26.511924 18659 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.520391 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "902b0c6b28a040c9902fea6547ffaa9f" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:26.521004 13229 raft_consensus.cc:3060] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.522594 18659 raft_consensus.cc:515] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.524969 18659 leader_election.cc:290] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.539913 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5548d773e7254d74bd88a9092bf7567d" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:26.540539 13231 raft_consensus.cc:3060] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.543502 13229 raft_consensus.cc:2468] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 11.
I20260709 12:26:26.546741 18675 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:26.547097 12671 leader_election.cc:336] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.547379 18675 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.550787 18675 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.552029 12671 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.553714 18675 raft_consensus.cc:2804] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:26.554517 18675 raft_consensus.cc:697] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:26.554571 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:26.555269 13229 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 17.
I20260709 12:26:26.555656 18675 consensus_queue.cc:237] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:26.556852 12671 leader_election.cc:336] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.558944 13231 raft_consensus.cc:2468] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 12.
I20260709 12:26:26.559696 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:26.562280 18659 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:26.562686 18659 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:26.562788 12671 leader_election.cc:336] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.563097 18659 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.564155 12671 leader_election.cc:304] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.565042 18574 raft_consensus.cc:2804] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:26.565587 18574 raft_consensus.cc:697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:26.566444 18574 consensus_queue.cc:237] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.571868 18659 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.579468 18659 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:26.582773 18669 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.582830 13231 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e072821343d84e57b593eb6bc58c585a" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91"
I20260709 12:26:26.583640 13231 raft_consensus.cc:3060] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.583499 18669 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.588198 18669 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:26.597296 18675 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.597965 18675 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:26.591634 13201 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.591634 13231 raft_consensus.cc:2468] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 18.
W20260709 12:26:26.605320 13198 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.606452 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.609694 18674 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:26.606976 18669 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.610767 18669 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.614179 18669 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:26.607676 12453 catalog_manager.cc:5697] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 10 to 11, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 11 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:26.618779 13201 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:26.607515 12671 leader_election.cc:336] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.620491 12671 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.622458 18574 raft_consensus.cc:2804] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:26.621445 13198 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.622938 18574 raft_consensus.cc:697] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Becoming Leader. State: Replica: c6795b140b3247279a2231c6b9360d24, State: Running, Role: LEADER
I20260709 12:26:26.623049 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.623833 18655 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.623858 18574 consensus_queue.cc:237] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:26.632681 12674 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:26.633392 18675 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:26.650120 12671 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.650591 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.651281 18574 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:26.650911 12453 catalog_manager.cc:5697] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 11 to 12, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 12 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.652731 12453 catalog_manager.cc:5697] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 reported cstate change: term changed from 17 to 18, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to c6795b140b3247279a2231c6b9360d24 (127.11.32.3). New cstate: current_term: 18 leader_uuid: "c6795b140b3247279a2231c6b9360d24" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.667550 18669 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.668125 18669 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.670408 18669 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:26.673774 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:26.674443 12700 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 15.
I20260709 12:26:26.675601 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 
I20260709 12:26:26.676337 18655 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:26.676744 18655 raft_consensus.cc:493] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting leader election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.677088 18655 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:26.680084 13198 leader_election.cc:336] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.687896 18675 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:26.688443 18675 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:26.690518 18675 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:26.685060 18655 raft_consensus.cc:515] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.694828 18655 leader_election.cc:290] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Requested vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:26.695009 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "94aed3506ab5437b8943521ce387d9e4" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24"
I20260709 12:26:26.695652 12700 raft_consensus.cc:3060] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:26.697690 12674 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:26.698168 13198 leader_election.cc:336] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.704738 12700 raft_consensus.cc:2468] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 16.
I20260709 12:26:26.705940 13199 leader_election.cc:304] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:26.706609 12671 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:26.706705 18655 raft_consensus.cc:2804] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:26.707090 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:26.707599 18655 raft_consensus.cc:697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Becoming Leader. State: Replica: 155b5b0a0b6d4b499edfe2797ffa5b91, State: Running, Role: LEADER
I20260709 12:26:26.707820 18675 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:26.708613 18655 consensus_queue.cc:237] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:26.738626 12453 catalog_manager.cc:5697] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 reported cstate change: term changed from 15 to 16, leader changed from a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2) to 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4). New cstate: current_term: 16 leader_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:26.835871 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:26.895304 13231 raft_consensus.cc:1275] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:26:26.897444 18574 consensus_queue.cc:1048] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:26.901787 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:26.908665 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:26.934827 12671 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:26.971915 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:26.981043 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.023085 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.025458 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.027774 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.031842 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.062879 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.063557 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.071274 12671 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.074738 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:27.100203 13232 raft_consensus.cc:1275] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:27.112986 18659 consensus_queue.cc:1048] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:27.122831 13198 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.123332 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.138317 12671 consensus_peers.cc:597] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.143968 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.144773 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.149627 12671 consensus_peers.cc:597] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:27.158394 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.162209 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:27.165266 13232 raft_consensus.cc:1275] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:27.168934 13232 raft_consensus.cc:1275] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Refusing update from remote peer c6795b140b3247279a2231c6b9360d24: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:27.170521 18659 consensus_queue.cc:1048] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:27.172640 18659 consensus_queue.cc:1048] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [LEADER]: Connected to new peer: Peer: permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:27.184705 12671 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.202701 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.210619 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.217175 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.220955 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:27.224066 12703 raft_consensus.cc:1275] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Refusing update from remote peer 155b5b0a0b6d4b499edfe2797ffa5b91: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:27.226192 18655 consensus_queue.cc:1048] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:27.264834 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.275441 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.276082 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.302637 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.327039 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.338658 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.387652 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.428344 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.434302 12671 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.469745 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.480597 11392 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:27.501039 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.526290 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.588143 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.594893 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:27.701333 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:27.714433 18669 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:27.715211 18669 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:27.728572 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.736748 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:27.739917 18669 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:27.744603 13198 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:27.745162 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:27.746376 18669 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:27.741482 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.749598 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:27.756529 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.799546 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.828325 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.844491 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:27.889014 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:28.051702 18582 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.052232 18582 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:28.054306 18582 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:28.059548 18582 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.060014 18582 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:28.062224 18582 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.062983 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:28.067302 12671 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.068423 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:28.069286 18582 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:28.076689 12671 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:28.077670 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:28.078188 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:28.078979 18582 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:28.108106 18582 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:28.108739 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:28.108594 18582 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:28.110828 18582 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.120820 12671 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:28.124482 12674 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:28.125032 12674 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:28.125777 18659 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:28.132373 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:28.159729 18582 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.160255 18582 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:28.162652 18582 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.171837 12671 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:28.175583 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:28.180490 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:28.183686 12674 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:28.184180 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:28.184991 18582 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:28.215101 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:28.218087 18669 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.219592 18669 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:28.222239 18669 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.227412 13198 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.290743 18669 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.291325 18669 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:28.303331 13198 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.304050 18669 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:28.338620 18669 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.339223 18669 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:28.341672 18669 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.347993 13198 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.372658 18669 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.373252 18669 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:28.396593 13198 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.402112 18669 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.452328 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:28.474691 18669 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.475430 18669 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:28.481175 11392 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:28.504069 18669 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:28.505661 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:28.517496 12700 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 21.
W20260709 12:26:28.524302 13198 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.561923 18693 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.562472 18693 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:28.564671 18693 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.584707 12674 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:28.587203 12671 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.592067 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:28.595538 18693 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:28.603870 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:28.616595 18693 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.617271 18693 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:28.636488 12674 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:28.662158 12671 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.644311 18693 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:28.674198 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:28.675072 18693 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:28.690303 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:28.698770 18669 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.699333 18669 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:28.706388 13198 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:28.701242 18669 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:28.748562 18669 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:28.750348 18669 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:28.758597 18669 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:28.769807 13198 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:29.099152 12441 catalog_manager.cc:4755] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:29.154925 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.155682 13201 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.156178 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:29.156991 18692 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:29.158579 13201 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.159442 13201 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:29.166388 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:29.178056 18669 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:29.184057 13201 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.184847 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:29.186527 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.187551 13201 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:29.187067 18696 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:29.188817 18692 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:29.189932 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.190475 13201 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.193542 13201 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:29.194700 13201 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.195139 18696 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:29.196074 13201 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:29.198216 18696 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:29.199102 13201 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:29.199527 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:29.204955 18696 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:29.346796 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.391633 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.427523 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.437695 12671 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:29.481694 11392 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:29.493342 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.517009 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.518102 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.526460 12671 consensus_peers.cc:597] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:29.585929 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.587622 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.594890 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.604681 13201 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111) [suppressed 638 similar messages]
W20260709 12:26:29.696982 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.741596 12671 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.747116 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:29.755591 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.765862 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.771778 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.771778 13198 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:29.798099 12671 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.829717 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.847747 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:29.885154 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.886237 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:29.915319 18693 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:29.915932 18693 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:29.923215 12671 consensus_peers.cc:597] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:26:29.924486 18693 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:29.926445 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:29.928231 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:29.929057 12674 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:29.936211 12671 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:29.936697 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:29.938468 18693 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:29.958148 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:26:29.987162 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:29.995893 12671 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:30.014716 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:30.018253 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.022243 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:26:30.025604 18582 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:30.026189 18582 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:30.044034 12674 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:30.046295 18582 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:30.048980 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.050432 12671 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:30.050985 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:30.051771 18693 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:30.083089 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.083834 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:30.154757 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.202749 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.205845 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.263098 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.274899 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:30.287349 18669 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:30.288062 18669 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:30.290267 18669 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:30.298069 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:30.301093 13198 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:30.301517 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:30.302217 18669 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:30.302675 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.341611 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.392614 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.410521 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:30.478626 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.479272 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:30.482215 11392 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:30.743263 18698 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:30.743935 18698 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:30.746201 18698 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:31.010200 18699 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.011041 18699 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:31.016944 18699 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.040621 13198 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:34669, user_credentials={real_user=slave}} blocked reactor thread for 47479.6us
W20260709 12:26:31.058661 12674 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 54093.9us
W20260709 12:26:31.066465 12671 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:31.091708 12671 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:31.114830 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.115674 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.116413 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:31.116858 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.119935 18693 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:31.123378 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.126340 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:31.126915 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:31.124131 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.127552 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:31.128185 12674 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:31.128633 12674 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.129387 18697 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:31.129885 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:31.155715 18697 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.156258 18697 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:31.158334 18697 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.165056 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:31.173935 12671 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.174523 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.175330 18697 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:31.271322 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:31.307911 18709 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.308527 18709 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:31.312024 18709 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.317291 13201 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:31.318164 18709 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.318835 18709 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:31.320462 13198 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.320973 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.321754 18714 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:31.322181 18709 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.327353 13201 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:31.328032 13198 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.328519 13198 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.329639 18709 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:31.378901 18709 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.386335 18709 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:31.393934 13201 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:31.396147 18709 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.448885 13198 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.449754 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.451054 18709 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:31.482722 11392 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:31.491644 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:31.507179 12488 debug-util.cc:398] Leaking SignalData structure 0x7b0800316f80 after lost signal to thread 11395
W20260709 12:26:31.508337 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080031b0c0 after lost signal to thread 12491
W20260709 12:26:31.509645 12488 debug-util.cc:398] Leaking SignalData structure 0x7b08002c5480 after lost signal to thread 12732
W20260709 12:26:31.510789 12488 debug-util.cc:398] Leaking SignalData structure 0x7b080038c1c0 after lost signal to thread 13259
W20260709 12:26:31.616456 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:31.670581 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:31.863462 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:31.881783 18709 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.882412 18709 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:31.884701 18709 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.896389 13201 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:31.897305 13198 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.897784 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.899574 18706 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:31.902168 18698 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:31.902750 18698 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:31.905256 18698 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:31.911971 12674 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:31.916460 12671 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.917073 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.917958 18698 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:31.921452 18709 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.922060 18709 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:31.929893 12700 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "c6795b140b3247279a2231c6b9360d24" is_pre_election: true
I20260709 12:26:31.930558 12700 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 155b5b0a0b6d4b499edfe2797ffa5b91 in term 21.
W20260709 12:26:31.938766 13201 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:31.940997 13198 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:31.941425 13198 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:31.942286 18706 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:31.943778 18709 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:31.981737 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.003333 12671 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.016844 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.069438 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.193013 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:32.202224 18718 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:32.202971 18718 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:32.211643 18718 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:32.212213 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:32.262902 13198 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:32.267505 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:32.271476 18706 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:32.280289 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.295867 12671 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.317929 12671 consensus_peers.cc:597] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.325662 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.384442 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.398443 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.419330 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:32.429981 18706 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:32.430608 18706 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:32.432858 18706 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:32.458060 13198 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:32.461603 13201 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:32.462054 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:32.464159 18709 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:32.466544 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.473093 12671 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:26:32.478238 18698 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:32.478773 18698 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:32.481009 18698 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:32.483225 11392 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:32.489120 12674 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:32.501098 12671 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:32.501734 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:32.503124 18698 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:32.518766 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.520077 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.542366 13198 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.557261 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:32.564250 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.576206 12671 consensus_peers.cc:597] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:26:32.586576 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.590574 12671 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.608444 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.610649 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.609762 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.611354 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.650151 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:32.655774 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.666821 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.668394 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.671474 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.707782 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:32.739333 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:32.933449 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.008898 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:33.050879 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.054487 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.069480 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.092993 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.099282 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.114252 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:33.135329 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.143920 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.188843 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.235471 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:33.237571 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:33.269472 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.310760 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:33.316963 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.357307 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:33.483639 11392 thread.cc:527] Waited for 8000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:33.485069 18697 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:33.485630 18697 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:33.489421 18697 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:33.502460 12671 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:33.507980 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:33.508543 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:33.509485 18697 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:33.601997 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.618724 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.661700 13199 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43633, user_credentials={real_user=slave}} blocked reactor thread for 47297.8us
W20260709 12:26:33.726186 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.734642 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:33.785264 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:33.805262 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.074725 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.143102 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:34.159017 18721 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:34.160161 18721 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:34.187485 12674 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:34.204022 18722 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:34.204824 18722 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:34.207129 18722 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:34.217245 13198 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:34.220275 12671 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:34.232340 12671 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:34.233954 18725 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:34.236613 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:34.227556 18721 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:34.239923 13201 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:34.248687 13201 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:34.265304 12671 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:34.281956 13201 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:45107, user_credentials={real_user=slave}} blocked reactor thread for 54586.5us
I20260709 12:26:34.281971 18723 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:34.295171 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:34.357633 18721 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:34.358328 18721 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:34.360540 18721 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:34.370299 12674 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:34.371198 12671 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:34.371628 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:34.373009 18721 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:34.440546 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.461808 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.484699 11392 thread.cc:527] Waited for 9000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:34.529704 18726 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:34.530493 18726 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:34.534516 18726 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:34.539501 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:34.541224 13198 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:34.541659 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:34.542955 18726 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:34.609714 13198 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111) [suppressed 600 similar messages]
W20260709 12:26:34.710601 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.719416 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.807960 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.832528 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:34.865461 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.884186 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:34.912241 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:34.924140 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:34.939390 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:34.958276 18723 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:34.959045 18723 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:34.961374 18723 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:34.964680 13198 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:34.967715 13201 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:34.969945 13198 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:34.970464 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:34.970831 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:34.971743 18723 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:34.996205 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.024619 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.044298 12671 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.057487 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:35.073777 12671 consensus_peers.cc:597] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:35.076861 12671 consensus_peers.cc:597] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:26:35.102623 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:35.126192 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.161649 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.164144 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.192487 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.197755 12671 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.217074 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:35.233158 18723 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:35.235072 18723 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:35.237859 18723 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:35.242837 18709 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:35.272255 18709 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:35.274619 18709 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:35.245779 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:35.268363 18729 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:35.281075 18729 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:35.283905 18729 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:35.294363 13198 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:35.295584 13198 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:35.296914 18709 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:35.309612 13201 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:35.358646 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:35.360566 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.368964 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:35.372762 13198 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:35.380180 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:35.382085 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:35.382580 18723 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:35.405750 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.416540 12671 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:35.425390 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:35.424822 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:35.428869 18729 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:35.439901 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.458788 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.476215 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.485220 11392 thread.cc:527] Waited for 10000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:35.505026 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.517705 12671 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.557643 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.602824 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.605297 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.623189 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.654366 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.673575 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.710882 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.723366 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:35.854847 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:35.887717 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:35.924813 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:35.955163 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:36.001451 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:36.021149 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:26:36.056161 18709 raft_consensus.cc:493] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:36.058386 18709 raft_consensus.cc:515] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:36.068266 18709 leader_election.cc:290] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:36.078950 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:36.079528 13198 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:36.128300 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:36.101783 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:36.133665 13201 leader_election.cc:336] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:36.135501 13201 leader_election.cc:304] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:36.137818 18709 raft_consensus.cc:2749] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:26:36.206346 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:36.311159 18727 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:36.311932 18727 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:36.319450 12671 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:36.320191 18727 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:36.338680 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:36.339461 12674 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:36.340310 18727 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:36.341737 18727 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.342332 18727 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:36.369366 12671 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:36.371080 18727 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:36.374058 13229 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:36.379189 13229 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 21.
W20260709 12:26:36.385880 12674 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:36.405026 12674 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:36.409793 18727 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:36.440927 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:36.485749 11392 thread.cc:527] Waited for 11000ms trying to join with diag-logger (tid 12655)
W20260709 12:26:36.544510 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:36.678900 18730 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:36.679863 18730 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:36.682037 18730 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:36.710480 12674 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:36.724527 12671 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:36.734122 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:36.735210 18730 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:36.752478 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:36.944860 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:36.964116 12671 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:36.964745 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:36.965214 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.049288 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.104429 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:37.137372 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.157826 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:37.252123 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.306139 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.326619 12441 catalog_manager.cc:4755] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:37.389294 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.402030 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.433817 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.458364 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:37.463361 18709 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:37.465111 18709 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:37.470633 18709 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:37.476014 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.483129 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:37.483733 13201 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:37.484537 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.485076 13198 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:37.485549 13198 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
W20260709 12:26:37.486202 11392 thread.cc:527] Waited for 12000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:37.486990 18723 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:37.496682 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:37.498664 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.520381 13198 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:37.600405 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:37.644616 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:37.659140 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.671284 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:37.704656 18723 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:37.705109 18723 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:37.706796 18723 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:37.711858 13198 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:37.714958 13201 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:37.715382 13201 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:37.716081 18723 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:37.801059 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.811830 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:37.817143 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:37.874608 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:37.888026 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:37.890997 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.124459 12674 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.156908 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.179373 12674 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:38.219259 12674 consensus_peers.cc:597] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.222270 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.234026 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:38.259608 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.269465 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.271718 12674 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.273602 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.278393 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.283294 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:38.378643 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.400646 12674 consensus_peers.cc:597] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.477397 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.486637 11392 thread.cc:527] Waited for 13000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:38.496081 18738 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:38.496608 18738 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:38.498726 18738 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:38.502588 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:38.512550 12671 consensus_peers.cc:597] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.516269 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.516985 12671 consensus_peers.cc:597] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:38.519006 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.519847 12671 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.520283 12671 consensus_peers.cc:597] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:26:38.520697 12671 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.521025 12671 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:38.521328 12671 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:38.522002 18738 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:38.581230 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:38.584448 18738 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:38.585018 18738 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:38.587136 18738 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:38.592242 12674 consensus_peers.cc:597] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.592721 12671 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:38.593200 12674 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:38.593628 12674 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:38.594218 18738 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:38.744395 12671 consensus_peers.cc:597] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:38.752816 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.844336 12674 consensus_peers.cc:597] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:38.927531 12674 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:39.075618 18740 raft_consensus.cc:493] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:39.076153 18740 raft_consensus.cc:515] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:39.080647 18740 leader_election.cc:290] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:39.087999 13201 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:39.096102 13198 leader_election.cc:336] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:39.096661 13198 leader_election.cc:304] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:39.097460 18740 raft_consensus.cc:2749] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:39.289517 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.296617 12674 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.434823 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:39.457180 18734 raft_consensus.cc:493] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:39.457732 18734 raft_consensus.cc:515] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:39.459795 18734 leader_election.cc:290] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:39.465433 12674 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:39.467797 12671 leader_election.cc:336] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:39.468204 12671 leader_election.cc:304] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:39.469111 18734 raft_consensus.cc:2749] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:39.487149 11392 thread.cc:527] Waited for 14000ms trying to join with diag-logger (tid 12655)
I20260709 12:26:39.500174 18734 raft_consensus.cc:493] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
W20260709 12:26:39.500511 12674 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:39.500926 18734 raft_consensus.cc:515] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:39.503000 18734 leader_election.cc:290] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:39.507977 12674 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:39.518771 12671 leader_election.cc:336] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:39.519316 12671 leader_election.cc:304] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:39.520071 18734 raft_consensus.cc:2749] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:39.616055 13198 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111) [suppressed 615 similar messages]
W20260709 12:26:39.648136 12674 consensus_peers.cc:597] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:39.696913 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.793344 13198 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.867475 12671 consensus_peers.cc:597] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.905269 12671 consensus_peers.cc:597] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.919451 13198 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:39.925587 13201 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:39.937021 18734 raft_consensus.cc:493] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:39.937671 18734 raft_consensus.cc:515] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:39.939893 18734 leader_election.cc:290] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:39.945152 12674 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:39.947672 12671 leader_election.cc:336] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:39.948117 12671 leader_election.cc:304] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:39.948874 18734 raft_consensus.cc:2749] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:39.967738 12671 consensus_peers.cc:597] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:39.990095 18743 raft_consensus.cc:493] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:39.990710 18743 raft_consensus.cc:515] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:39.992851 18743 leader_election.cc:290] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:39.997246 13201 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:39.998862 13198 leader_election.cc:336] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:39.999281 13198 leader_election.cc:304] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:40.000299 18743 raft_consensus.cc:2749] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:40.004902 12674 consensus_peers.cc:597] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.038161 13201 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:40.044268 18734 raft_consensus.cc:493] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:40.044783 18734 raft_consensus.cc:515] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
W20260709 12:26:40.045115 13198 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:40.048400 18734 leader_election.cc:290] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:40.054136 12671 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:40.057124 12674 leader_election.cc:336] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:40.057896 12674 leader_election.cc:304] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:40.058630 18734 raft_consensus.cc:2749] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:40.063838 12674 consensus_peers.cc:597] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.072470 12671 consensus_peers.cc:597] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:40.075556 13201 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.078202 13198 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:40.122443 18742 raft_consensus.cc:493] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:40.123034 18742 raft_consensus.cc:515] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } attrs { replace: true } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:40.125759 18742 leader_election.cc:290] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), 155b5b0a0b6d4b499edfe2797ffa5b91 (127.11.32.4:37323)
I20260709 12:26:40.129463 13232 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a10e3ca41dda44bc9e0c04ad3cc65f57" candidate_uuid: "c6795b140b3247279a2231c6b9360d24" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" is_pre_election: true
I20260709 12:26:40.130126 13232 raft_consensus.cc:2468] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6795b140b3247279a2231c6b9360d24 in term 21.
W20260709 12:26:40.130641 12674 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:40.135429 12671 leader_election.cc:336] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:40.135833 12671 leader_election.cc:304] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91, c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:40.137594 18734 raft_consensus.cc:2749] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:26:40.143646 12671 consensus_peers.cc:597] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.144899 13198 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.178586 12674 consensus_peers.cc:597] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.186141 13198 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:26:40.224617 13198 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.233597 12674 consensus_peers.cc:597] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.289557 12674 consensus_peers.cc:597] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:40.293125 13198 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.299382 12674 consensus_peers.cc:597] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:40.311112 18742 raft_consensus.cc:493] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:40.311671 18742 raft_consensus.cc:515] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:40.313725 18742 leader_election.cc:290] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:40.319944 12671 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:40.320962 12674 leader_election.cc:336] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:40.321943 12674 leader_election.cc:304] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:40.322621 18742 raft_consensus.cc:2749] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:40.379359 13201 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.379930 12671 consensus_peers.cc:597] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:26:40.395035 18742 raft_consensus.cc:493] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:40.395624 18742 raft_consensus.cc:515] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } }
I20260709 12:26:40.397632 18742 leader_election.cc:290] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:40.403322 12674 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:40.404129 12671 leader_election.cc:336] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:40.404572 12671 leader_election.cc:304] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6795b140b3247279a2231c6b9360d24; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:40.405558 18744 raft_consensus.cc:2749] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:40.407708 12671 consensus_peers.cc:597] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.416260 12671 consensus_peers.cc:597] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:40.460544 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
I20260709 12:26:40.476692 18743 raft_consensus.cc:493] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:40.477321 18743 raft_consensus.cc:515] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
W20260709 12:26:40.489270 13198 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:40.491712 13201 leader_election.cc:336] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:40.492170 13201 leader_election.cc:304] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:40.492853 18743 leader_election.cc:290] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
I20260709 12:26:40.493490 18709 raft_consensus.cc:2749] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:40.511591 12674 consensus_peers.cc:597] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:40.516268 13201 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:40.565960 12671 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.613075 13201 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:40.614890 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
W20260709 12:26:40.648413 13198 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.648715 13201 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:40.676059 13199 consensus_peers.cc:597] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.676848 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:40.679963 11392 tablet_replica.cc:333] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.680927 11392 raft_consensus.cc:2243] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.682225 11392 raft_consensus.cc:2272] T f768a2094f5744cfa0dec019647ccb13 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.685266 11392 tablet_replica.cc:333] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.686151 11392 raft_consensus.cc:2243] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.687366 11392 raft_consensus.cc:2272] T c12120af627b4866b9f483d6cd9f30f5 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.690002 11392 tablet_replica.cc:333] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.690802 11392 raft_consensus.cc:2243] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:26:40.691018 12674 consensus_peers.cc:597] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:40.691848 11392 raft_consensus.cc:2272] T 28c65936613f4ee89e3dc89d06a91776 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.694569 11392 tablet_replica.cc:333] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.695310 11392 raft_consensus.cc:2243] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.696072 11392 raft_consensus.cc:2272] T 74acfff7189b45af8e177ff563645d9d P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.698757 11392 tablet_replica.cc:333] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.699644 11392 raft_consensus.cc:2243] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.700804 11392 raft_consensus.cc:2272] T 8acfb123196f471d9fa81328e89997cc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.704427 11392 tablet_replica.cc:333] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.705227 11392 raft_consensus.cc:2243] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.706393 11392 raft_consensus.cc:2272] T 75aab4686614449489ce5c08d0860bd6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:40.707109 12671 consensus_peers.cc:597] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:26:40.708818 11392 tablet_replica.cc:333] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.709678 11392 raft_consensus.cc:2243] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.710814 11392 raft_consensus.cc:2272] T d472a3f71a5d430fafa4a535ed826f18 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.713380 11392 tablet_replica.cc:333] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.714195 11392 raft_consensus.cc:2243] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus shutting down.
W20260709 12:26:40.714917 13199 consensus_peers.cc:597] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.714931 11392 raft_consensus.cc:2272] T 20e379fdd40947f39c461038e088ea1a P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.717809 11392 tablet_replica.cc:333] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.718408 11392 raft_consensus.cc:2243] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.719216 11392 raft_consensus.cc:2272] T 793f816912494728bf76dd612942dc4c P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.721103 11392 tablet_replica.cc:333] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.721799 11392 raft_consensus.cc:2243] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.722550 11392 raft_consensus.cc:2272] T 23f3709af552426ebb55ecf39265cc47 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.724839 11392 tablet_replica.cc:333] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.725440 11392 raft_consensus.cc:2243] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.726393 11392 raft_consensus.cc:2272] T bc86699922844edbae89cb65c328e3ce P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.728178 11392 tablet_replica.cc:333] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.728713 11392 raft_consensus.cc:2243] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.729596 11392 raft_consensus.cc:2272] T e19c569fe6e34f969a722bd2495c3a89 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.731252 11392 tablet_replica.cc:333] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.731752 11392 raft_consensus.cc:2243] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.732600 11392 raft_consensus.cc:2272] T c6a602467dda4cb0bbfb59098cf973c9 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.734350 11392 tablet_replica.cc:333] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.734861 11392 raft_consensus.cc:2243] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.735301 11392 raft_consensus.cc:2272] T 08834ef951b049b39c60e46c2ed865e9 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.736989 11392 tablet_replica.cc:333] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.737588 11392 raft_consensus.cc:2243] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.738392 11392 raft_consensus.cc:2272] T 606f6695c1e84da291559cacabfa82bc P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.740116 11392 tablet_replica.cc:333] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.740816 11392 raft_consensus.cc:2243] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.741914 11392 raft_consensus.cc:2272] T a6ad0911475a422ab0936b28dc4c93f1 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.744321 11392 tablet_replica.cc:333] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.745038 11392 raft_consensus.cc:2243] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.746213 11392 raft_consensus.cc:2272] T 0e137b72ba4847d6ad89da17af64db7d P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.748855 11392 tablet_replica.cc:333] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.749545 11392 raft_consensus.cc:2243] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.750085 11392 raft_consensus.cc:2272] T ef8bfbfb91b54571bed5f5d44534395a P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.752435 11392 tablet_replica.cc:333] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.753129 11392 raft_consensus.cc:2243] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Raft consensus shutting down.
W20260709 12:26:40.754271 13199 consensus_peers.cc:597] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.755156 11392 raft_consensus.cc:2272] T 39edb149903d45b5a17cbbc4dd12850b P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.757603 11392 tablet_replica.cc:333] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.758142 11392 raft_consensus.cc:2243] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.758962 11392 raft_consensus.cc:2272] T 902b0c6b28a040c9902fea6547ffaa9f P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.760867 11392 tablet_replica.cc:333] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.761468 11392 raft_consensus.cc:2243] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.762338 11392 raft_consensus.cc:2272] T 9e5ce7f361ff45268f58f04272a4a5ef P c6795b140b3247279a2231c6b9360d24 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.764292 11392 tablet_replica.cc:333] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.764889 11392 raft_consensus.cc:2243] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.765453 11392 raft_consensus.cc:2272] T 91e9b98dfcc94a4f87b33617aa6df487 P c6795b140b3247279a2231c6b9360d24 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.767828 11392 tablet_replica.cc:333] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
W20260709 12:26:40.768285 13201 consensus_peers.cc:597] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:40.768455 11392 raft_consensus.cc:2243] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.770520 11392 raft_consensus.cc:2272] T af0709be9e0d4bf39ce083c7af243837 P c6795b140b3247279a2231c6b9360d24 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.773473 11392 tablet_replica.cc:333] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.774334 11392 raft_consensus.cc:2243] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 9 LEADER]: Raft consensus shutting down.
W20260709 12:26:40.774921 13201 consensus_peers.cc:597] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260709 12:26:40.775544 11392 raft_consensus.cc:2272] T 9257ace92110474f9ba7f25a16b03161 P c6795b140b3247279a2231c6b9360d24 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.777817 11392 tablet_replica.cc:333] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.778415 11392 raft_consensus.cc:2243] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.779291 11392 raft_consensus.cc:2272] T 33554b5715244a96b9faa863336bdc3b P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.781090 11392 tablet_replica.cc:333] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.781713 11392 raft_consensus.cc:2243] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.782203 11392 raft_consensus.cc:2272] T c8dc26a51db24f54ad0e0272c06d9306 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.784138 11392 tablet_replica.cc:333] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.784732 11392 raft_consensus.cc:2243] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.785708 11392 raft_consensus.cc:2272] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P c6795b140b3247279a2231c6b9360d24 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.787647 11392 tablet_replica.cc:333] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.788228 11392 raft_consensus.cc:2243] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.789250 11392 raft_consensus.cc:2272] T 5548d773e7254d74bd88a9092bf7567d P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.791324 11392 tablet_replica.cc:333] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.792092 11392 raft_consensus.cc:2243] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.792657 11392 raft_consensus.cc:2272] T 0116b2408a7241828256061551a36f1c P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.795186 11392 tablet_replica.cc:333] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.795997 11392 raft_consensus.cc:2243] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.796638 11392 raft_consensus.cc:2272] T 1a59b6927edd4e21a78fe14b7acdad1c P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.799532 11392 tablet_replica.cc:333] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.800354 11392 raft_consensus.cc:2243] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.801489 11392 raft_consensus.cc:2272] T e18a3c206d6646e69fba42e3b74572a6 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.803902 11392 tablet_replica.cc:333] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.804553 11392 raft_consensus.cc:2243] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.805198 11392 raft_consensus.cc:2272] T 54ae52ca0f5e4e988dcd22a9651ec1bd P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.807150 11392 tablet_replica.cc:333] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.807796 11392 raft_consensus.cc:2243] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.808279 11392 raft_consensus.cc:2272] T 7f25843830014b4c8c5707696cddc7f0 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.810185 11392 tablet_replica.cc:333] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.810878 11392 raft_consensus.cc:2243] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.811482 11392 raft_consensus.cc:2272] T 936a02b62f0d46168b0550920bd53ed3 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.813717 11392 tablet_replica.cc:333] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.814262 11392 raft_consensus.cc:2243] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.815243 11392 raft_consensus.cc:2272] T 7d75a6f40c324994a517c98816b2afc4 P c6795b140b3247279a2231c6b9360d24 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.817500 11392 tablet_replica.cc:333] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.818007 11392 raft_consensus.cc:2243] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:26:40.818562 13199 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.819025 11392 raft_consensus.cc:2272] T cd26860ea4e84bd7851de4aaa5d02f01 P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.820839 11392 tablet_replica.cc:333] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.821373 11392 raft_consensus.cc:2243] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.821969 11392 raft_consensus.cc:2272] T 4719532adf46473495ced717a908a078 P c6795b140b3247279a2231c6b9360d24 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.823822 11392 tablet_replica.cc:333] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.824319 11392 raft_consensus.cc:2243] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.824920 11392 raft_consensus.cc:2272] T 85949dbea3b742fea0cb31dfc53d5766 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.827049 11392 tablet_replica.cc:333] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.827756 11392 raft_consensus.cc:2243] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.828881 11392 raft_consensus.cc:2272] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P c6795b140b3247279a2231c6b9360d24 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.831167 11392 tablet_replica.cc:333] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.831651 11392 raft_consensus.cc:2243] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.832170 11392 raft_consensus.cc:2272] T 52ac1951d6d64447869208058e8755b6 P c6795b140b3247279a2231c6b9360d24 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.833923 11392 tablet_replica.cc:333] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.834409 11392 raft_consensus.cc:2243] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.835258 11392 raft_consensus.cc:2272] T a10e3ca41dda44bc9e0c04ad3cc65f57 P c6795b140b3247279a2231c6b9360d24 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.837112 11392 tablet_replica.cc:333] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.837723 11392 raft_consensus.cc:2243] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.838255 11392 raft_consensus.cc:2272] T 94aed3506ab5437b8943521ce387d9e4 P c6795b140b3247279a2231c6b9360d24 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.840610 11392 tablet_replica.cc:333] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.841285 11392 raft_consensus.cc:2243] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.841972 11392 raft_consensus.cc:2272] T e25848d0a4024deda42b246d049b5be0 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:40.842980 13199 consensus_peers.cc:597] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:40.844353 11392 tablet_replica.cc:333] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.845144 11392 raft_consensus.cc:2243] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.845956 11392 raft_consensus.cc:2272] T c5facffc88a94bc58f10135f6686804c P c6795b140b3247279a2231c6b9360d24 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.848510 11392 tablet_replica.cc:333] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.849011 11392 raft_consensus.cc:2243] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.849522 11392 raft_consensus.cc:2272] T 700a61b9aeed45869b2d882368e99824 P c6795b140b3247279a2231c6b9360d24 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.851363 11392 tablet_replica.cc:333] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24: stopping tablet replica
I20260709 12:26:40.851850 11392 raft_consensus.cc:2243] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:40.852728 11392 raft_consensus.cc:2272] T e072821343d84e57b593eb6bc58c585a P c6795b140b3247279a2231c6b9360d24 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:40.877483 13199 consensus_peers.cc:597] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:40.887032 13198 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:40.911178 13199 consensus_peers.cc:597] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:40.961364 13198 consensus_peers.cc:597] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:26:41.003176 13199 consensus_peers.cc:597] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.015350 13199 consensus_peers.cc:597] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.022620 13199 consensus_peers.cc:597] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.052323 18709 raft_consensus.cc:493] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:41.052809 18709 raft_consensus.cc:515] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:41.054634 18709 leader_election.cc:290] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:41.058462 13201 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:41.061933 13199 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.063608 13198 leader_election.cc:336] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:41.064002 13198 leader_election.cc:304] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:41.064592 18709 raft_consensus.cc:2749] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:41.070873 13199 consensus_peers.cc:597] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:26:41.216178 13201 consensus_peers.cc:597] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260709 12:26:41.221477 13201 consensus_peers.cc:597] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:41.223203 13199 consensus_peers.cc:597] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Couldn't send request to peer c6795b140b3247279a2231c6b9360d24. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:41.399096 18745 raft_consensus.cc:493] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:41.399619 18745 raft_consensus.cc:515] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:41.401634 18745 leader_election.cc:290] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:41.406103 13198 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
W20260709 12:26:41.407014 13201 leader_election.cc:336] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:41.407397 13201 leader_election.cc:304] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:41.408073 18745 raft_consensus.cc:2749] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:41.658243 18709 raft_consensus.cc:493] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:41.658728 18709 raft_consensus.cc:515] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:41.660645 18709 leader_election.cc:290] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:41.672192 13201 consensus_peers.cc:597] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Couldn't send request to peer 23740bafdb794232879a0bb6884f7a68. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260709 12:26:41.672645 13201 leader_election.cc:336] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
W20260709 12:26:41.673652 13199 leader_election.cc:336] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
I20260709 12:26:41.674594 13199 leader_election.cc:304] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:41.679237 18743 raft_consensus.cc:2749] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:41.764741 18745 raft_consensus.cc:493] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:41.765343 18745 raft_consensus.cc:515] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:41.767545 18745 leader_election.cc:290] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:41.776533 13199 leader_election.cc:336] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
W20260709 12:26:41.777686 13201 leader_election.cc:336] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:41.778098 13201 leader_election.cc:304] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:41.778772 18745 raft_consensus.cc:2749] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:41.784969 18743 raft_consensus.cc:493] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:41.785585 18743 raft_consensus.cc:515] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:41.787596 18743 leader_election.cc:290] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:41.793912 13199 leader_election.cc:336] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
W20260709 12:26:41.794950 13198 leader_election.cc:336] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:41.796571 13198 leader_election.cc:304] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:41.798484 18743 raft_consensus.cc:2749] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:41.832247 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
W20260709 12:26:41.879261 13198 consensus_peers.cc:597] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:41.883874 18743 raft_consensus.cc:493] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:41.884531 18743 raft_consensus.cc:515] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:41.887454 18743 leader_election.cc:290] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:41.894464 13199 leader_election.cc:336] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
W20260709 12:26:41.895954 13198 leader_election.cc:336] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:41.896413 13198 leader_election.cc:304] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:41.897158 18743 raft_consensus.cc:2749] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:41.958786 11392 tablet_server.cc:179] TabletServer@127.11.32.4:0 shutting down...
I20260709 12:26:42.015053 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:26:42.015856 11392 tablet_replica.cc:333] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.016821 11392 raft_consensus.cc:2243] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.017580 11392 raft_consensus.cc:2272] T a10e3ca41dda44bc9e0c04ad3cc65f57 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.020311 11392 tablet_replica.cc:333] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.021090 11392 raft_consensus.cc:2243] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.022127 11392 raft_consensus.cc:2272] T 606f6695c1e84da291559cacabfa82bc P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.021042 18743 raft_consensus.cc:493] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:42.023623 18743 raft_consensus.cc:515] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:42.025128 11392 tablet_replica.cc:333] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.026268 11392 raft_consensus.cc:2243] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.027544 11392 raft_consensus.cc:2272] T d9812250f15d4075a3c8831ca5f3ed41 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.029021 18743 leader_election.cc:290] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:42.030761 11392 tablet_replica.cc:333] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
W20260709 12:26:42.030860 13201 leader_election.cc:336] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:42.031839 11392 raft_consensus.cc:2243] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.031966 18743 raft_consensus.cc:493] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:42.032635 11392 raft_consensus.cc:2272] T 28c65936613f4ee89e3dc89d06a91776 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.032985 13199 leader_election.cc:336] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
I20260709 12:26:42.032609 18743 raft_consensus.cc:515] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:42.033492 13199 leader_election.cc:304] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:42.034309 18745 raft_consensus.cc:2749] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:42.036114 11392 tablet_replica.cc:333] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.037065 11392 raft_consensus.cc:2243] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.037709 11392 raft_consensus.cc:2272] T 902b0c6b28a040c9902fea6547ffaa9f P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.039059 13201 leader_election.cc:336] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:42.040069 18743 leader_election.cc:290] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
W20260709 12:26:42.040364 13199 leader_election.cc:336] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
I20260709 12:26:42.040688 11392 tablet_replica.cc:333] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.040827 13199 leader_election.cc:304] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:42.041574 18743 raft_consensus.cc:2749] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:42.041648 11392 raft_consensus.cc:2243] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.042403 11392 raft_consensus.cc:2272] T f8bd8b4df5594ab89b5028f708332757 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.044273 18745 raft_consensus.cc:493] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:42.045099 11392 tablet_replica.cc:333] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.044754 18745 raft_consensus.cc:515] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:42.046092 11392 raft_consensus.cc:2243] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.047096 18745 leader_election.cc:290] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:42.047214 11392 raft_consensus.cc:2272] T 91e9b98dfcc94a4f87b33617aa6df487 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.050336 11392 tablet_replica.cc:333] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.051087 11392 raft_consensus.cc:2243] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.051684 11392 raft_consensus.cc:2272] T 8cad0ce0b1e4401c95e8abd3bbbdd60b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.054097 13199 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
I20260709 12:26:42.054605 11392 tablet_replica.cc:333] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.055348 11392 raft_consensus.cc:2243] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Raft consensus shutting down.
W20260709 12:26:42.055531 13201 leader_election.cc:336] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:42.055971 13201 leader_election.cc:304] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:42.056375 11392 raft_consensus.cc:2272] T c8dc26a51db24f54ad0e0272c06d9306 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.056857 18743 raft_consensus.cc:2749] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:42.058889 11392 tablet_replica.cc:333] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.059294 18743 raft_consensus.cc:493] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader c6795b140b3247279a2231c6b9360d24)
I20260709 12:26:42.059579 11392 raft_consensus.cc:2243] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.059811 18743 raft_consensus.cc:515] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "c6795b140b3247279a2231c6b9360d24" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43633 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:42.060428 11392 raft_consensus.cc:2272] T 39edb149903d45b5a17cbbc4dd12850b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.062224 18743 leader_election.cc:290] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669), c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633)
I20260709 12:26:42.063434 11392 tablet_replica.cc:333] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.064347 11392 raft_consensus.cc:2243] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.065039 11392 raft_consensus.cc:2272] T e19c569fe6e34f969a722bd2495c3a89 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.066576 13198 leader_election.cc:336] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:42.067345 18743 raft_consensus.cc:493] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader a2a8d71f644447218c1afc3e5f7716cd)
I20260709 12:26:42.067842 11392 tablet_replica.cc:333] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
W20260709 12:26:42.067726 13199 leader_election.cc:336] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer c6795b140b3247279a2231c6b9360d24 (127.11.32.3:43633): Network error: Client connection negotiation failed: client connection to 127.11.32.3:43633: connect: Connection refused (error 111)
I20260709 12:26:42.068372 13199 leader_election.cc:304] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: a2a8d71f644447218c1afc3e5f7716cd, c6795b140b3247279a2231c6b9360d24
I20260709 12:26:42.067939 18743 raft_consensus.cc:515] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "23740bafdb794232879a0bb6884f7a68" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 45107 } } peers { permanent_uuid: "a2a8d71f644447218c1afc3e5f7716cd" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 34669 } } peers { permanent_uuid: "155b5b0a0b6d4b499edfe2797ffa5b91" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 37323 } attrs { promote: false } }
I20260709 12:26:42.068861 11392 raft_consensus.cc:2243] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.069096 18745 raft_consensus.cc:2749] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:42.070327 11392 raft_consensus.cc:2272] T 54ae52ca0f5e4e988dcd22a9651ec1bd P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.072772 11392 tablet_replica.cc:333] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.073696 11392 raft_consensus.cc:2243] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.074332 11392 raft_consensus.cc:2272] T e18a3c206d6646e69fba42e3b74572a6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 12:26:42.074566 13201 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107): Network error: Client connection negotiation failed: client connection to 127.11.32.1:45107: connect: Connection refused (error 111)
I20260709 12:26:42.075358 18743 leader_election.cc:290] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 23740bafdb794232879a0bb6884f7a68 (127.11.32.1:45107), a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669)
W20260709 12:26:42.076579 13198 leader_election.cc:336] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:42.077021 13198 leader_election.cc:304] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 155b5b0a0b6d4b499edfe2797ffa5b91; no voters: 23740bafdb794232879a0bb6884f7a68, a2a8d71f644447218c1afc3e5f7716cd
I20260709 12:26:42.077245 11392 tablet_replica.cc:333] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.077765 18743 raft_consensus.cc:2749] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:42.078186 11392 raft_consensus.cc:2243] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.078790 11392 raft_consensus.cc:2272] T 613ed3057bf74d02a48d823635fd0b6a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.080925 11392 tablet_replica.cc:333] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.081530 11392 raft_consensus.cc:2243] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.081975 11392 raft_consensus.cc:2272] T a6ad0911475a422ab0936b28dc4c93f1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.083904 11392 tablet_replica.cc:333] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.084461 11392 raft_consensus.cc:2243] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.084893 11392 raft_consensus.cc:2272] T 0e137b72ba4847d6ad89da17af64db7d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.086998 11392 tablet_replica.cc:333] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.087512 11392 raft_consensus.cc:2243] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.088248 11392 raft_consensus.cc:2272] T 08834ef951b049b39c60e46c2ed865e9 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.090224 11392 tablet_replica.cc:333] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.090761 11392 raft_consensus.cc:2243] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.091514 11392 raft_consensus.cc:2272] T 1a59b6927edd4e21a78fe14b7acdad1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.093456 11392 tablet_replica.cc:333] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.094048 11392 raft_consensus.cc:2243] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.094578 11392 raft_consensus.cc:2272] T 47430c4494f1431f8fb577cd8838f972 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.096515 11392 tablet_replica.cc:333] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.097064 11392 raft_consensus.cc:2243] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.097604 11392 raft_consensus.cc:2272] T 04a769018c454aa685eae73d74c89abb P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.099777 11392 tablet_replica.cc:333] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.100369 11392 raft_consensus.cc:2243] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.100952 11392 raft_consensus.cc:2272] T 2d04f0e851d04dab8ea27bcfbdbb46e1 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.103397 11392 tablet_replica.cc:333] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.104194 11392 raft_consensus.cc:2243] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.104715 11392 raft_consensus.cc:2272] T 2514eba211b3456c96ca755c4c7c084b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.107249 11392 tablet_replica.cc:333] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.107784 11392 raft_consensus.cc:2243] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.108592 11392 raft_consensus.cc:2272] T 52ac1951d6d64447869208058e8755b6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.110689 11392 tablet_replica.cc:333] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.111408 11392 raft_consensus.cc:2243] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.111963 11392 raft_consensus.cc:2272] T 140159e481364d9e99f0f034c42b7fda P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.113894 11392 tablet_replica.cc:333] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.114419 11392 raft_consensus.cc:2243] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.115480 11392 raft_consensus.cc:2272] T 700a61b9aeed45869b2d882368e99824 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.118127 11392 tablet_replica.cc:333] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.118939 11392 raft_consensus.cc:2243] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.119546 11392 raft_consensus.cc:2272] T e072821343d84e57b593eb6bc58c585a P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.122073 11392 tablet_replica.cc:333] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.122809 11392 raft_consensus.cc:2243] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.123363 11392 raft_consensus.cc:2272] T 9257ace92110474f9ba7f25a16b03161 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.125660 11392 tablet_replica.cc:333] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.126314 11392 raft_consensus.cc:2243] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.126921 11392 raft_consensus.cc:2272] T d457e0ba678747fba0ac2a4c1b42649e P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.129370 11392 tablet_replica.cc:333] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
W20260709 12:26:42.129837 13198 consensus_peers.cc:597] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 -> Peer a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): Couldn't send request to peer a2a8d71f644447218c1afc3e5f7716cd. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:26:42.129957 11392 raft_consensus.cc:2243] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.130581 11392 raft_consensus.cc:2272] T 793f816912494728bf76dd612942dc4c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.132704 11392 tablet_replica.cc:333] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.133278 11392 raft_consensus.cc:2243] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.134385 11392 raft_consensus.cc:2272] T df7bcc0f7c2a4fc0a36e8605f87a3a0b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.137223 11392 tablet_replica.cc:333] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.137897 11392 raft_consensus.cc:2243] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.138386 11392 raft_consensus.cc:2272] T 33554b5715244a96b9faa863336bdc3b P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.140348 11392 tablet_replica.cc:333] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.140936 11392 raft_consensus.cc:2243] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.141876 11392 raft_consensus.cc:2272] T c5facffc88a94bc58f10135f6686804c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.144197 11392 tablet_replica.cc:333] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.144874 11392 raft_consensus.cc:2243] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.145349 11392 raft_consensus.cc:2272] T 75aab4686614449489ce5c08d0860bd6 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.147413 11392 tablet_replica.cc:333] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.147903 11392 raft_consensus.cc:2243] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.148747 11392 raft_consensus.cc:2272] T 0afb49cf962a46388bf387ad7b344c39 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.150738 11392 tablet_replica.cc:333] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.151273 11392 raft_consensus.cc:2243] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.152089 11392 raft_consensus.cc:2272] T 94aed3506ab5437b8943521ce387d9e4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.154052 11392 tablet_replica.cc:333] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.154559 11392 raft_consensus.cc:2243] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.155345 11392 raft_consensus.cc:2272] T 74acfff7189b45af8e177ff563645d9d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.157153 11392 tablet_replica.cc:333] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.157830 11392 raft_consensus.cc:2243] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.158757 11392 raft_consensus.cc:2272] T 4719532adf46473495ced717a908a078 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.160682 11392 tablet_replica.cc:333] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.161232 11392 raft_consensus.cc:2243] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.162195 11392 raft_consensus.cc:2272] T 936a02b62f0d46168b0550920bd53ed3 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.164223 11392 tablet_replica.cc:333] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.164721 11392 raft_consensus.cc:2243] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.165560 11392 raft_consensus.cc:2272] T 7f25843830014b4c8c5707696cddc7f0 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.167512 11392 tablet_replica.cc:333] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.168203 11392 raft_consensus.cc:2243] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.168980 11392 raft_consensus.cc:2272] T 7d75a6f40c324994a517c98816b2afc4 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.172901 11392 tablet_replica.cc:333] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.173620 11392 raft_consensus.cc:2243] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.174609 11392 raft_consensus.cc:2272] T 2ca7fa9a22ba4b0b8300a42169fced1c P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.177213 11392 tablet_replica.cc:333] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.177939 11392 raft_consensus.cc:2243] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.179086 11392 raft_consensus.cc:2272] T d5554b3483384c14898b46be0dbd5ae5 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.181879 11392 tablet_replica.cc:333] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.182528 11392 raft_consensus.cc:2243] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:26:42.183483 11392 raft_consensus.cc:2272] T 3f9ecf42cca34c34954029c3568e54b2 P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.185948 11392 tablet_replica.cc:333] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91: stopping tablet replica
I20260709 12:26:42.186558 11392 raft_consensus.cc:2243] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:42.187096 11392 raft_consensus.cc:2272] T 5548d773e7254d74bd88a9092bf7567d P 155b5b0a0b6d4b499edfe2797ffa5b91 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:42.509913 11392 tablet_server.cc:196] TabletServer@127.11.32.4:0 shutdown complete.
I20260709 12:26:42.592305 11392 master.cc:562] Master@127.11.32.62:45335 shutting down...
W20260709 12:26:42.634181 12505 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:26:42.634537 12505 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:26:42.634759 12505 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:26:53.759029 12441 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111) [suppressed 278 similar messages]
W20260709 12:26:53.763309 12441 catalog_manager.cc:4755] TS a2a8d71f644447218c1afc3e5f7716cd (127.11.32.2:34669): ChangeConfig:REMOVE_PEER RPC failed for tablet a10e3ca41dda44bc9e0c04ad3cc65f57: Network error: Client connection negotiation failed: client connection to 127.11.32.2:34669: connect: Connection refused (error 111)
I20260709 12:26:56.251142 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:26:56.252671 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:56.253288 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3f1cbd60b6244caaa2ca6d4aafd3dea2: stopping tablet replica
I20260709 12:26:56.492280 11392 master.cc:584] Master@127.11.32.62:45335 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (210359 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:26:56.613399 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:37705
I20260709 12:26:56.614846 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:56.620949 18752 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:56.621855 18751 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:56.622255 18754 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:56.622725 11392 server_base.cc:1061] running on GCE node
I20260709 12:26:56.626654 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:56.626973 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:56.627167 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600016627151 us; error 0 us; skew 500 ppm
I20260709 12:26:56.627712 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:56.630228 11392 webserver.cc:533] Webserver started at http://127.11.32.62:44193/ using document root <none> and password file <none>
I20260709 12:26:56.630668 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:56.630820 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:56.631036 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:56.632311 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "1fffedc497074f4a97e3d5e6c101d663"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:26:56.636739 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:26:56.640091 18759 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:56.640828 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:56.641124 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "1fffedc497074f4a97e3d5e6c101d663"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:26:56.641374 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:56.655771 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:56.657025 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:56.695820 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:37705
I20260709 12:26:56.695940 18810 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:37705 every 8 connection(s)
I20260709 12:26:56.700047 18811 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:56.711563 18811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663: Bootstrap starting.
I20260709 12:26:56.716337 18811 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:56.720505 18811 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663: No bootstrap required, opened a new log
I20260709 12:26:56.722697 18811 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffedc497074f4a97e3d5e6c101d663" member_type: VOTER }
I20260709 12:26:56.723119 18811 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:56.723295 18811 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1fffedc497074f4a97e3d5e6c101d663, State: Initialized, Role: FOLLOWER
I20260709 12:26:56.723785 18811 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffedc497074f4a97e3d5e6c101d663" member_type: VOTER }
I20260709 12:26:56.724188 18811 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:26:56.724401 18811 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:26:56.724617 18811 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:56.729269 18811 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffedc497074f4a97e3d5e6c101d663" member_type: VOTER }
I20260709 12:26:56.729858 18811 leader_election.cc:304] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1fffedc497074f4a97e3d5e6c101d663; no voters: 
I20260709 12:26:56.730945 18811 leader_election.cc:290] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:26:56.731349 18814 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:56.732735 18814 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 1 LEADER]: Becoming Leader. State: Replica: 1fffedc497074f4a97e3d5e6c101d663, State: Running, Role: LEADER
I20260709 12:26:56.733520 18814 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffedc497074f4a97e3d5e6c101d663" member_type: VOTER }
I20260709 12:26:56.734244 18811 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:26:56.741307 18816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1fffedc497074f4a97e3d5e6c101d663. Latest consensus state: current_term: 1 leader_uuid: "1fffedc497074f4a97e3d5e6c101d663" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffedc497074f4a97e3d5e6c101d663" member_type: VOTER } }
I20260709 12:26:56.741397 18815 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1fffedc497074f4a97e3d5e6c101d663" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1fffedc497074f4a97e3d5e6c101d663" member_type: VOTER } }
I20260709 12:26:56.742128 18816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:56.742297 18815 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [sys.catalog]: This master's current role is: LEADER
I20260709 12:26:56.745055 18824 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:26:56.751617 18824 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:26:56.752635 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:26:56.760655 18824 catalog_manager.cc:1383] Generated new cluster ID: 4a970fd75bbb4fffb80b4289442ec69e
I20260709 12:26:56.761008 18824 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:26:56.787168 18824 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:26:56.788470 18824 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:26:56.804885 18824 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663: Generated new TSK 0
I20260709 12:26:56.805572 18824 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:26:56.819101 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:56.825232 18832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:56.826399 18833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:56.828886 11392 server_base.cc:1061] running on GCE node
W20260709 12:26:56.829253 18836 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:56.831377 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:56.831597 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:56.831774 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600016831753 us; error 0 us; skew 500 ppm
I20260709 12:26:56.832357 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:56.834751 11392 webserver.cc:533] Webserver started at http://127.11.32.1:32783/ using document root <none> and password file <none>
I20260709 12:26:56.835232 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:56.835412 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:56.835693 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:56.836921 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "c6d7b700141440f8997cb5145ad80f79"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:26:56.841517 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:26:56.845172 18840 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:56.846109 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 12:26:56.846432 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "c6d7b700141440f8997cb5145ad80f79"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:26:56.846722 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:56.863240 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:56.864583 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:56.866278 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:56.868764 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:56.868996 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:56.869261 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:56.869473 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:26:56.915133 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:44929
I20260709 12:26:56.915212 18902 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:44929 every 8 connection(s)
I20260709 12:26:56.920666 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:56.929579 18908 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:56.929654 18907 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:56.933233 18910 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:56.933903 11392 server_base.cc:1061] running on GCE node
I20260709 12:26:56.935585 18903 heartbeater.cc:344] Connected to a master server at 127.11.32.62:37705
I20260709 12:26:56.936035 18903 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:56.936764 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:56.936996 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:56.936928 18903 heartbeater.cc:507] Master 127.11.32.62:37705 requested a full tablet report, sending...
I20260709 12:26:56.937353 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600016937332 us; error 0 us; skew 500 ppm
I20260709 12:26:56.938069 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:56.939545 18776 ts_manager.cc:194] Registered new tserver with Master: c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:56.940659 11392 webserver.cc:533] Webserver started at http://127.11.32.2:37119/ using document root <none> and password file <none>
I20260709 12:26:56.941196 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:56.941433 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:56.941735 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:56.941793 18776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59790
I20260709 12:26:56.943339 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "1e1f5beea2f147c9a99d564bf624643c"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:26:56.948132 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:26:56.951691 18915 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:56.952404 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:56.952696 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "1e1f5beea2f147c9a99d564bf624643c"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:26:56.953009 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:56.971191 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:56.972441 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:56.973896 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:56.976111 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:56.976337 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:56.976593 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:56.976760 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:57.018224 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:37853
I20260709 12:26:57.018324 18977 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:37853 every 8 connection(s)
I20260709 12:26:57.023115 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:57.030473 18981 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:57.032423 18982 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:57.035537 18984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:57.035842 18978 heartbeater.cc:344] Connected to a master server at 127.11.32.62:37705
I20260709 12:26:57.036320 18978 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:57.036610 11392 server_base.cc:1061] running on GCE node
I20260709 12:26:57.037264 18978 heartbeater.cc:507] Master 127.11.32.62:37705 requested a full tablet report, sending...
I20260709 12:26:57.037729 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:57.038020 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:57.038231 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600017038212 us; error 0 us; skew 500 ppm
I20260709 12:26:57.038964 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:57.039551 18776 ts_manager.cc:194] Registered new tserver with Master: 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:57.041551 18776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59792
I20260709 12:26:57.041750 11392 webserver.cc:533] Webserver started at http://127.11.32.3:37991/ using document root <none> and password file <none>
I20260709 12:26:57.042399 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:57.042671 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:57.043001 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:57.044255 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "31bb5a47c5b64d31ade62e132c3dda27"
format_stamp: "Formatted at 2026-07-09 12:26:57 on dist-test-slave-sckv"
I20260709 12:26:57.048720 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:26:57.051860 18989 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:57.052590 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:57.052883 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "31bb5a47c5b64d31ade62e132c3dda27"
format_stamp: "Formatted at 2026-07-09 12:26:57 on dist-test-slave-sckv"
I20260709 12:26:57.053164 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:57.105594 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:57.106840 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:57.108314 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:57.110534 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:57.110762 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:57.111003 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:57.111177 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:57.151580 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:45785
I20260709 12:26:57.151682 19051 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:45785 every 8 connection(s)
I20260709 12:26:57.156322 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:26:57.163386 19055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:26:57.163748 19056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:57.167246 11392 server_base.cc:1061] running on GCE node
W20260709 12:26:57.167213 19058 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:26:57.168745 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:26:57.169044 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:26:57.169248 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600017169230 us; error 0 us; skew 500 ppm
I20260709 12:26:57.169306 19052 heartbeater.cc:344] Connected to a master server at 127.11.32.62:37705
I20260709 12:26:57.169788 19052 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:57.169919 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:26:57.170827 19052 heartbeater.cc:507] Master 127.11.32.62:37705 requested a full tablet report, sending...
I20260709 12:26:57.172696 11392 webserver.cc:533] Webserver started at http://127.11.32.4:42013/ using document root <none> and password file <none>
I20260709 12:26:57.173148 18776 ts_manager.cc:194] Registered new tserver with Master: 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:57.173350 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:26:57.173672 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:26:57.173980 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:26:57.175020 18776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59800
I20260709 12:26:57.175484 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-3-root/instance:
uuid: "c7db7a43db4a4c23bcd749e49623180b"
format_stamp: "Formatted at 2026-07-09 12:26:57 on dist-test-slave-sckv"
I20260709 12:26:57.180169 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:26:57.183357 19063 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:57.184094 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:26:57.184389 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-3-root
uuid: "c7db7a43db4a4c23bcd749e49623180b"
format_stamp: "Formatted at 2026-07-09 12:26:57 on dist-test-slave-sckv"
I20260709 12:26:57.184671 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:26:57.199920 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:26:57.201176 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:26:57.202702 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:26:57.205384 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:26:57.205693 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.001s
I20260709 12:26:57.206027 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:26:57.206264 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:26:57.271773 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.4:34167
I20260709 12:26:57.271821 19125 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.4:34167 every 8 connection(s)
I20260709 12:26:57.288916 19126 heartbeater.cc:344] Connected to a master server at 127.11.32.62:37705
I20260709 12:26:57.289330 19126 heartbeater.cc:461] Registering TS with master...
I20260709 12:26:57.290175 19126 heartbeater.cc:507] Master 127.11.32.62:37705 requested a full tablet report, sending...
I20260709 12:26:57.292188 18776 ts_manager.cc:194] Registered new tserver with Master: c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:26:57.292879 11392 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.01604165s
I20260709 12:26:57.293937 18776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59812
I20260709 12:26:57.320225 18776 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59822:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:26:57.559563 19091 tablet_service.cc:1511] Processing CreateTablet for tablet ee3fe50916684ab8ad38a191ae892eb2 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:57.561084 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3fe50916684ab8ad38a191ae892eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.565200 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 59bfebe89eac4fb0a7733f516b04b007 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:57.565817 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 1234203a94d043c99f919323ab576971 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:57.566758 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfebe89eac4fb0a7733f516b04b007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.567296 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1234203a94d043c99f919323ab576971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.569885 19088 tablet_service.cc:1511] Processing CreateTablet for tablet bba70b230ee84643b59da80ba7390a2a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:57.570722 19089 tablet_service.cc:1511] Processing CreateTablet for tablet f20c40417f904c7d97367b1ed0a0c088 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:57.571758 19088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba70b230ee84643b59da80ba7390a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.573242 19017 tablet_service.cc:1511] Processing CreateTablet for tablet ee3fe50916684ab8ad38a191ae892eb2 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:57.574637 19017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3fe50916684ab8ad38a191ae892eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.577832 19089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20c40417f904c7d97367b1ed0a0c088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.597787 19087 tablet_service.cc:1511] Processing CreateTablet for tablet 96d263d5e9d1495c814b3ea85c3f7c3b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:57.599298 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d263d5e9d1495c814b3ea85c3f7c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.602689 19145 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:57.604040 19086 tablet_service.cc:1511] Processing CreateTablet for tablet 143c53cb7a644bacadbdf430e0f80687 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:57.605557 19086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143c53cb7a644bacadbdf430e0f80687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.606830 19015 tablet_service.cc:1511] Processing CreateTablet for tablet f20c40417f904c7d97367b1ed0a0c088 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:57.608363 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20c40417f904c7d97367b1ed0a0c088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.610646 19145 tablet_bootstrap.cc:654] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.619869 19016 tablet_service.cc:1511] Processing CreateTablet for tablet f5c3a84e41a54b46b74cd3e02e00bbe3 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:57.621275 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c3a84e41a54b46b74cd3e02e00bbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.621138 19014 tablet_service.cc:1511] Processing CreateTablet for tablet 96d263d5e9d1495c814b3ea85c3f7c3b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:57.622771 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d263d5e9d1495c814b3ea85c3f7c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.638868 19145 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:57.639428 19145 ts_tablet_manager.cc:1403] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.037s	user 0.013s	sys 0.004s
I20260709 12:26:57.639004 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 402a280e12134198878e344533753066 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:57.640858 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a280e12134198878e344533753066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.642748 19145 raft_consensus.cc:359] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:57.643726 19145 raft_consensus.cc:385] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.644030 19145 raft_consensus.cc:740] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.650434 19145 consensus_queue.cc:260] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:57.663321 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 143c53cb7a644bacadbdf430e0f80687 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:57.664640 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143c53cb7a644bacadbdf430e0f80687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.668006 19013 tablet_service.cc:1511] Processing CreateTablet for tablet 9b30962081764c9e846593f0908f6cea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:57.669483 19013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b30962081764c9e846593f0908f6cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.669821 18943 tablet_service.cc:1511] Processing CreateTablet for tablet ee3fe50916684ab8ad38a191ae892eb2 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:26:57.671160 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee3fe50916684ab8ad38a191ae892eb2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.672997 19088 tablet_service.cc:1511] Processing CreateTablet for tablet 1923ecfa0beb4e56a72fb14eb30fd44e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:57.674265 19088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1923ecfa0beb4e56a72fb14eb30fd44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.674659 19012 tablet_service.cc:1511] Processing CreateTablet for tablet 195b142675bd4c3ba085b783eccf665f (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:57.676023 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195b142675bd4c3ba085b783eccf665f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.676826 19087 tablet_service.cc:1511] Processing CreateTablet for tablet 195b142675bd4c3ba085b783eccf665f (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:57.682663 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195b142675bd4c3ba085b783eccf665f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.683202 18942 tablet_service.cc:1511] Processing CreateTablet for tablet 1234203a94d043c99f919323ab576971 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:57.663259 19147 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:57.684966 18942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1234203a94d043c99f919323ab576971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.687830 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 238ed3f1ff024aaeaf72c97d614e3c01 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:57.689066 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238ed3f1ff024aaeaf72c97d614e3c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.695389 18941 tablet_service.cc:1511] Processing CreateTablet for tablet 59bfebe89eac4fb0a7733f516b04b007 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:57.696925 18941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfebe89eac4fb0a7733f516b04b007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.698125 19147 tablet_bootstrap.cc:654] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:57.700294 19086 tablet_service.cc:1511] Processing CreateTablet for tablet b50d7fdee8a244cfa677109bb9ca854a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:57.701602 19086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50d7fdee8a244cfa677109bb9ca854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.707301 18940 tablet_service.cc:1511] Processing CreateTablet for tablet f5c3a84e41a54b46b74cd3e02e00bbe3 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:57.708931 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c3a84e41a54b46b74cd3e02e00bbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.715265 18939 tablet_service.cc:1511] Processing CreateTablet for tablet bba70b230ee84643b59da80ba7390a2a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:57.716784 18939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba70b230ee84643b59da80ba7390a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.722088 19147 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:57.722556 19147 ts_tablet_manager.cc:1403] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.060s	user 0.011s	sys 0.000s
I20260709 12:26:57.723760 18938 tablet_service.cc:1511] Processing CreateTablet for tablet 143c53cb7a644bacadbdf430e0f80687 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:26:57.725847 18938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143c53cb7a644bacadbdf430e0f80687. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.728235 19084 tablet_service.cc:1511] Processing CreateTablet for tablet 154018e97da948d78c303aec9ff51f57 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:57.730103 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154018e97da948d78c303aec9ff51f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.734386 19147 raft_consensus.cc:359] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:57.735140 19147 raft_consensus.cc:385] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:57.735435 19147 raft_consensus.cc:740] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:57.738688 19147 consensus_queue.cc:260] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:57.741760 19087 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4107fcf756467ab86dd05df9d8a366 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:57.743041 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4107fcf756467ab86dd05df9d8a366. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:57.746479 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:57.747809 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 9b30962081764c9e846593f0908f6cea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:57.749985 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b30962081764c9e846593f0908f6cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.750733 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 815dce779e1642fd862e279f79c8a118 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:57.752004 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815dce779e1642fd862e279f79c8a118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.763579 18936 tablet_service.cc:1511] Processing CreateTablet for tablet 402a280e12134198878e344533753066 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:57.763417 19084 tablet_service.cc:1511] Processing CreateTablet for tablet b8e124074de848de84792c3456059de8 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:57.765156 18936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a280e12134198878e344533753066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.765149 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e124074de848de84792c3456059de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.780071 18935 tablet_service.cc:1511] Processing CreateTablet for tablet 1923ecfa0beb4e56a72fb14eb30fd44e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:57.781713 18935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1923ecfa0beb4e56a72fb14eb30fd44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.782281 19087 tablet_service.cc:1511] Processing CreateTablet for tablet e029f7a7f4cc40c0adcc3767c9c581df (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:57.782532 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 556d72ded831470a830cb0f4451a480b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:57.783541 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f7a7f4cc40c0adcc3767c9c581df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.783962 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d72ded831470a830cb0f4451a480b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.786509 19013 tablet_service.cc:1511] Processing CreateTablet for tablet 1923ecfa0beb4e56a72fb14eb30fd44e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:26:57.789041 19013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1923ecfa0beb4e56a72fb14eb30fd44e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.793073 19012 tablet_service.cc:1511] Processing CreateTablet for tablet b50d7fdee8a244cfa677109bb9ca854a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:57.794693 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50d7fdee8a244cfa677109bb9ca854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.796789 18934 tablet_service.cc:1511] Processing CreateTablet for tablet 556d72ded831470a830cb0f4451a480b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:57.798197 18934 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d72ded831470a830cb0f4451a480b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.800848 19010 tablet_service.cc:1511] Processing CreateTablet for tablet acf2707a8bd640fda22add252bcd5bd2 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:57.804447 19011 tablet_service.cc:1511] Processing CreateTablet for tablet 154018e97da948d78c303aec9ff51f57 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:57.810091 19011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154018e97da948d78c303aec9ff51f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.821799 19009 tablet_service.cc:1511] Processing CreateTablet for tablet 815dce779e1642fd862e279f79c8a118 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:57.829761 18940 tablet_service.cc:1511] Processing CreateTablet for tablet 238ed3f1ff024aaeaf72c97d614e3c01 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:57.831259 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238ed3f1ff024aaeaf72c97d614e3c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.827083 19008 tablet_service.cc:1511] Processing CreateTablet for tablet b8e124074de848de84792c3456059de8 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:57.836879 19147 ts_tablet_manager.cc:1434] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.114s	user 0.014s	sys 0.026s
I20260709 12:26:57.837749 19126 heartbeater.cc:499] Master 127.11.32.62:37705 was elected leader, sending a full tablet report...
I20260709 12:26:57.838065 19147 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:57.839323 19085 tablet_service.cc:1511] Processing CreateTablet for tablet e5af4e1d5b3e4e3f81b1e55817e8ef53 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:57.840878 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af4e1d5b3e4e3f81b1e55817e8ef53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.825898 19010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf2707a8bd640fda22add252bcd5bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.855701 19009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815dce779e1642fd862e279f79c8a118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.856367 19148 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.856871 19008 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e124074de848de84792c3456059de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.857800 19052 heartbeater.cc:499] Master 127.11.32.62:37705 was elected leader, sending a full tablet report...
I20260709 12:26:57.856963 19148 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:57.868456 19148 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:57.870815 19015 tablet_service.cc:1511] Processing CreateTablet for tablet a27793117bd7440cb8d9d04abcb78f46 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:57.875336 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27793117bd7440cb8d9d04abcb78f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.877688 18868 tablet_service.cc:1511] Processing CreateTablet for tablet 1234203a94d043c99f919323ab576971 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:26:57.878042 18867 tablet_service.cc:1511] Processing CreateTablet for tablet 59bfebe89eac4fb0a7733f516b04b007 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:26:57.879210 18868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1234203a94d043c99f919323ab576971. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.880314 18866 tablet_service.cc:1511] Processing CreateTablet for tablet f20c40417f904c7d97367b1ed0a0c088 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:26:57.882668 18865 tablet_service.cc:1511] Processing CreateTablet for tablet f5c3a84e41a54b46b74cd3e02e00bbe3 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:26:57.884462 18865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c3a84e41a54b46b74cd3e02e00bbe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.886811 19017 tablet_service.cc:1511] Processing CreateTablet for tablet 5c531f84ef5f49dca1527adcd178ed3a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:57.887027 18864 tablet_service.cc:1511] Processing CreateTablet for tablet bba70b230ee84643b59da80ba7390a2a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:26:57.888582 19017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c531f84ef5f49dca1527adcd178ed3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.910948 18864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba70b230ee84643b59da80ba7390a2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.911967 18863 tablet_service.cc:1511] Processing CreateTablet for tablet 96d263d5e9d1495c814b3ea85c3f7c3b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:26:57.914487 19151 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:57.914701 18862 tablet_service.cc:1511] Processing CreateTablet for tablet 9b30962081764c9e846593f0908f6cea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:26:57.917289 18861 tablet_service.cc:1511] Processing CreateTablet for tablet 402a280e12134198878e344533753066 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:26:57.918926 19145 ts_tablet_manager.cc:1434] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.279s	user 0.023s	sys 0.036s
I20260709 12:26:57.919198 18863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 96d263d5e9d1495c814b3ea85c3f7c3b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.920426 19145 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:57.935575 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f20c40417f904c7d97367b1ed0a0c088. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.936534 18861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 402a280e12134198878e344533753066. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.945075 18903 heartbeater.cc:499] Master 127.11.32.62:37705 was elected leader, sending a full tablet report...
W20260709 12:26:57.946161 19053 tablet.cc:2406] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:26:57.946455 19091 tablet_service.cc:1511] Processing CreateTablet for tablet 5c531f84ef5f49dca1527adcd178ed3a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:57.948608 18860 tablet_service.cc:1511] Processing CreateTablet for tablet 195b142675bd4c3ba085b783eccf665f (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:26:57.953030 18859 tablet_service.cc:1511] Processing CreateTablet for tablet 556d72ded831470a830cb0f4451a480b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:26:57.955796 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 154018e97da948d78c303aec9ff51f57 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:26:57.948652 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c531f84ef5f49dca1527adcd178ed3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.973562 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 154018e97da948d78c303aec9ff51f57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.975658 18936 tablet_service.cc:1511] Processing CreateTablet for tablet acf2707a8bd640fda22add252bcd5bd2 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:57.985529 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9b30962081764c9e846593f0908f6cea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.986958 18859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 556d72ded831470a830cb0f4451a480b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.964510 18935 tablet_service.cc:1511] Processing CreateTablet for tablet e029f7a7f4cc40c0adcc3767c9c581df (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:57.993324 19090 tablet_service.cc:1511] Processing CreateTablet for tablet bfbd1061e0be4511b027499bf152444a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:57.995078 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbd1061e0be4511b027499bf152444a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.994556 18860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 195b142675bd4c3ba085b783eccf665f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:57.997716 18867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 59bfebe89eac4fb0a7733f516b04b007. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.002765 19016 tablet_service.cc:1511] Processing CreateTablet for tablet e5af4e1d5b3e4e3f81b1e55817e8ef53 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:58.004616 18938 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4107fcf756467ab86dd05df9d8a366 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:57.977275 18936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf2707a8bd640fda22add252bcd5bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.025370 19147 tablet_bootstrap.cc:654] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.032114 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af4e1d5b3e4e3f81b1e55817e8ef53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.035638 18935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f7a7f4cc40c0adcc3767c9c581df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.037449 19084 tablet_service.cc:1511] Processing CreateTablet for tablet bda58a59bd074fd3bce74d63822c2671 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:58.038766 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda58a59bd074fd3bce74d63822c2671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.044514 18978 heartbeater.cc:499] Master 127.11.32.62:37705 was elected leader, sending a full tablet report...
I20260709 12:26:58.052742 18942 tablet_service.cc:1511] Processing CreateTablet for tablet b8e124074de848de84792c3456059de8 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:26:58.055569 18943 tablet_service.cc:1511] Processing CreateTablet for tablet a27793117bd7440cb8d9d04abcb78f46 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:58.060276 19150 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.063302 19150 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:58.064121 18939 tablet_service.cc:1511] Processing CreateTablet for tablet 5c531f84ef5f49dca1527adcd178ed3a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:26:58.059888 19014 tablet_service.cc:1511] Processing CreateTablet for tablet bda58a59bd074fd3bce74d63822c2671 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:26:58.066102 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda58a59bd074fd3bce74d63822c2671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.066234 19150 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:58.076268 18941 tablet_service.cc:1511] Processing CreateTablet for tablet 52337688286f416c8736cfa551d03aea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:58.098160 19012 tablet_service.cc:1511] Processing CreateTablet for tablet 52337688286f416c8736cfa551d03aea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:58.100039 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52337688286f416c8736cfa551d03aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.086064 18938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4107fcf756467ab86dd05df9d8a366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.114709 19145 tablet_bootstrap.cc:654] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.128535 19151 tablet_bootstrap.cc:654] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.148132 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27793117bd7440cb8d9d04abcb78f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.165279 18937 tablet_service.cc:1511] Processing CreateTablet for tablet bfbd1061e0be4511b027499bf152444a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:58.166851 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbd1061e0be4511b027499bf152444a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.171089 18864 tablet_service.cc:1511] Processing CreateTablet for tablet 238ed3f1ff024aaeaf72c97d614e3c01 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:26:58.172461 18864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 238ed3f1ff024aaeaf72c97d614e3c01. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.178617 18939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c531f84ef5f49dca1527adcd178ed3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.183142 19155 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:58.186184 18942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b8e124074de848de84792c3456059de8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.192730 18941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52337688286f416c8736cfa551d03aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.196727 18935 tablet_service.cc:1511] Processing CreateTablet for tablet dd349f9d1efe4b17a329506502573552 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:58.198263 18935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd349f9d1efe4b17a329506502573552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.208284 19091 tablet_service.cc:1511] Processing CreateTablet for tablet dd349f9d1efe4b17a329506502573552 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:58.209685 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd349f9d1efe4b17a329506502573552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.230278 18862 tablet_service.cc:1511] Processing CreateTablet for tablet b50d7fdee8a244cfa677109bb9ca854a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:26:58.231792 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b50d7fdee8a244cfa677109bb9ca854a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.235430 19147 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:58.236296 19147 ts_tablet_manager.cc:1403] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.398s	user 0.010s	sys 0.027s
I20260709 12:26:58.240115 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:58.241045 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:26:58.242110 18991 leader_election.cc:343] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:58.243084 18991 leader_election.cc:343] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.243469 18991 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:58.248332 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 54cf4aa1eaae45588f5272617a664b12 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:58.249747 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cf4aa1eaae45588f5272617a664b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.257706 18868 tablet_service.cc:1511] Processing CreateTablet for tablet 815dce779e1642fd862e279f79c8a118 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:26:58.259052 18868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 815dce779e1642fd862e279f79c8a118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.260403 18866 tablet_service.cc:1511] Processing CreateTablet for tablet 1b4107fcf756467ab86dd05df9d8a366 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:26:58.261394 19152 raft_consensus.cc:2749] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.272265 18859 tablet_service.cc:1511] Processing CreateTablet for tablet a27793117bd7440cb8d9d04abcb78f46 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:26:58.274098 19147 raft_consensus.cc:359] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.290205 19147 raft_consensus.cc:385] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.290575 19147 raft_consensus.cc:740] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.275615 19017 tablet_service.cc:1511] Processing CreateTablet for tablet dd349f9d1efe4b17a329506502573552 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:26:58.279660 19151 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:58.291666 19151 ts_tablet_manager.cc:1403] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.378s	user 0.013s	sys 0.010s
I20260709 12:26:58.294834 19151 raft_consensus.cc:359] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.295629 19151 raft_consensus.cc:385] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.295922 19151 raft_consensus.cc:740] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.296068 18867 tablet_service.cc:1511] Processing CreateTablet for tablet e5af4e1d5b3e4e3f81b1e55817e8ef53 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:26:58.296710 19151 consensus_queue.cc:260] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.257241 18863 tablet_service.cc:1511] Processing CreateTablet for tablet acf2707a8bd640fda22add252bcd5bd2 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:26:58.298197 19017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dd349f9d1efe4b17a329506502573552. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.302449 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 43a5a064384d4367a357c422ea87190e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:58.294875 18861 tablet_service.cc:1511] Processing CreateTablet for tablet e029f7a7f4cc40c0adcc3767c9c581df (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:26:58.303583 19145 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:58.303835 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a5a064384d4367a357c422ea87190e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.304507 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1b4107fcf756467ab86dd05df9d8a366. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.306974 19145 ts_tablet_manager.cc:1403] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.387s	user 0.036s	sys 0.044s
I20260709 12:26:58.310499 19145 raft_consensus.cc:359] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.311328 19145 raft_consensus.cc:385] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.311683 19145 raft_consensus.cc:740] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.312700 19145 consensus_queue.cc:260] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.315346 19145 ts_tablet_manager.cc:1434] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:26:58.316561 19145 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:58.283495 19155 tablet_bootstrap.cc:654] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.324821 18865 tablet_service.cc:1511] Processing CreateTablet for tablet 52337688286f416c8736cfa551d03aea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:26:58.326027 19151 ts_tablet_manager.cc:1434] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 12:26:58.330261 19151 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:58.321645 19147 consensus_queue.cc:260] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.335014 19147 ts_tablet_manager.cc:1434] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.098s	user 0.007s	sys 0.000s
I20260709 12:26:58.337620 19147 tablet_bootstrap.cc:492] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:58.323841 18861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e029f7a7f4cc40c0adcc3767c9c581df. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.339591 19014 tablet_service.cc:1511] Processing CreateTablet for tablet 43a5a064384d4367a357c422ea87190e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:58.341050 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a5a064384d4367a357c422ea87190e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.341706 18863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet acf2707a8bd640fda22add252bcd5bd2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.346475 18867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5af4e1d5b3e4e3f81b1e55817e8ef53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.346812 19147 tablet_bootstrap.cc:654] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.347504 18865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 52337688286f416c8736cfa551d03aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.327891 18860 tablet_service.cc:1511] Processing CreateTablet for tablet bfbd1061e0be4511b027499bf152444a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:26:58.355674 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:58.355897 18942 tablet_service.cc:1511] Processing CreateTablet for tablet 40be63f36321487394bd3ee0bd3e794c (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:58.356387 19145 tablet_bootstrap.cc:654] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.357054 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:58.357760 19151 tablet_bootstrap.cc:654] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.365516 18859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a27793117bd7440cb8d9d04abcb78f46. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.366262 18860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bfbd1061e0be4511b027499bf152444a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.358500 19091 tablet_service.cc:1511] Processing CreateTablet for tablet 2586f1cfce5848caaa69ac93ed67b9d6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:58.360237 18862 tablet_service.cc:1511] Processing CreateTablet for tablet bda58a59bd074fd3bce74d63822c2671 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
W20260709 12:26:58.366725 19065 leader_election.cc:343] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.369374 19012 tablet_service.cc:1511] Processing CreateTablet for tablet 2586f1cfce5848caaa69ac93ed67b9d6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
W20260709 12:26:58.371121 19065 leader_election.cc:343] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.371702 19065 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:58.357981 18938 tablet_service.cc:1511] Processing CreateTablet for tablet 54cf4aa1eaae45588f5272617a664b12 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:58.372012 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2586f1cfce5848caaa69ac93ed67b9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.377576 18943 tablet_service.cc:1511] Processing CreateTablet for tablet 2586f1cfce5848caaa69ac93ed67b9d6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:26:58.384644 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 30bc1c45f11a44f79c80125131564f4a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:58.387086 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bc1c45f11a44f79c80125131564f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.367278 19010 tablet_service.cc:1511] Processing CreateTablet for tablet 40be63f36321487394bd3ee0bd3e794c (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:58.389171 19010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40be63f36321487394bd3ee0bd3e794c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.389245 18942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40be63f36321487394bd3ee0bd3e794c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.391153 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2586f1cfce5848caaa69ac93ed67b9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.391258 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2586f1cfce5848caaa69ac93ed67b9d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.396160 18864 tablet_service.cc:1511] Processing CreateTablet for tablet 40be63f36321487394bd3ee0bd3e794c (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:26:58.396265 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 416fa299c26f44b69a5b04ef4d339514 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:58.397737 18864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 40be63f36321487394bd3ee0bd3e794c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.397972 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416fa299c26f44b69a5b04ef4d339514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.399540 18938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cf4aa1eaae45588f5272617a664b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.404479 19150 raft_consensus.cc:2749] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.408903 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bda58a59bd074fd3bce74d63822c2671. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.413178 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 416fa299c26f44b69a5b04ef4d339514 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:58.422204 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416fa299c26f44b69a5b04ef4d339514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.423686 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 68288b50f46b45328211be0d64c50c8a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:58.425057 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68288b50f46b45328211be0d64c50c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.443687 18935 tablet_service.cc:1511] Processing CreateTablet for tablet 30bc1c45f11a44f79c80125131564f4a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:58.448647 18935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bc1c45f11a44f79c80125131564f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.445112 18940 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce7cd3504f34236b92a9304bae7977b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:58.454178 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce7cd3504f34236b92a9304bae7977b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.445801 19015 tablet_service.cc:1511] Processing CreateTablet for tablet 68288b50f46b45328211be0d64c50c8a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:58.447350 19011 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce7cd3504f34236b92a9304bae7977b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:58.460758 19011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce7cd3504f34236b92a9304bae7977b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.461710 19152 raft_consensus.cc:493] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.462015 18863 tablet_service.cc:1511] Processing CreateTablet for tablet 54cf4aa1eaae45588f5272617a664b12 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:26:58.462210 19152 raft_consensus.cc:515] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.463464 18863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54cf4aa1eaae45588f5272617a664b12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.464401 19152 leader_election.cc:290] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:58.466601 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:58.467950 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68288b50f46b45328211be0d64c50c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.466575 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:26:58.474153 18991 leader_election.cc:343] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:58.474845 18991 leader_election.cc:343] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.475253 18991 leader_election.cc:304] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:58.475478 19145 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:58.476060 19145 ts_tablet_manager.cc:1403] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.160s	user 0.013s	sys 0.008s
I20260709 12:26:58.476279 19163 raft_consensus.cc:493] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.476801 19163 raft_consensus.cc:515] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.479388 19163 leader_election.cc:290] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:58.483596 19150 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.484091 19150 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.491621 19150 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:58.493806 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:26:58.495370 19065 leader_election.cc:343] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.482757 19152 raft_consensus.cc:2749] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.522989 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:26:58.524744 19065 leader_election.cc:343] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.525187 19065 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:58.526351 19150 raft_consensus.cc:2749] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.528766 18861 tablet_service.cc:1511] Processing CreateTablet for tablet 43a5a064384d4367a357c422ea87190e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:26:58.550987 19151 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:58.553419 19151 ts_tablet_manager.cc:1403] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.223s	user 0.021s	sys 0.004s
I20260709 12:26:58.553988 18861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 43a5a064384d4367a357c422ea87190e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.539691 19145 raft_consensus.cc:359] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:58.555168 19145 raft_consensus.cc:385] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.555583 19145 raft_consensus.cc:740] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.556389 19145 consensus_queue.cc:260] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:58.558655 19145 ts_tablet_manager.cc:1434] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.082s	user 0.009s	sys 0.000s
I20260709 12:26:58.559672 19145 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:58.571089 19084 tablet_service.cc:1511] Processing CreateTablet for tablet a6baecd84a26405bb8e40a75edcabb9d (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:58.572500 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6baecd84a26405bb8e40a75edcabb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.573078 19145 tablet_bootstrap.cc:654] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.573107 19155 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:58.576365 19155 ts_tablet_manager.cc:1403] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.394s	user 0.006s	sys 0.021s
I20260709 12:26:58.556923 19151 raft_consensus.cc:359] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.577919 19151 raft_consensus.cc:385] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.578280 19151 raft_consensus.cc:740] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.579125 19151 consensus_queue.cc:260] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.583206 19151 ts_tablet_manager.cc:1434] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260709 12:26:58.584298 19151 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:58.590529 18868 tablet_service.cc:1511] Processing CreateTablet for tablet 416fa299c26f44b69a5b04ef4d339514 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:26:58.592067 18868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 416fa299c26f44b69a5b04ef4d339514. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.592384 19147 tablet_bootstrap.cc:492] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:58.593024 19147 ts_tablet_manager.cc:1403] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.257s	user 0.025s	sys 0.034s
I20260709 12:26:58.590529 19091 tablet_service.cc:1511] Processing CreateTablet for tablet 5ce7cd3504f34236b92a9304bae7977b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:26:58.594457 19085 tablet_service.cc:1511] Processing CreateTablet for tablet f56e2ce743e6479589da5d8a3788ebb6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:58.611308 19011 tablet_service.cc:1511] Processing CreateTablet for tablet caee18f264a54f23a0400a742d9f7927 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:58.618341 19011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caee18f264a54f23a0400a742d9f7927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.611308 18867 tablet_service.cc:1511] Processing CreateTablet for tablet 30bc1c45f11a44f79c80125131564f4a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:26:58.621775 18867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30bc1c45f11a44f79c80125131564f4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.612437 18864 tablet_service.cc:1511] Processing CreateTablet for tablet 68288b50f46b45328211be0d64c50c8a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:26:58.615321 19089 tablet_service.cc:1511] Processing CreateTablet for tablet c795e825a66b48189a7397f6c172a621 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:58.615226 18866 tablet_service.cc:1511] Processing CreateTablet for tablet caee18f264a54f23a0400a742d9f7927 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:58.580096 19155 raft_consensus.cc:359] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.634769 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56e2ce743e6479589da5d8a3788ebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.637106 19145 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:58.637739 19145 ts_tablet_manager.cc:1403] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.078s	user 0.017s	sys 0.019s
I20260709 12:26:58.640226 19089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c795e825a66b48189a7397f6c172a621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.640311 18940 tablet_service.cc:1511] Processing CreateTablet for tablet caee18f264a54f23a0400a742d9f7927 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:26:58.642554 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caee18f264a54f23a0400a742d9f7927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.650971 19145 raft_consensus.cc:359] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.652125 19147 raft_consensus.cc:359] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:58.655665 19147 raft_consensus.cc:385] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.656055 19147 raft_consensus.cc:740] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.656864 19147 consensus_queue.cc:260] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:58.657521 18863 tablet_service.cc:1511] Processing CreateTablet for tablet a6baecd84a26405bb8e40a75edcabb9d (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:58.658293 19012 tablet_service.cc:1511] Processing CreateTablet for tablet f56e2ce743e6479589da5d8a3788ebb6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:58.659536 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56e2ce743e6479589da5d8a3788ebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.629436 19155 raft_consensus.cc:385] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.655273 19145 raft_consensus.cc:385] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.661684 19155 raft_consensus.cc:740] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.661947 19145 raft_consensus.cc:740] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.661923 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:58.662433 18863 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6baecd84a26405bb8e40a75edcabb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.662528 19155 consensus_queue.cc:260] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.664196 19147 ts_tablet_manager.cc:1434] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.071s	user 0.009s	sys 0.000s
I20260709 12:26:58.669055 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 184620f70ba844b09efb04461363f9b7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:58.669273 19087 tablet_service.cc:1511] Processing CreateTablet for tablet a78687d4c1044976aff39a7a2fd653f1 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:58.669865 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet caee18f264a54f23a0400a742d9f7927. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.664726 19145 consensus_queue.cc:260] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.671612 18864 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68288b50f46b45328211be0d64c50c8a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.671370 19086 tablet_service.cc:1511] Processing CreateTablet for tablet 54bb9118a5c3400e9e4421d2c5f4a918 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:26:58.665824 18917 leader_election.cc:343] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.666388 19091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ce7cd3504f34236b92a9304bae7977b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.667456 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:58.680243 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78687d4c1044976aff39a7a2fd653f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.680184 19152 raft_consensus.cc:493] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.681094 19152 raft_consensus.cc:515] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.681527 18938 tablet_service.cc:1511] Processing CreateTablet for tablet a6baecd84a26405bb8e40a75edcabb9d (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:26:58.682065 19086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bb9118a5c3400e9e4421d2c5f4a918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.682783 18938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6baecd84a26405bb8e40a75edcabb9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.683315 19152 leader_election.cc:290] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:58.683336 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184620f70ba844b09efb04461363f9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.685179 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:58.685179 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:26:58.688992 18991 leader_election.cc:343] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:58.689780 18991 leader_election.cc:343] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.690229 18991 leader_election.cc:304] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:58.690716 19088 tablet_service.cc:1511] Processing CreateTablet for tablet 9def37a54ca4491ba21f9e74d8ebe4ed (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:58.691380 19152 raft_consensus.cc:2749] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.692022 19088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9def37a54ca4491ba21f9e74d8ebe4ed. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:58.693965 18916 leader_election.cc:343] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.694485 18916 leader_election.cc:304] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:58.694900 19145 ts_tablet_manager.cc:1434] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.002s
I20260709 12:26:58.695958 19145 tablet_bootstrap.cc:492] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:58.698673 19163 raft_consensus.cc:2749] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.661245 19151 tablet_bootstrap.cc:654] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.670267 19147 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:58.712677 18861 tablet_service.cc:1511] Processing CreateTablet for tablet f56e2ce743e6479589da5d8a3788ebb6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:26:58.714071 18861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f56e2ce743e6479589da5d8a3788ebb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.720024 18862 tablet_service.cc:1511] Processing CreateTablet for tablet 9c10ea4afc7740068972f8bc611ae37e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:58.721328 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c10ea4afc7740068972f8bc611ae37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.721004 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 9c10ea4afc7740068972f8bc611ae37e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:58.722558 19152 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.723083 19152 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:58.724272 18865 tablet_service.cc:1511] Processing CreateTablet for tablet 184620f70ba844b09efb04461363f9b7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:58.724560 18935 tablet_service.cc:1511] Processing CreateTablet for tablet c795e825a66b48189a7397f6c172a621 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:58.725641 18865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184620f70ba844b09efb04461363f9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.725840 18935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c795e825a66b48189a7397f6c172a621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.726912 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:26:58.728500 18991 leader_election.cc:343] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.729110 19152 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:58.722281 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c10ea4afc7740068972f8bc611ae37e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.731863 18942 tablet_service.cc:1511] Processing CreateTablet for tablet 9c10ea4afc7740068972f8bc611ae37e (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:26:58.733180 18942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9c10ea4afc7740068972f8bc611ae37e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:58.749071 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:58.749738 19147 tablet_bootstrap.cc:654] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.756824 19011 tablet_service.cc:1511] Processing CreateTablet for tablet c795e825a66b48189a7397f6c172a621 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:26:58.758208 19011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c795e825a66b48189a7397f6c172a621. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.763880 19014 tablet_service.cc:1511] Processing CreateTablet for tablet a78687d4c1044976aff39a7a2fd653f1 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:58.764577 18860 tablet_service.cc:1511] Processing CreateTablet for tablet a78687d4c1044976aff39a7a2fd653f1 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:26:58.765157 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78687d4c1044976aff39a7a2fd653f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.765272 18943 tablet_service.cc:1511] Processing CreateTablet for tablet 54bb9118a5c3400e9e4421d2c5f4a918 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:58.765839 18860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a78687d4c1044976aff39a7a2fd653f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.766553 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bb9118a5c3400e9e4421d2c5f4a918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.767444 18941 tablet_service.cc:1511] Processing CreateTablet for tablet b4b3804e576c4d499ffeed1aabe213ea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:58.768682 18941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b3804e576c4d499ffeed1aabe213ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.770440 18859 tablet_service.cc:1511] Processing CreateTablet for tablet b4b3804e576c4d499ffeed1aabe213ea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:58.771680 18859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b3804e576c4d499ffeed1aabe213ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.772177 19163 raft_consensus.cc:493] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.772665 19163 raft_consensus.cc:515] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.770473 19010 tablet_service.cc:1511] Processing CreateTablet for tablet 54bb9118a5c3400e9e4421d2c5f4a918 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:26:58.774626 19010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 54bb9118a5c3400e9e4421d2c5f4a918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.775130 19163 leader_election.cc:290] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:58.782624 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:26:58.785182 18917 leader_election.cc:343] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.788107 19089 tablet_service.cc:1511] Processing CreateTablet for tablet 78854dfb3b15485bb2c2f3f6cc5b294d (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:58.763116 18940 tablet_service.cc:1511] Processing CreateTablet for tablet 184620f70ba844b09efb04461363f9b7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:26:58.790423 18940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 184620f70ba844b09efb04461363f9b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.791299 19172 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.791837 19172 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.797204 19172 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:58.722266 19084 tablet_service.cc:1511] Processing CreateTablet for tablet cb73782ff8474ba5bfef53d8399b01a7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:58.814108 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 9def37a54ca4491ba21f9e74d8ebe4ed (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:58.815505 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9def37a54ca4491ba21f9e74d8ebe4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.814073 18866 tablet_service.cc:1511] Processing CreateTablet for tablet 9def37a54ca4491ba21f9e74d8ebe4ed (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:26:58.827304 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9def37a54ca4491ba21f9e74d8ebe4ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.830020 19089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78854dfb3b15485bb2c2f3f6cc5b294d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.831429 19085 tablet_service.cc:1511] Processing CreateTablet for tablet 4d55ad11d73d42569f54ef540ebedcc9 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:58.832742 19085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d55ad11d73d42569f54ef540ebedcc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.838742 19090 tablet_service.cc:1511] Processing CreateTablet for tablet bce2d9aff2e749f5b4b14a488b26a084 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:58.840083 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce2d9aff2e749f5b4b14a488b26a084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.841912 19084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb73782ff8474ba5bfef53d8399b01a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.736068 19145 tablet_bootstrap.cc:654] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.736894 19155 ts_tablet_manager.cc:1434] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.160s	user 0.006s	sys 0.007s
I20260709 12:26:58.851011 19155 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:58.854892 19087 tablet_service.cc:1511] Processing CreateTablet for tablet 6a522629731a40c491e370cd123e39e6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:58.856247 19151 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:58.856787 19151 ts_tablet_manager.cc:1403] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.273s	user 0.014s	sys 0.009s
I20260709 12:26:58.857024 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a522629731a40c491e370cd123e39e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.860013 19151 raft_consensus.cc:359] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.860764 19151 raft_consensus.cc:385] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.861050 19151 raft_consensus.cc:740] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.861847 19151 consensus_queue.cc:260] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:58.867009 19147 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:58.872073 19151 ts_tablet_manager.cc:1434] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:26:58.874718 19086 tablet_service.cc:1511] Processing CreateTablet for tablet 819615c6672d40979e8058dd998c1dff (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:58.882009 19147 ts_tablet_manager.cc:1403] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.212s	user 0.012s	sys 0.000s
I20260709 12:26:58.875303 19083 tablet_service.cc:1511] Processing CreateTablet for tablet 304e743b0b1c476ead5c8073437f5c1f (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:58.883363 19014 tablet_service.cc:1511] Processing CreateTablet for tablet b4b3804e576c4d499ffeed1aabe213ea (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:26:58.884698 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4b3804e576c4d499ffeed1aabe213ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.889393 19151 tablet_bootstrap.cc:492] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:58.886245 19147 raft_consensus.cc:359] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.891184 19147 raft_consensus.cc:385] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.891512 19147 raft_consensus.cc:740] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.892400 19147 consensus_queue.cc:260] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.894865 19147 ts_tablet_manager.cc:1434] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:26:58.896190 19147 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:58.896605 19151 tablet_bootstrap.cc:654] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.900240 18862 tablet_service.cc:1511] Processing CreateTablet for tablet cb73782ff8474ba5bfef53d8399b01a7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:58.900516 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 78854dfb3b15485bb2c2f3f6cc5b294d (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:58.901609 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb73782ff8474ba5bfef53d8399b01a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.903646 19147 tablet_bootstrap.cc:654] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.903532 18866 tablet_service.cc:1511] Processing CreateTablet for tablet d157f6240cb74405827f910790c760e7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:58.880134 19145 tablet_bootstrap.cc:492] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:58.904948 18943 tablet_service.cc:1511] Processing CreateTablet for tablet d157f6240cb74405827f910790c760e7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:58.908658 19150 raft_consensus.cc:493] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.909179 19150 raft_consensus.cc:515] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:58.906663 19087 tablet_service.cc:1511] Processing CreateTablet for tablet 1590223762b24a92b589c7d9db79bb28 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:58.909683 19145 ts_tablet_manager.cc:1403] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.214s	user 0.008s	sys 0.005s
I20260709 12:26:58.906658 19015 tablet_service.cc:1511] Processing CreateTablet for tablet 78854dfb3b15485bb2c2f3f6cc5b294d (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:26:58.911405 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78854dfb3b15485bb2c2f3f6cc5b294d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.911620 19150 leader_election.cc:290] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:58.908066 19082 tablet_service.cc:1511] Processing CreateTablet for tablet dacdbc9e2aed4919814e17b608ac4e19 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:58.913520 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143c53cb7a644bacadbdf430e0f80687" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:58.913646 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:58.905064 19016 tablet_service.cc:1511] Processing CreateTablet for tablet cb73782ff8474ba5bfef53d8399b01a7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:26:58.909696 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157f6240cb74405827f910790c760e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.915328 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:26:58.916328 19065 leader_election.cc:343] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.917776 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78854dfb3b15485bb2c2f3f6cc5b294d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.925850 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157f6240cb74405827f910790c760e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.914366 19101 raft_consensus.cc:2468] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:26:58.894824 19155 tablet_bootstrap.cc:654] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:58.914800 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143c53cb7a644bacadbdf430e0f80687" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:58.914873 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cb73782ff8474ba5bfef53d8399b01a7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:58.913064 19145 raft_consensus.cc:359] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:58.933990 19145 raft_consensus.cc:385] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:58.934324 19145 raft_consensus.cc:740] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.941686 19145 consensus_queue.cc:260] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:58.942662 19027 raft_consensus.cc:2468] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:26:58.942584 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:58.945812 19026 raft_consensus.cc:2468] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:26:58.947463 19065 leader_election.cc:304] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:26:58.948870 19150 raft_consensus.cc:2804] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.949245 19150 raft_consensus.cc:493] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.949609 19150 raft_consensus.cc:3060] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.950145 18841 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:26:58.951079 19172 raft_consensus.cc:2804] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.951500 19172 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.951933 19172 raft_consensus.cc:3060] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.952550 19090 tablet_service.cc:1511] Processing CreateTablet for tablet 880c860fdd004c5c801a87289851b335 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:58.953887 18917 leader_election.cc:304] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
W20260709 12:26:58.954125 18990 leader_election.cc:343] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.954569 18990 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:58.955169 19163 raft_consensus.cc:2804] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:58.955555 19163 raft_consensus.cc:493] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.955899 19163 raft_consensus.cc:3060] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.956784 19152 raft_consensus.cc:2749] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:58.959576 19150 raft_consensus.cc:515] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:58.961112 19172 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:58.962437 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143c53cb7a644bacadbdf430e0f80687" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:58.963291 19163 raft_consensus.cc:515] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:26:58.963874 19065 leader_election.cc:343] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.965036 19172 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:58.966017 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
W20260709 12:26:58.967581 18917 leader_election.cc:343] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:58.966017 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143c53cb7a644bacadbdf430e0f80687" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:26:58.968752 19027 raft_consensus.cc:3060] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:58.969799 19150 leader_election.cc:290] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:58.975209 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
W20260709 12:26:58.977624 18761 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 72182.2us
I20260709 12:26:58.978983 19155 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
W20260709 12:26:58.979653 18760 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 72658.6us
I20260709 12:26:58.980826 19145 ts_tablet_manager.cc:1434] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.001s
I20260709 12:26:58.987927 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:58.988425 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:58.990484 19082 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacdbc9e2aed4919814e17b608ac4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.001658 19026 raft_consensus.cc:3060] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.003633 19155 ts_tablet_manager.cc:1403] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.153s	user 0.010s	sys 0.003s
I20260709 12:26:59.004451 19145 tablet_bootstrap.cc:492] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.006915 19155 raft_consensus.cc:359] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.007635 19155 raft_consensus.cc:385] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.007952 19155 raft_consensus.cc:740] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:58.974485 19163 leader_election.cc:290] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:59.001654 19027 raft_consensus.cc:2468] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:26:59.012315 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:26:59.012936 19101 raft_consensus.cc:3060] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.013254 19065 leader_election.cc:304] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:26:59.014539 19150 raft_consensus.cc:2804] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.011451 19087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1590223762b24a92b589c7d9db79bb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.008893 19155 consensus_queue.cc:260] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.018031 19163 raft_consensus.cc:493] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.037719 19150 raft_consensus.cc:697] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:26:59.038247 19185 raft_consensus.cc:493] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.038710 19150 consensus_queue.cc:237] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.039475 19083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e743b0b1c476ead5c8073437f5c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.048830 19090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880c860fdd004c5c801a87289851b335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.033558 19101 raft_consensus.cc:2468] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:26:59.056970 19172 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.058645 19086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819615c6672d40979e8058dd998c1dff. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:59.058835 18842 leader_election.cc:343] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.059568 18842 leader_election.cc:343] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.038730 19185 raft_consensus.cc:515] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.062588 19185 leader_election.cc:290] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:59.062748 19172 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.063484 19151 tablet_bootstrap.cc:492] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.063993 19151 ts_tablet_manager.cc:1403] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.175s	user 0.018s	sys 0.009s
I20260709 12:26:59.064334 19026 raft_consensus.cc:2468] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:26:59.036120 19163 raft_consensus.cc:515] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.067173 18917 leader_election.cc:304] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:59.067519 18862 tablet_service.cc:1511] Processing CreateTablet for tablet bce2d9aff2e749f5b4b14a488b26a084 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:59.067866 19163 leader_election.cc:290] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:59.068442 19163 raft_consensus.cc:2804] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.068825 18862 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce2d9aff2e749f5b4b14a488b26a084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.068881 19163 raft_consensus.cc:697] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:26:59.069756 19014 tablet_service.cc:1511] Processing CreateTablet for tablet bce2d9aff2e749f5b4b14a488b26a084 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:26:59.070148 18866 tablet_service.cc:1511] Processing CreateTablet for tablet 4d55ad11d73d42569f54ef540ebedcc9 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:59.071185 19155 ts_tablet_manager.cc:1434] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.000s
I20260709 12:26:59.071278 18942 tablet_service.cc:1511] Processing CreateTablet for tablet 4d55ad11d73d42569f54ef540ebedcc9 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:26:59.072717 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.065125 19172 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:59.080824 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bce2d9aff2e749f5b4b14a488b26a084. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.081482 19151 raft_consensus.cc:359] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.082332 19151 raft_consensus.cc:385] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.082687 19151 raft_consensus.cc:740] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.083485 19151 consensus_queue.cc:260] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.069072 19145 tablet_bootstrap.cc:654] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.085224 18860 tablet_service.cc:1511] Processing CreateTablet for tablet 819615c6672d40979e8058dd998c1dff (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:59.086155 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:59.087023 18953 raft_consensus.cc:2468] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:26:59.087402 18841 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:26:59.083570 18861 tablet_service.cc:1511] Processing CreateTablet for tablet cfe17266fa484c2ebe1f408f2348126b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:59.088338 19016 tablet_service.cc:1511] Processing CreateTablet for tablet cfe17266fa484c2ebe1f408f2348126b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:59.088846 18942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d55ad11d73d42569f54ef540ebedcc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.082770 19015 tablet_service.cc:1511] Processing CreateTablet for tablet d157f6240cb74405827f910790c760e7 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:26:59.089458 18938 tablet_service.cc:1511] Processing CreateTablet for tablet cfe17266fa484c2ebe1f408f2348126b (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:26:59.089476 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe17266fa484c2ebe1f408f2348126b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.090854 18938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe17266fa484c2ebe1f408f2348126b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.092578 18866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d55ad11d73d42569f54ef540ebedcc9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.095026 19172 raft_consensus.cc:2804] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.095510 19172 raft_consensus.cc:697] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:26:59.096356 19172 consensus_queue.cc:237] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.089052 19011 tablet_service.cc:1511] Processing CreateTablet for tablet 6a522629731a40c491e370cd123e39e6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:59.098317 19155 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:59.099458 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 819615c6672d40979e8058dd998c1dff (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:26:59.100744 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819615c6672d40979e8058dd998c1dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.118723 18861 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cfe17266fa484c2ebe1f408f2348126b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.121497 19155 tablet_bootstrap.cc:654] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.123207 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.125960 18943 tablet_service.cc:1511] Processing CreateTablet for tablet 6a522629731a40c491e370cd123e39e6 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:26:59.131958 18860 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 819615c6672d40979e8058dd998c1dff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.112124 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.136161 19027 raft_consensus.cc:2468] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:26:59.137770 18842 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:26:59.140252 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:59.141528 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.142319 19026 raft_consensus.cc:2468] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:26:59.143858 18917 leader_election.cc:304] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:26:59.110864 19015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d157f6240cb74405827f910790c760e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.106639 19065 leader_election.cc:304] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:26:59.168179 19016 tablet_service.cc:1511] Processing CreateTablet for tablet 304e743b0b1c476ead5c8073437f5c1f (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:59.160604 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a522629731a40c491e370cd123e39e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.174475 19011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6a522629731a40c491e370cd123e39e6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.181208 19145 tablet_bootstrap.cc:492] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.180873 18859 tablet_service.cc:1511] Processing CreateTablet for tablet 304e743b0b1c476ead5c8073437f5c1f (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:26:59.209573 19145 ts_tablet_manager.cc:1403] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.205s	user 0.014s	sys 0.003s
I20260709 12:26:59.210155 18859 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e743b0b1c476ead5c8073437f5c1f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:59.181999 18842 leader_election.cc:343] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.186048 19188 raft_consensus.cc:2804] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.213766 19188 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.214138 19188 raft_consensus.cc:3060] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.214576 19016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304e743b0b1c476ead5c8073437f5c1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.176069 19150 raft_consensus.cc:2804] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.221594 19150 raft_consensus.cc:493] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.212765 19145 raft_consensus.cc:359] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.221982 19150 raft_consensus.cc:3060] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.222136 19145 raft_consensus.cc:385] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.222615 19145 raft_consensus.cc:740] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
W20260709 12:26:59.171340 18841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 84007.6us
I20260709 12:26:59.194931 18935 tablet_service.cc:1511] Processing CreateTablet for tablet 1590223762b24a92b589c7d9db79bb28 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:59.224097 18935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1590223762b24a92b589c7d9db79bb28. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:59.225008 18917 leader_election.cc:343] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.162012 19163 consensus_queue.cc:237] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.199297 19155 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:59.227252 18865 tablet_service.cc:1511] Processing CreateTablet for tablet 880c860fdd004c5c801a87289851b335 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:59.221251 19188 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.228204 19155 ts_tablet_manager.cc:1403] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.130s	user 0.010s	sys 0.020s
I20260709 12:26:59.228900 18865 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880c860fdd004c5c801a87289851b335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.199785 19187 raft_consensus.cc:2804] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.229626 19187 raft_consensus.cc:493] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.230060 19187 raft_consensus.cc:3060] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.230598 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:59.200968 19147 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:59.204017 18867 tablet_service.cc:1511] Processing CreateTablet for tablet 5338350bbc37481288c0046192ce133a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:59.232431 18867 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5338350bbc37481288c0046192ce133a. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:26:59.232386 18842 leader_election.cc:343] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.205663 19012 tablet_service.cc:1511] Processing CreateTablet for tablet 5338350bbc37481288c0046192ce133a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:59.234812 19012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5338350bbc37481288c0046192ce133a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.237076 19147 ts_tablet_manager.cc:1403] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.341s	user 0.021s	sys 0.028s
W20260709 12:26:59.174743 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 73287.1us
I20260709 12:26:59.207630 18868 tablet_service.cc:1511] Processing CreateTablet for tablet dacdbc9e2aed4919814e17b608ac4e19 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
W20260709 12:26:59.244454 19065 leader_election.cc:343] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.208238 19010 tablet_service.cc:1511] Processing CreateTablet for tablet 880c860fdd004c5c801a87289851b335 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:26:59.238238 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:26:59.244747 18868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacdbc9e2aed4919814e17b608ac4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.245757 19026 raft_consensus.cc:3060] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.249250 19010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 880c860fdd004c5c801a87289851b335. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.242863 19014 tablet_service.cc:1511] Processing CreateTablet for tablet 1590223762b24a92b589c7d9db79bb28 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:26:59.270305 19014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1590223762b24a92b589c7d9db79bb28. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.206681 19151 ts_tablet_manager.cc:1434] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.142s	user 0.022s	sys 0.015s
I20260709 12:26:59.276304 19151 tablet_bootstrap.cc:492] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.270460 19150 raft_consensus.cc:515] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.276892 18937 tablet_service.cc:1511] Processing CreateTablet for tablet 5338350bbc37481288c0046192ce133a (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:26:59.278388 18937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5338350bbc37481288c0046192ce133a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.278411 19150 leader_election.cc:290] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:59.284045 19026 raft_consensus.cc:2468] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:26:59.285145 19151 tablet_bootstrap.cc:654] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.285322 18842 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:26:59.281824 19145 consensus_queue.cc:260] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.270617 19188 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:26:59.271401 18761 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 47388.1us
I20260709 12:26:59.287974 18943 tablet_service.cc:1511] Processing CreateTablet for tablet dacdbc9e2aed4919814e17b608ac4e19 (DEFAULT_TABLE table=test-workload [id=5a57b9844398454cb8dc2bcc329453c9]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:26:59.289999 19147 raft_consensus.cc:359] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.295527 19147 raft_consensus.cc:385] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.295801 19147 raft_consensus.cc:740] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.296533 19147 consensus_queue.cc:260] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:26:59.304409 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 60009.6us
I20260709 12:26:59.306124 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:26:59.307675 19155 raft_consensus.cc:359] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.308439 19155 raft_consensus.cc:385] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.308727 19155 raft_consensus.cc:740] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.309265 19155 consensus_queue.cc:260] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.291785 18775 catalog_manager.cc:5697] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.311169 19192 raft_consensus.cc:2804] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.327538 19192 raft_consensus.cc:697] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:26:59.328711 19192 consensus_queue.cc:237] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.330703 19145 ts_tablet_manager.cc:1434] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.121s	user 0.008s	sys 0.003s
I20260709 12:26:59.331841 19145 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
W20260709 12:26:59.318086 19065 leader_election.cc:343] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.337126 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:59.346061 18943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dacdbc9e2aed4919814e17b608ac4e19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:59.345782 18953 raft_consensus.cc:3060] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.347733 19147 ts_tablet_manager.cc:1434] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.104s	user 0.006s	sys 0.002s
I20260709 12:26:59.349244 19187 raft_consensus.cc:515] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.390339 18774 catalog_manager.cc:5697] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.385198 19147 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:59.395521 19151 tablet_bootstrap.cc:492] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.402314 19151 ts_tablet_manager.cc:1403] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.126s	user 0.025s	sys 0.041s
I20260709 12:26:59.404961 19187 leader_election.cc:290] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:59.405263 19155 ts_tablet_manager.cc:1434] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.177s	user 0.012s	sys 0.008s
I20260709 12:26:59.406390 19155 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:59.406350 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:26:59.407068 18877 raft_consensus.cc:3060] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.408361 19151 raft_consensus.cc:359] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.409123 19151 raft_consensus.cc:385] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.409438 19151 raft_consensus.cc:740] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.409579 19145 tablet_bootstrap.cc:654] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.410602 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:26:59.410390 19151 consensus_queue.cc:260] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.411229 19026 raft_consensus.cc:3060] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.413127 19151 ts_tablet_manager.cc:1434] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:26:59.421869 19155 tablet_bootstrap.cc:654] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.401573 18953 raft_consensus.cc:2468] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:26:59.427774 19065 leader_election.cc:304] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:59.428982 19150 raft_consensus.cc:2804] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.429225 19151 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.430677 19150 raft_consensus.cc:697] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:26:59.432159 19026 raft_consensus.cc:2468] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:26:59.431926 19150 consensus_queue.cc:237] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.429008 19147 tablet_bootstrap.cc:654] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.434314 18917 leader_election.cc:304] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:26:59.435670 19187 raft_consensus.cc:2804] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.436246 19187 raft_consensus.cc:697] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:26:59.438481 19151 tablet_bootstrap.cc:654] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.437148 19187 consensus_queue.cc:237] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.440662 19186 raft_consensus.cc:493] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.441390 19186 raft_consensus.cc:515] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.449002 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50d7fdee8a244cfa677109bb9ca854a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
W20260709 12:26:59.451041 19065 leader_election.cc:343] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.458801 19151 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.459424 19151 ts_tablet_manager.cc:1403] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.008s
I20260709 12:26:59.461059 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50d7fdee8a244cfa677109bb9ca854a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.459975 19186 leader_election.cc:290] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:26:59.462415 19065 leader_election.cc:343] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.459133 18877 raft_consensus.cc:2468] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:26:59.462661 19151 raft_consensus.cc:359] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.462996 19065 leader_election.cc:304] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:59.463426 19151 raft_consensus.cc:385] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.463618 19145 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.463758 19151 raft_consensus.cc:740] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.464107 19186 raft_consensus.cc:2749] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.464673 19151 consensus_queue.cc:260] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.464151 19145 ts_tablet_manager.cc:1403] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.133s	user 0.015s	sys 0.011s
I20260709 12:26:59.467031 19151 ts_tablet_manager.cc:1434] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:59.468050 19151 tablet_bootstrap.cc:492] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.470435 19145 raft_consensus.cc:359] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.473562 19145 raft_consensus.cc:385] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.474639 19145 raft_consensus.cc:740] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.476172 19155 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:59.475811 19145 consensus_queue.cc:260] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.476717 19155 ts_tablet_manager.cc:1403] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.011s
I20260709 12:26:59.477017 19147 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:59.477540 19147 ts_tablet_manager.cc:1403] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.097s	user 0.017s	sys 0.012s
I20260709 12:26:59.479756 19155 raft_consensus.cc:359] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.480005 19147 raft_consensus.cc:359] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.480518 19155 raft_consensus.cc:385] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.480778 19147 raft_consensus.cc:385] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.480881 19155 raft_consensus.cc:740] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.481091 19145 ts_tablet_manager.cc:1434] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260709 12:26:59.481524 19147 raft_consensus.cc:740] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.483539 19145 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.484452 19151 tablet_bootstrap.cc:654] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.484071 19147 consensus_queue.cc:260] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.487450 19155 consensus_queue.cc:260] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.489714 19155 ts_tablet_manager.cc:1434] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.000s
I20260709 12:26:59.493676 19147 ts_tablet_manager.cc:1434] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.002s
I20260709 12:26:59.495061 19147 tablet_bootstrap.cc:492] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:59.495846 19145 tablet_bootstrap.cc:654] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.497853 19155 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:59.508018 19155 tablet_bootstrap.cc:654] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.515384 19151 tablet_bootstrap.cc:492] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.515887 19151 ts_tablet_manager.cc:1403] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.017s
I20260709 12:26:59.519551 19151 raft_consensus.cc:359] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.520268 19151 raft_consensus.cc:385] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.520572 19151 raft_consensus.cc:740] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.521255 19151 consensus_queue.cc:260] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.521996 19147 tablet_bootstrap.cc:654] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.523634 19151 ts_tablet_manager.cc:1434] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:26:59.524726 19151 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.524653 18773 catalog_manager.cc:5697] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.526613 18775 catalog_manager.cc:5697] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.528679 18773 catalog_manager.cc:5697] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.531782 19151 tablet_bootstrap.cc:654] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.534272 19187 raft_consensus.cc:493] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.534935 19187 raft_consensus.cc:515] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.539027 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:59.541904 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
W20260709 12:26:59.544389 18916 leader_election.cc:343] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.545819 18917 leader_election.cc:343] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.546391 18917 leader_election.cc:304] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:59.547469 19163 raft_consensus.cc:2749] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.550880 19188 consensus_queue.cc:1048] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:59.554625 19187 leader_election.cc:290] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:26:59.556260 18774 catalog_manager.cc:5697] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.573207 19147 tablet_bootstrap.cc:492] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:59.573834 19147 ts_tablet_manager.cc:1403] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.079s	user 0.043s	sys 0.012s
I20260709 12:26:59.576864 19147 raft_consensus.cc:359] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.577603 19147 raft_consensus.cc:385] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.577890 19147 raft_consensus.cc:740] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.578217 19150 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.578758 19150 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.580926 19150 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:59.583232 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.583907 19026 raft_consensus.cc:2468] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:26:59.585121 19065 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:26:59.585268 19145 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.585398 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.585939 19145 ts_tablet_manager.cc:1403] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.103s	user 0.016s	sys 0.000s
W20260709 12:26:59.586915 19065 leader_election.cc:343] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.586437 19150 raft_consensus.cc:2804] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.588317 19150 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.588766 19150 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.591642 19145 raft_consensus.cc:359] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.592404 19145 raft_consensus.cc:385] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.592665 19145 raft_consensus.cc:740] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.593364 19145 consensus_queue.cc:260] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:26:59.597126 18842 consensus_peers.cc:597] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:59.578714 19147 consensus_queue.cc:260] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.600633 19147 ts_tablet_manager.cc:1434] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:26:59.601591 19145 ts_tablet_manager.cc:1434] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.001s
I20260709 12:26:59.602602 19145 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.604295 19150 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.607115 19155 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:59.607632 19155 ts_tablet_manager.cc:1403] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.110s	user 0.005s	sys 0.023s
I20260709 12:26:59.609581 19145 tablet_bootstrap.cc:654] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.610486 19147 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:59.613121 19151 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.613951 19151 ts_tablet_manager.cc:1403] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.089s	user 0.023s	sys 0.030s
I20260709 12:26:59.616832 19150 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:59.618362 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:26:59.618415 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:26:59.619066 19026 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.619275 19147 tablet_bootstrap.cc:654] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.620440 19151 raft_consensus.cc:359] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.623594 19151 raft_consensus.cc:385] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.624065 19151 raft_consensus.cc:740] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.625087 19192 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:59.625676 19065 leader_election.cc:343] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.625806 19192 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.628348 19187 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.628445 18953 raft_consensus.cc:3060] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.628949 19187 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.630635 19192 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:26:59.631260 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.631685 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:59.632381 19100 raft_consensus.cc:2468] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:26:59.633049 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.633873 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.631654 19151 consensus_queue.cc:260] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.634850 19027 raft_consensus.cc:2393] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c6d7b700141440f8997cb5145ad80f79 in this term.
I20260709 12:26:59.631309 19187 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:59.639825 18917 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:59.641078 19187 raft_consensus.cc:3060] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.642185 19151 ts_tablet_manager.cc:1434] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.028s	user 0.002s	sys 0.006s
W20260709 12:26:59.633306 18842 leader_election.cc:343] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.643424 19151 tablet_bootstrap.cc:492] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.643339 19026 raft_consensus.cc:2468] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:26:59.644609 19065 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:59.645054 18841 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:26:59.645750 19150 raft_consensus.cc:2804] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.646092 19192 raft_consensus.cc:2804] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.646248 19150 raft_consensus.cc:697] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:26:59.646579 19192 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.647070 19192 raft_consensus.cc:3060] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.647230 19150 consensus_queue.cc:237] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.649969 19152 raft_consensus.cc:493] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.650647 19152 raft_consensus.cc:515] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.652783 19152 leader_election.cc:290] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:59.653430 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3fe50916684ab8ad38a191ae892eb2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:59.610662 19155 raft_consensus.cc:359] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.654145 19187 raft_consensus.cc:2749] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.654417 19186 consensus_queue.cc:1048] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.654268 19155 raft_consensus.cc:385] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.655352 19155 raft_consensus.cc:740] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
W20260709 12:26:59.656211 18990 leader_election.cc:343] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.656577 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3fe50916684ab8ad38a191ae892eb2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:59.657368 18952 raft_consensus.cc:2468] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:26:59.656492 19155 consensus_queue.cc:260] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.658731 18991 leader_election.cc:304] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:59.659497 19155 ts_tablet_manager.cc:1434] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 12:26:59.660009 19152 raft_consensus.cc:2804] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.660524 19152 raft_consensus.cc:493] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.661142 19152 raft_consensus.cc:3060] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.667100 18775 catalog_manager.cc:5697] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.667627 19145 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.668313 19145 ts_tablet_manager.cc:1403] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.066s	user 0.022s	sys 0.008s
I20260709 12:26:59.660560 19155 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:59.671196 19145 raft_consensus.cc:359] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.656906 19147 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:59.671847 19145 raft_consensus.cc:385] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.672212 19145 raft_consensus.cc:740] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.672397 19147 ts_tablet_manager.cc:1403] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.001s
I20260709 12:26:59.673332 19145 consensus_queue.cc:260] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.672961 19192 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.676743 19152 raft_consensus.cc:515] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.677889 19151 tablet_bootstrap.cc:654] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.688057 19150 raft_consensus.cc:493] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.684438 19155 tablet_bootstrap.cc:654] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.692430 19150 raft_consensus.cc:515] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.694664 19150 leader_election.cc:290] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:26:59.679589 19147 raft_consensus.cc:359] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.678088 19187 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.695456 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3fe50916684ab8ad38a191ae892eb2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:26:59.695642 19187 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:26:59.696918 18990 leader_election.cc:343] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.697126 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:59.697829 18953 raft_consensus.cc:2468] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:26:59.698647 19187 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:59.698895 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.699173 19147 raft_consensus.cc:385] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.699502 19147 raft_consensus.cc:740] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.699882 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:59.700125 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.701684 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3fe50916684ab8ad38a191ae892eb2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:59.702011 18916 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:59.702289 18953 raft_consensus.cc:3060] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.700188 19147 consensus_queue.cc:260] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.702817 19065 leader_election.cc:304] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:26:59.704371 19192 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:26:59.704892 19152 leader_election.cc:290] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:59.704960 19186 raft_consensus.cc:2804] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.705796 19186 raft_consensus.cc:493] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.706122 19186 raft_consensus.cc:3060] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.706971 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
W20260709 12:26:59.708652 18842 leader_election.cc:343] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.704968 19147 ts_tablet_manager.cc:1434] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.032s	user 0.009s	sys 0.000s
I20260709 12:26:59.710794 19147 tablet_bootstrap.cc:492] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:59.711333 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:26:59.712210 19100 raft_consensus.cc:3060] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.713038 19145 ts_tablet_manager.cc:1434] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.005s
I20260709 12:26:59.714011 19145 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.719682 19100 raft_consensus.cc:2468] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:26:59.721010 18841 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:26:59.722035 19187 raft_consensus.cc:2749] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.722150 19192 raft_consensus.cc:2804] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:26:59.723246 19065 leader_election.cc:343] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.724900 19192 raft_consensus.cc:697] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:26:59.726733 19145 tablet_bootstrap.cc:654] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.726787 19192 consensus_queue.cc:237] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.727864 19147 tablet_bootstrap.cc:654] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.730316 18953 raft_consensus.cc:2468] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:26:59.723176 19225 consensus_queue.cc:1048] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:59.731935 18991 leader_election.cc:304] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:59.734563 19222 raft_consensus.cc:2804] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.735090 19222 raft_consensus.cc:697] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:26:59.735046 19186 raft_consensus.cc:515] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.736264 19222 consensus_queue.cc:237] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.741222 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:26:59.741257 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:59.742062 18952 raft_consensus.cc:3060] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.744086 19186 leader_election.cc:290] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:26:59.750522 19065 leader_election.cc:343] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.755471 19145 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.756053 19145 ts_tablet_manager.cc:1403] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.003s
W20260709 12:26:59.767032 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:26:59.768977 19155 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:59.767788 18773 catalog_manager.cc:5697] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.769562 19155 ts_tablet_manager.cc:1403] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.109s	user 0.016s	sys 0.010s
W20260709 12:26:59.770267 18917 consensus_peers.cc:597] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:59.771250 19152 raft_consensus.cc:493] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.771943 19152 raft_consensus.cc:515] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.772719 19155 raft_consensus.cc:359] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.773253 19192 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.773546 19155 raft_consensus.cc:385] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.773958 19155 raft_consensus.cc:740] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.773785 19192 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.774740 19155 consensus_queue.cc:260] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.775916 19192 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:26:59.775727 19145 raft_consensus.cc:359] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.776456 19145 raft_consensus.cc:385] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.776758 19145 raft_consensus.cc:740] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.777036 19155 ts_tablet_manager.cc:1434] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:26:59.777906 18952 raft_consensus.cc:2468] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:26:59.778410 19155 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:59.779062 19145 consensus_queue.cc:260] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.779134 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:26:59.780637 19026 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:26:59.776796 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d72ded831470a830cb0f4451a480b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:59.782927 19065 leader_election.cc:304] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:26:59.784651 18842 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:26:59.784873 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:59.785204 19186 raft_consensus.cc:2804] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.786031 19151 tablet_bootstrap.cc:492] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.786487 19151 ts_tablet_manager.cc:1403] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.143s	user 0.021s	sys 0.001s
I20260709 12:26:59.774384 19152 leader_election.cc:290] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:26:59.787444 18991 leader_election.cc:343] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.787949 18841 leader_election.cc:343] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.788508 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d72ded831470a830cb0f4451a480b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:26:59.790110 19151 raft_consensus.cc:359] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.790779 19151 raft_consensus.cc:385] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.791026 19151 raft_consensus.cc:740] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.791692 19151 consensus_queue.cc:260] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.793149 19186 raft_consensus.cc:697] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:26:59.794076 19186 consensus_queue.cc:237] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.797135 19151 ts_tablet_manager.cc:1434] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:26:59.789204 18877 raft_consensus.cc:2468] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:26:59.798228 19151 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.798143 19192 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.798660 19192 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.799000 19192 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.804047 18991 leader_election.cc:304] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:26:59.805217 19222 raft_consensus.cc:2804] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.805632 19222 raft_consensus.cc:493] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.805994 19222 raft_consensus.cc:3060] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.815094 19222 raft_consensus.cc:515] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.817731 19147 tablet_bootstrap.cc:492] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:59.818270 19147 ts_tablet_manager.cc:1403] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.108s	user 0.025s	sys 0.003s
I20260709 12:26:59.822422 19222 leader_election.cc:290] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:59.823977 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d72ded831470a830cb0f4451a480b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:26:59.824837 19155 tablet_bootstrap.cc:654] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.823310 19147 raft_consensus.cc:359] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:26:59.825438 18991 leader_election.cc:343] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.825716 19147 raft_consensus.cc:385] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.826152 19147 raft_consensus.cc:740] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.824704 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d72ded831470a830cb0f4451a480b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:26:59.826970 19147 consensus_queue.cc:260] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.828545 18775 catalog_manager.cc:5697] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:59.829764 18877 raft_consensus.cc:3060] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.829996 19151 tablet_bootstrap.cc:654] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.833398 19145 ts_tablet_manager.cc:1434] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.001s
I20260709 12:26:59.834487 19145 tablet_bootstrap.cc:492] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.835963 19147 ts_tablet_manager.cc:1434] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:26:59.824028 19192 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.836997 18776 catalog_manager.cc:5697] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.837877 19187 consensus_queue.cc:1048] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.840502 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:26:59.843538 19027 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.844949 19147 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:59.841529 19192 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:26:59.841831 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:26:59.850003 19145 tablet_bootstrap.cc:654] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
W20260709 12:26:59.851202 18841 leader_election.cc:343] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.852007 19155 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:59.852721 19155 ts_tablet_manager.cc:1403] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.075s	user 0.009s	sys 0.005s
I20260709 12:26:59.854806 19147 tablet_bootstrap.cc:654] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.856225 19155 raft_consensus.cc:359] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.861124 19155 raft_consensus.cc:385] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.861594 19155 raft_consensus.cc:740] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.862566 19155 consensus_queue.cc:260] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.860455 19027 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:26:59.865392 19155 ts_tablet_manager.cc:1434] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:26:59.866928 19155 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:26:59.867945 18842 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:26:59.869048 19192 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.869554 19192 raft_consensus.cc:697] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:26:59.867980 19145 tablet_bootstrap.cc:492] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.870707 19145 ts_tablet_manager.cc:1403] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.006s
I20260709 12:26:59.870458 19192 consensus_queue.cc:237] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.874440 19145 raft_consensus.cc:359] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.875331 19145 raft_consensus.cc:385] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.875667 19145 raft_consensus.cc:740] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.876530 19145 consensus_queue.cc:260] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:26:59.877714 19186 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.880625 19186 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.881524 19151 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:26:59.881659 19145 ts_tablet_manager.cc:1434] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:26:59.881996 19151 ts_tablet_manager.cc:1403] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.002s
I20260709 12:26:59.882565 19145 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.883174 19186 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:26:59.884151 19155 tablet_bootstrap.cc:654] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.885288 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:26:59.886216 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:26:59.886945 19065 leader_election.cc:343] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:26:59.888269 19065 leader_election.cc:343] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.888675 19065 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:26:59.889775 19145 tablet_bootstrap.cc:654] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.890833 19151 raft_consensus.cc:359] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.891532 19151 raft_consensus.cc:385] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.891790 19151 raft_consensus.cc:740] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.892458 19151 consensus_queue.cc:260] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.889802 19186 raft_consensus.cc:2749] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:26:59.895569 19151 ts_tablet_manager.cc:1434] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:26:59.896957 19151 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:26:59.898206 18776 catalog_manager.cc:5697] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:59.903779 19147 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:26:59.842695 18877 raft_consensus.cc:2468] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:26:59.878849 19235 raft_consensus.cc:493] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.905654 18991 leader_election.cc:304] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:26:59.907236 19222 raft_consensus.cc:2804] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:26:59.907892 19222 raft_consensus.cc:697] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:26:59.908849 19197 consensus_queue.cc:1048] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:26:59.905687 19235 raft_consensus.cc:515] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.912801 19235 leader_election.cc:290] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:59.914885 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50d7fdee8a244cfa677109bb9ca854a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:26:59.915817 19100 raft_consensus.cc:2468] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:26:59.919051 18990 leader_election.cc:304] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:26:59.909014 19222 consensus_queue.cc:237] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:26:59.925938 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50d7fdee8a244cfa677109bb9ca854a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:26:59.927578 18991 leader_election.cc:343] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.929345 19235 raft_consensus.cc:2804] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:26:59.929996 19235 raft_consensus.cc:493] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.930466 19235 raft_consensus.cc:3060] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.904510 19147 ts_tablet_manager.cc:1403] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.060s	user 0.023s	sys 0.007s
I20260709 12:26:59.941241 19147 raft_consensus.cc:359] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.944540 19163 consensus_queue.cc:1048] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.950450 19147 raft_consensus.cc:385] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.952211 19186 consensus_queue.cc:1048] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.952786 19147 raft_consensus.cc:740] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.956763 19147 consensus_queue.cc:260] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.959960 19145 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:26:59.960465 19145 ts_tablet_manager.cc:1403] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.078s	user 0.034s	sys 0.032s
I20260709 12:26:59.961512 19235 raft_consensus.cc:515] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.963271 19145 raft_consensus.cc:359] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.963837 19235 leader_election.cc:290] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:26:59.963982 19145 raft_consensus.cc:385] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.964358 19145 raft_consensus.cc:740] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.964489 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50d7fdee8a244cfa677109bb9ca854a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:26:59.964706 19155 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:26:59.965045 19100 raft_consensus.cc:3060] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:26:59.965229 19155 ts_tablet_manager.cc:1403] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.099s	user 0.031s	sys 0.010s
I20260709 12:26:59.965067 19145 consensus_queue.cc:260] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:26:59.967844 19145 ts_tablet_manager.cc:1434] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:26:59.968689 19145 tablet_bootstrap.cc:492] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:26:59.970374 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b50d7fdee8a244cfa677109bb9ca854a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
W20260709 12:26:59.971907 18991 leader_election.cc:343] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:26:59.949991 19151 tablet_bootstrap.cc:654] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.975039 19145 tablet_bootstrap.cc:654] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:26:59.975971 19192 consensus_queue.cc:1048] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:26:59.980799 19187 consensus_queue.cc:1048] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:26:59.984143 19155 raft_consensus.cc:359] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.984790 19155 raft_consensus.cc:385] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:26:59.985060 19155 raft_consensus.cc:740] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:26:59.985757 19147 ts_tablet_manager.cc:1434] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:26:59.987299 19155 consensus_queue.cc:260] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:26:59.987807 19147 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:26:59.991420 19155 ts_tablet_manager.cc:1434] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:26:59.992262 19155 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.029944 18877 raft_consensus.cc:3060] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.030877 19100 raft_consensus.cc:2468] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:00.036412 18990 leader_election.cc:304] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.037459 19235 raft_consensus.cc:2804] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.037950 19235 raft_consensus.cc:697] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:00.038866 19235 consensus_queue.cc:237] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.045097 19147 tablet_bootstrap.cc:654] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.045639 19222 raft_consensus.cc:493] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.046326 19155 tablet_bootstrap.cc:654] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.046144 19222 raft_consensus.cc:515] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.057682 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.060415 19145 tablet_bootstrap.cc:492] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.063342 18953 raft_consensus.cc:2393] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31bb5a47c5b64d31ade62e132c3dda27 in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:00.063621 19145 ts_tablet_manager.cc:1403] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.095s	user 0.015s	sys 0.021s
I20260709 12:27:00.068089 19147 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:00.068575 19147 ts_tablet_manager.cc:1403] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.004s
I20260709 12:27:00.067955 18773 catalog_manager.cc:5697] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.069316 18876 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.070178 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1923ecfa0beb4e56a72fb14eb30fd44e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:00.071648 19226 consensus_queue.cc:1048] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.064531 19222 leader_election.cc:290] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.079769 19151 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:00.080256 19151 ts_tablet_manager.cc:1403] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.184s	user 0.013s	sys 0.002s
I20260709 12:27:00.086162 19151 raft_consensus.cc:359] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.086843 19151 raft_consensus.cc:385] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.086961 18990 leader_election.cc:304] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.087155 19151 raft_consensus.cc:740] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.089828 19151 consensus_queue.cc:260] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.090768 19222 raft_consensus.cc:3060] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.108074 19226 consensus_queue.cc:1048] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.108893 18773 catalog_manager.cc:5697] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.110191 19151 ts_tablet_manager.cc:1434] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:27:00.111194 19151 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:00.114545 19145 raft_consensus.cc:359] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.115029 19145 raft_consensus.cc:385] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.115191 19145 raft_consensus.cc:740] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.117674 19222 raft_consensus.cc:2749] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.118351 19155 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:00.118371 19145 consensus_queue.cc:260] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.118981 19155 ts_tablet_manager.cc:1403] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.127s	user 0.007s	sys 0.024s
I20260709 12:27:00.122503 19155 raft_consensus.cc:359] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.123175 19155 raft_consensus.cc:385] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.123438 19155 raft_consensus.cc:740] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.124049 19155 consensus_queue.cc:260] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.125766 19222 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.126140 19155 ts_tablet_manager.cc:1434] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:00.126250 19222 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.126617 19235 raft_consensus.cc:493] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.130959 19155 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.131138 19235 raft_consensus.cc:515] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.133816 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:00.134670 19150 consensus_queue.cc:1048] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:00.135329 18990 leader_election.cc:343] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.136874 19222 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:00.137308 19145 ts_tablet_manager.cc:1434] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260709 12:27:00.137468 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.138267 19147 raft_consensus.cc:359] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.138943 19147 raft_consensus.cc:385] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.139269 19145 tablet_bootstrap.cc:492] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.139205 19147 raft_consensus.cc:740] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.137688 19151 tablet_bootstrap.cc:654] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.142432 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:00.143309 19100 raft_consensus.cc:2393] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31bb5a47c5b64d31ade62e132c3dda27 in current term 1: Already voted for candidate c6d7b700141440f8997cb5145ad80f79 in this term.
I20260709 12:27:00.144629 18990 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.145270 19145 tablet_bootstrap.cc:654] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.146121 19222 raft_consensus.cc:3060] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.148281 19147 consensus_queue.cc:260] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.148722 19155 tablet_bootstrap.cc:654] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.150817 19145 tablet_bootstrap.cc:492] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.151291 19145 ts_tablet_manager.cc:1403] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:27:00.148540 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.154078 19145 raft_consensus.cc:359] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.154755 19145 raft_consensus.cc:385] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.154600 19152 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.155231 19145 raft_consensus.cc:740] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.155428 19152 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.156354 19147 ts_tablet_manager.cc:1434] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.084s	user 0.004s	sys 0.002s
I20260709 12:27:00.156011 19145 consensus_queue.cc:260] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:00.154448 18991 leader_election.cc:343] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.157078 18991 leader_election.cc:304] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.157786 19235 leader_election.cc:290] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:00.158701 19235 raft_consensus.cc:2749] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.161900 19192 consensus_queue.cc:1048] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.162158 19152 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.166652 19147 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:00.170219 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:00.171764 18990 leader_election.cc:343] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.180212 19155 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:00.180757 19155 ts_tablet_manager.cc:1403] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.009s
I20260709 12:27:00.182983 19151 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:00.183467 19151 ts_tablet_manager.cc:1403] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.072s	user 0.004s	sys 0.013s
I20260709 12:27:00.183787 19155 raft_consensus.cc:359] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.184540 19155 raft_consensus.cc:385] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.184846 19155 raft_consensus.cc:740] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.207238 19155 consensus_queue.cc:260] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.214970 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.209227 19186 raft_consensus.cc:493] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.215703 19222 raft_consensus.cc:2749] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.216068 19186 raft_consensus.cc:515] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:27:00.216593 18991 leader_election.cc:343] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.217094 18991 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.218262 19186 leader_election.cc:290] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.220822 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.221266 19147 tablet_bootstrap.cc:654] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.222472 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:00.226140 19065 leader_election.cc:343] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:00.227015 19065 leader_election.cc:343] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.227541 19065 leader_election.cc:304] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.228441 19253 raft_consensus.cc:493] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.229072 19222 raft_consensus.cc:2749] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.228960 19253 raft_consensus.cc:515] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.230305 19150 raft_consensus.cc:2749] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.231254 19253 leader_election.cc:290] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:00.232551 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d72ded831470a830cb0f4451a480b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:00.232601 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "556d72ded831470a830cb0f4451a480b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:00.234305 18990 consensus_peers.cc:597] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Couldn't send request to peer c7db7a43db4a4c23bcd749e49623180b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:00.234509 18876 raft_consensus.cc:2393] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate 31bb5a47c5b64d31ade62e132c3dda27 in this term.
I20260709 12:27:00.235121 19155 ts_tablet_manager.cc:1434] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.008s
I20260709 12:27:00.235764 18953 raft_consensus.cc:3060] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.239183 19151 raft_consensus.cc:359] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.239573 19145 ts_tablet_manager.cc:1434] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.088s	user 0.019s	sys 0.030s
I20260709 12:27:00.241178 19145 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.239907 19151 raft_consensus.cc:385] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.243440 19151 raft_consensus.cc:740] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.244068 18917 leader_election.cc:304] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.244237 19151 consensus_queue.cc:260] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.240074 19155 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.251576 19155 tablet_bootstrap.cc:654] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.254334 19253 raft_consensus.cc:3060] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.256143 19163 raft_consensus.cc:493] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.256687 19163 raft_consensus.cc:515] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.258844 19163 leader_election.cc:290] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.261317 19253 raft_consensus.cc:2749] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.261943 19187 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.266009 19187 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.271291 19187 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.272286 19192 consensus_queue.cc:1048] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.275768 19145 tablet_bootstrap.cc:654] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.279628 19186 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.279841 19150 consensus_queue.cc:1048] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.280159 19186 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.281749 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfebe89eac4fb0a7733f516b04b007" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:00.282249 19186 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:00.287946 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:00.288760 19025 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
W20260709 12:27:00.289043 18916 leader_election.cc:343] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.287943 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.288056 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfebe89eac4fb0a7733f516b04b007" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.290263 18951 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:00.290514 18876 raft_consensus.cc:2468] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:00.291875 18917 leader_election.cc:304] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.289155 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:00.292685 19187 raft_consensus.cc:2804] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.292719 19024 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:00.293200 19187 raft_consensus.cc:493] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.293107 18917 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:00.294035 19187 raft_consensus.cc:3060] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.294699 19253 raft_consensus.cc:2804] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.295189 19253 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.295603 19253 raft_consensus.cc:3060] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.295617 19065 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:00.287943 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:00.300391 19101 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:00.303282 19151 ts_tablet_manager.cc:1434] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.119s	user 0.007s	sys 0.003s
I20260709 12:27:00.304374 19151 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:00.303718 19187 raft_consensus.cc:515] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.319474 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfebe89eac4fb0a7733f516b04b007" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:00.320108 18876 raft_consensus.cc:3060] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.320303 18878 raft_consensus.cc:3060] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.302687 19186 raft_consensus.cc:2804] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.322345 19186 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.322697 19186 raft_consensus.cc:3060] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.323503 19263 consensus_queue.cc:1048] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.325891 19150 consensus_queue.cc:1048] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.334641 19187 leader_election.cc:290] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.335882 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfebe89eac4fb0a7733f516b04b007" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
W20260709 12:27:00.337348 18916 leader_election.cc:343] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.338413 19147 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:00.339051 19147 ts_tablet_manager.cc:1403] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.039s
I20260709 12:27:00.346439 19253 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.348197 19253 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.348997 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:00.349700 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:00.349777 19024 raft_consensus.cc:3060] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.353654 19147 raft_consensus.cc:359] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.354352 19147 raft_consensus.cc:385] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.354616 19147 raft_consensus.cc:740] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.355536 19147 consensus_queue.cc:260] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.357535 19147 ts_tablet_manager.cc:1434] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:27:00.359309 19147 tablet_bootstrap.cc:492] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:00.366513 18878 raft_consensus.cc:2468] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:00.372068 19151 tablet_bootstrap.cc:654] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.373075 18917 leader_election.cc:304] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.375855 19253 raft_consensus.cc:2804] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.376417 19253 raft_consensus.cc:697] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:00.377461 19253 consensus_queue.cc:237] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.380417 19263 consensus_queue.cc:1048] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.386169 19145 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.386898 19145 ts_tablet_manager.cc:1403] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.146s	user 0.018s	sys 0.023s
I20260709 12:27:00.388231 19147 tablet_bootstrap.cc:654] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.390893 19186 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.392584 19101 raft_consensus.cc:2393] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:00.394373 19186 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:00.398768 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:00.400730 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:00.401638 18952 raft_consensus.cc:2393] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7db7a43db4a4c23bcd749e49623180b in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:00.401958 19145 raft_consensus.cc:359] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.402710 19145 raft_consensus.cc:385] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.402999 19145 raft_consensus.cc:740] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.403676 19145 consensus_queue.cc:260] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.404462 19024 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:00.405586 19027 raft_consensus.cc:2393] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c7db7a43db4a4c23bcd749e49623180b in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:00.410415 19145 ts_tablet_manager.cc:1434] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:27:00.419710 18917 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.420718 19151 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:00.421264 19151 ts_tablet_manager.cc:1403] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.004s
I20260709 12:27:00.421615 19155 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:00.421814 19065 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:00.422137 19155 ts_tablet_manager.cc:1403] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.182s	user 0.007s	sys 0.014s
I20260709 12:27:00.423941 19163 raft_consensus.cc:2804] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.424470 19163 raft_consensus.cc:697] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:00.424873 19145 tablet_bootstrap.cc:492] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.425446 19163 consensus_queue.cc:237] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:00.429548 18841 consensus_peers.cc:597] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 -> Peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Couldn't send request to peer c7db7a43db4a4c23bcd749e49623180b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:00.429983 19155 raft_consensus.cc:359] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.430773 19155 raft_consensus.cc:385] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.431092 19155 raft_consensus.cc:740] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.432229 19155 consensus_queue.cc:260] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.432991 19145 tablet_bootstrap.cc:654] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.435030 19155 ts_tablet_manager.cc:1434] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:27:00.439481 19155 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.436086 19186 raft_consensus.cc:2749] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.445114 19192 consensus_queue.cc:1048] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.446149 19263 consensus_queue.cc:1048] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.446597 19222 raft_consensus.cc:493] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.447265 19222 raft_consensus.cc:515] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.450821 19222 leader_election.cc:290] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.436313 19151 raft_consensus.cc:359] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.454196 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27793117bd7440cb8d9d04abcb78f46" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.456305 19150 raft_consensus.cc:493] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:00.456403 18991 leader_election.cc:343] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.457008 19150 raft_consensus.cc:515] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.460278 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27793117bd7440cb8d9d04abcb78f46" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.459369 19150 leader_election.cc:290] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:00.462246 18991 leader_election.cc:343] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.462682 18991 leader_election.cc:304] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.463217 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:00.463829 19262 raft_consensus.cc:2749] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.463912 19024 raft_consensus.cc:2468] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:00.465675 19065 leader_election.cc:304] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:00.466796 19150 raft_consensus.cc:2804] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.467186 19150 raft_consensus.cc:493] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.467582 19150 raft_consensus.cc:3060] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.452315 19151 raft_consensus.cc:385] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.471104 19151 raft_consensus.cc:740] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.472474 19263 consensus_queue.cc:1048] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.465976 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:00.477579 19065 leader_election.cc:343] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.471839 19151 consensus_queue.cc:260] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.512261 19147 tablet_bootstrap.cc:492] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:00.512605 19151 ts_tablet_manager.cc:1434] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.091s	user 0.004s	sys 0.002s
I20260709 12:27:00.512887 19147 ts_tablet_manager.cc:1403] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.154s	user 0.021s	sys 0.001s
I20260709 12:27:00.514906 18878 raft_consensus.cc:3060] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.516152 19147 raft_consensus.cc:359] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.518270 18776 catalog_manager.cc:5697] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:00.521991 19155 tablet_bootstrap.cc:654] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.524086 19151 tablet_bootstrap.cc:492] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:00.527534 19150 raft_consensus.cc:515] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.530012 19150 leader_election.cc:290] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:00.534435 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:00.534523 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:00.535226 19024 raft_consensus.cc:3060] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:00.538425 19065 leader_election.cc:343] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.542857 19263 consensus_queue.cc:1048] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.549505 19024 raft_consensus.cc:2468] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:00.550962 19065 leader_election.cc:304] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.554989 19150 raft_consensus.cc:2804] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.555650 19150 raft_consensus.cc:697] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:00.557230 19145 tablet_bootstrap.cc:492] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.556937 19150 consensus_queue.cc:237] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.558425 19145 ts_tablet_manager.cc:1403] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.134s	user 0.018s	sys 0.015s
I20260709 12:27:00.562340 19186 raft_consensus.cc:493] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.562934 19186 raft_consensus.cc:515] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.563035 18776 catalog_manager.cc:5697] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.564713 19151 tablet_bootstrap.cc:654] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.517082 19147 raft_consensus.cc:385] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.567492 19147 raft_consensus.cc:740] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.567679 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f7a7f4cc40c0adcc3767c9c581df" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.568186 19147 consensus_queue.cc:260] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.570652 19147 ts_tablet_manager.cc:1434] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.001s
I20260709 12:27:00.570636 19145 raft_consensus.cc:359] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.571841 19145 raft_consensus.cc:385] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:00.572033 19065 leader_election.cc:343] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.572217 19145 raft_consensus.cc:740] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.571883 19147 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:00.573132 19145 consensus_queue.cc:260] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.575536 19145 ts_tablet_manager.cc:1434] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:27:00.577355 19145 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.578835 19186 leader_election.cc:290] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.582369 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f7a7f4cc40c0adcc3767c9c581df" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.583379 18952 raft_consensus.cc:2468] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:00.587193 19151 tablet_bootstrap.cc:492] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:00.587752 19151 ts_tablet_manager.cc:1403] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.064s	user 0.007s	sys 0.007s
I20260709 12:27:00.588447 19065 leader_election.cc:304] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.589371 19150 raft_consensus.cc:2804] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.589886 19150 raft_consensus.cc:493] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.590301 19150 raft_consensus.cc:3060] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.592521 19155 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:00.593092 19155 ts_tablet_manager.cc:1403] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.154s	user 0.016s	sys 0.012s
I20260709 12:27:00.595175 19145 tablet_bootstrap.cc:654] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.593782 18773 catalog_manager.cc:5697] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.596073 19155 raft_consensus.cc:359] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.599224 19155 raft_consensus.cc:385] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.599545 19155 raft_consensus.cc:740] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.600701 19155 consensus_queue.cc:260] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.602736 19150 raft_consensus.cc:515] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.606504 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f7a7f4cc40c0adcc3767c9c581df" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:00.612278 19147 tablet_bootstrap.cc:654] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.609483 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f7a7f4cc40c0adcc3767c9c581df" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:00.613305 18952 raft_consensus.cc:3060] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:00.613981 19065 leader_election.cc:343] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.606583 19151 raft_consensus.cc:359] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.603207 19155 ts_tablet_manager.cc:1434] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:00.622442 19151 raft_consensus.cc:385] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.609562 19150 leader_election.cc:290] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.633570 19147 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:00.641831 19186 raft_consensus.cc:493] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.656507 19147 ts_tablet_manager.cc:1403] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.085s	user 0.029s	sys 0.029s
I20260709 12:27:00.656646 19186 raft_consensus.cc:515] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.638257 19145 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.657740 19145 ts_tablet_manager.cc:1403] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.081s	user 0.025s	sys 0.020s
I20260709 12:27:00.659058 19186 leader_election.cc:290] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.655853 19151 raft_consensus.cc:740] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.660151 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3fe50916684ab8ad38a191ae892eb2" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:00.660775 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee3fe50916684ab8ad38a191ae892eb2" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.662302 19147 raft_consensus.cc:359] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.662958 19147 raft_consensus.cc:385] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.663211 19147 raft_consensus.cc:740] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.660406 19151 consensus_queue.cc:260] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.660420 19145 raft_consensus.cc:359] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.664513 19145 raft_consensus.cc:385] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.664317 19147 consensus_queue.cc:260] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.664958 19145 raft_consensus.cc:740] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.663190 19065 leader_election.cc:304] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:00.665319 19155 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.665673 19151 ts_tablet_manager.cc:1434] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.078s	user 0.008s	sys 0.001s
I20260709 12:27:00.669021 19151 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:00.666805 19150 raft_consensus.cc:2749] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.624644 18952 raft_consensus.cc:2468] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:00.666852 19147 ts_tablet_manager.cc:1434] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:00.675132 19147 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:00.674935 19065 leader_election.cc:304] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.676208 19163 raft_consensus.cc:493] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.676932 19163 raft_consensus.cc:515] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.677678 19155 tablet_bootstrap.cc:654] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.680066 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:00.681553 18917 leader_election.cc:343] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.665758 19145 consensus_queue.cc:260] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.676270 19150 raft_consensus.cc:2804] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.683516 19163 leader_election.cc:290] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:00.684453 19145 ts_tablet_manager.cc:1434] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.001s
I20260709 12:27:00.685133 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:00.686280 19151 tablet_bootstrap.cc:654] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.693946 19145 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
W20260709 12:27:00.694743 18917 leader_election.cc:343] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.695302 18917 leader_election.cc:304] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:00.686793 19147 tablet_bootstrap.cc:654] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.689247 19100 raft_consensus.cc:3060] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.692042 19155 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:00.691936 19150 raft_consensus.cc:697] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:00.700021 19145 tablet_bootstrap.cc:654] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.701579 19150 consensus_queue.cc:237] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.705626 19163 raft_consensus.cc:2749] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.706015 19155 ts_tablet_manager.cc:1403] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.041s	user 0.004s	sys 0.017s
I20260709 12:27:00.709942 19155 raft_consensus.cc:359] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.712919 19145 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.712954 19155 raft_consensus.cc:385] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.713524 19145 ts_tablet_manager.cc:1403] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.009s
I20260709 12:27:00.713984 19155 raft_consensus.cc:740] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.715224 19155 consensus_queue.cc:260] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.716559 19145 raft_consensus.cc:359] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.717875 19145 raft_consensus.cc:385] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.718158 19145 raft_consensus.cc:740] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.718822 19145 consensus_queue.cc:260] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.723425 19145 ts_tablet_manager.cc:1434] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:27:00.724311 19145 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.733006 19145 tablet_bootstrap.cc:654] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.739378 19151 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:00.739900 19151 ts_tablet_manager.cc:1403] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.071s	user 0.017s	sys 0.001s
I20260709 12:27:00.743600 19151 raft_consensus.cc:359] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.744292 19151 raft_consensus.cc:385] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.744664 19151 raft_consensus.cc:740] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.745312 18776 catalog_manager.cc:5697] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.747643 19155 ts_tablet_manager.cc:1434] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:27:00.750730 19147 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:00.751224 19147 ts_tablet_manager.cc:1403] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.034s
I20260709 12:27:00.753780 19147 raft_consensus.cc:359] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.754597 19147 raft_consensus.cc:385] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.754877 19147 raft_consensus.cc:740] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.755556 19147 consensus_queue.cc:260] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.758944 19147 ts_tablet_manager.cc:1434] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:00.759861 19147 tablet_bootstrap.cc:492] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:00.760672 19155 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.765496 19147 tablet_bootstrap.cc:654] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.766047 19263 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.766615 19263 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.768735 19263 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:00.761533 19145 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.769906 19145 ts_tablet_manager.cc:1403] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.046s	user 0.023s	sys 0.008s
I20260709 12:27:00.771130 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.771651 19155 tablet_bootstrap.cc:654] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.772447 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:00.774349 18990 leader_election.cc:343] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:00.790383 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:00.793269 19145 raft_consensus.cc:359] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.794256 19145 raft_consensus.cc:385] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.794762 19145 raft_consensus.cc:740] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.795655 19145 consensus_queue.cc:260] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.796696 19155 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:00.797209 19155 ts_tablet_manager.cc:1403] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.037s	user 0.022s	sys 0.007s
I20260709 12:27:00.800156 19155 raft_consensus.cc:359] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.800849 19155 raft_consensus.cc:385] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.801111 19155 raft_consensus.cc:740] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.801509 19145 ts_tablet_manager.cc:1434] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.004s
I20260709 12:27:00.802881 19145 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.816486 19145 tablet_bootstrap.cc:654] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.827211 19263 raft_consensus.cc:493] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.827999 19263 raft_consensus.cc:515] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.831979 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c531f84ef5f49dca1527adcd178ed3a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.832684 18951 raft_consensus.cc:2468] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:00.834115 18991 leader_election.cc:304] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:00.835019 19262 raft_consensus.cc:2804] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.835407 19262 raft_consensus.cc:493] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.835777 19262 raft_consensus.cc:3060] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.745736 19151 consensus_queue.cc:260] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.838871 19263 leader_election.cc:290] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.840766 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c531f84ef5f49dca1527adcd178ed3a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:00.842545 18990 leader_election.cc:343] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.843497 19263 raft_consensus.cc:493] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.844583 19263 raft_consensus.cc:515] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.854863 19151 ts_tablet_manager.cc:1434] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.115s	user 0.009s	sys 0.000s
I20260709 12:27:00.856297 19151 tablet_bootstrap.cc:492] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
W20260709 12:27:00.858158 18991 leader_election.cc:343] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.858815 18991 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.858088 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:00.858822 19263 leader_election.cc:290] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.859829 18951 raft_consensus.cc:2468] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:00.860762 19222 raft_consensus.cc:2749] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:00.862079 18991 leader_election.cc:304] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:00.862905 19222 raft_consensus.cc:2804] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:00.863340 19222 raft_consensus.cc:493] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.863749 19222 raft_consensus.cc:3060] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.863876 19151 tablet_bootstrap.cc:654] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.865592 19262 raft_consensus.cc:515] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.868883 19147 tablet_bootstrap.cc:492] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:00.867995 19145 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:00.869547 19147 ts_tablet_manager.cc:1403] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.110s	user 0.029s	sys 0.031s
I20260709 12:27:00.869606 19145 ts_tablet_manager.cc:1403] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.011s
I20260709 12:27:00.871508 19222 raft_consensus.cc:515] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.872747 19145 raft_consensus.cc:359] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.873433 19147 raft_consensus.cc:359] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.874718 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c531f84ef5f49dca1527adcd178ed3a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:00.875149 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c531f84ef5f49dca1527adcd178ed3a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:00.876101 18951 raft_consensus.cc:3060] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:00.877008 18990 leader_election.cc:343] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:00.875749 19145 raft_consensus.cc:385] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.877431 19155 consensus_queue.cc:260] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:00.878243 19262 leader_election.cc:290] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:00.877971 19145 raft_consensus.cc:740] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.879691 19145 consensus_queue.cc:260] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:00.882536 19253 consensus_queue.cc:1048] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:00.884289 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:00.884912 18878 raft_consensus.cc:3060] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.884989 19101 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.890656 18951 raft_consensus.cc:2468] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:00.892032 18991 leader_election.cc:304] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:00.892707 19145 ts_tablet_manager.cc:1434] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.002s
I20260709 12:27:00.893388 19262 raft_consensus.cc:2804] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.894018 19262 raft_consensus.cc:697] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:00.894699 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:00.894953 19262 consensus_queue.cc:237] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.899636 19145 tablet_bootstrap.cc:492] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:00.904542 19147 raft_consensus.cc:385] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.905004 19147 raft_consensus.cc:740] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.906311 19222 leader_election.cc:290] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:00.906965 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:00.907071 18878 raft_consensus.cc:2468] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:00.907136 19253 consensus_queue.cc:1048] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:00.907713 18951 raft_consensus.cc:3060] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.908115 19155 ts_tablet_manager.cc:1434] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.111s	user 0.018s	sys 0.004s
I20260709 12:27:00.909096 19155 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:00.905998 19147 consensus_queue.cc:260] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.915773 19147 ts_tablet_manager.cc:1434] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:27:00.916906 19147 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:00.927925 18951 raft_consensus.cc:2468] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:00.929641 19145 tablet_bootstrap.cc:654] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.935115 19147 tablet_bootstrap.cc:654] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.935896 19151 tablet_bootstrap.cc:492] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:00.936410 19151 ts_tablet_manager.cc:1403] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.080s	user 0.018s	sys 0.021s
I20260709 12:27:00.939461 19151 raft_consensus.cc:359] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.940488 19151 raft_consensus.cc:385] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:00.940780 19151 raft_consensus.cc:740] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:00.973520 19151 consensus_queue.cc:260] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:00.974555 18991 leader_election.cc:304] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:00.939486 18773 catalog_manager.cc:5697] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:00.979568 19151 ts_tablet_manager.cc:1434] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.001s
I20260709 12:27:00.982626 19151 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:00.983587 19155 tablet_bootstrap.cc:654] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:00.979036 19262 raft_consensus.cc:2804] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:00.976531 19197 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.989745 19262 raft_consensus.cc:697] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
W20260709 12:27:00.976769 18991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 45362.1us
I20260709 12:27:00.995901 19262 consensus_queue.cc:237] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:00.996724 19100 raft_consensus.cc:3060] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:00.991668 19197 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.007287 19197 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.008773 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.014400 19163 consensus_queue.cc:1048] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:01.016947 18842 leader_election.cc:343] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.024700 19186 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.025233 19186 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.026923 19150 consensus_queue.cc:1048] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.027323 19186 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:01.028406 19147 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:01.029919 19147 ts_tablet_manager.cc:1403] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.113s	user 0.019s	sys 0.030s
I20260709 12:27:01.032172 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.013612 19197 raft_consensus.cc:493] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:01.036209 19065 leader_election.cc:343] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.034567 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.048787 19155 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:01.049866 19155 ts_tablet_manager.cc:1403] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.141s	user 0.010s	sys 0.003s
I20260709 12:27:01.035861 19197 raft_consensus.cc:515] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.053789 19101 raft_consensus.cc:2468] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:01.062971 18841 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:01.063499 19197 leader_election.cc:290] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.063848 19188 raft_consensus.cc:2804] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.064287 19188 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.065917 19155 raft_consensus.cc:359] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.066828 19155 raft_consensus.cc:385] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.067160 19155 raft_consensus.cc:740] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.067968 19155 consensus_queue.cc:260] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.075148 19253 consensus_queue.cc:1048] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.076017 19310 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.075074 19151 tablet_bootstrap.cc:654] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.081696 19188 raft_consensus.cc:3060] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.043511 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.084712 19147 raft_consensus.cc:359] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.085443 19147 raft_consensus.cc:385] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.085712 19147 raft_consensus.cc:740] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.086218 19155 ts_tablet_manager.cc:1434] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.036s	user 0.007s	sys 0.006s
I20260709 12:27:01.084159 19310 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.087321 19147 consensus_queue.cc:260] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.094081 19262 raft_consensus.cc:493] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.095374 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f7a7f4cc40c0adcc3767c9c581df" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.097965 19155 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:01.094574 19262 raft_consensus.cc:515] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.101212 19262 leader_election.cc:290] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:01.104089 19147 ts_tablet_manager.cc:1434] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.001s
I20260709 12:27:01.104979 19145 tablet_bootstrap.cc:492] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:01.105531 19145 ts_tablet_manager.cc:1403] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.206s	user 0.021s	sys 0.003s
I20260709 12:27:01.089069 19027 raft_consensus.cc:2468] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:01.092968 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e029f7a7f4cc40c0adcc3767c9c581df" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.108559 19147 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:01.124471 19310 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:01.125921 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.126031 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.121027 18951 raft_consensus.cc:2393] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:01.127243 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.118273 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.118468 19065 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
W20260709 12:27:01.128796 18990 leader_election.cc:343] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.130261 19150 raft_consensus.cc:2804] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.130671 19150 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.131007 19150 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:01.138834 18916 leader_election.cc:343] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.155117 19145 raft_consensus.cc:359] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.158411 19145 raft_consensus.cc:385] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.159034 19145 raft_consensus.cc:740] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
W20260709 12:27:01.152731 18991 leader_election.cc:343] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.153245 18842 leader_election.cc:304] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
W20260709 12:27:01.167979 18917 leader_election.cc:343] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.175063 18991 leader_election.cc:304] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.179557 19145 consensus_queue.cc:260] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.187747 18917 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.215623 19155 tablet_bootstrap.cc:654] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:01.216313 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 49337.7us
I20260709 12:27:01.192457 19150 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.220212 19150 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:01.221158 19312 raft_consensus.cc:2749] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.195158 19262 raft_consensus.cc:2749] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.207887 19145 ts_tablet_manager.cc:1434] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.003s
I20260709 12:27:01.229061 19145 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:01.184327 19188 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.202184 19192 raft_consensus.cc:3060] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.213481 18773 catalog_manager.cc:5697] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:01.238016 19147 tablet_bootstrap.cc:654] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.214358 19310 raft_consensus.cc:493] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.243364 19310 raft_consensus.cc:515] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.239408 19188 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.239529 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:01.245774 18842 leader_election.cc:343] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.245942 19310 leader_election.cc:290] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:01.251281 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd349f9d1efe4b17a329506502573552" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.252086 19151 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:01.252209 19320 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.252804 19320 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.254931 19320 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:01.256033 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd349f9d1efe4b17a329506502573552" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.256445 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:01.256719 19024 raft_consensus.cc:2468] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:01.257030 19100 raft_consensus.cc:3060] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.252795 19151 ts_tablet_manager.cc:1403] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.272s	user 0.019s	sys 0.021s
I20260709 12:27:01.260139 19151 raft_consensus.cc:359] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.260787 19151 raft_consensus.cc:385] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.261047 19151 raft_consensus.cc:740] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.262753 18917 leader_election.cc:304] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:01.263861 19310 raft_consensus.cc:2804] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.264284 19310 raft_consensus.cc:493] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.264432 19222 raft_consensus.cc:493] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.264761 19310 raft_consensus.cc:3060] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.265122 19222 raft_consensus.cc:515] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.265465 19151 consensus_queue.cc:260] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.267562 19222 leader_election.cc:290] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.269637 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52337688286f416c8736cfa551d03aea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.270525 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52337688286f416c8736cfa551d03aea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:01.269599 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 136310us
W20260709 12:27:01.271256 18991 leader_election.cc:343] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:01.272187 18916 leader_election.cc:343] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:01.272349 18991 leader_election.cc:343] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.272991 18991 leader_election.cc:304] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:01.274257 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:01.275405 19222 raft_consensus.cc:2749] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.277135 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.277765 19026 raft_consensus.cc:2468] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:01.278314 18878 raft_consensus.cc:3060] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.278828 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:01.279429 19027 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.277889 19151 ts_tablet_manager.cc:1434] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:27:01.282658 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.288182 19151 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:01.290791 19027 raft_consensus.cc:2468] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:01.293936 19192 raft_consensus.cc:2749] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.294826 19100 raft_consensus.cc:2468] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
W20260709 12:27:01.297055 18990 consensus_peers.cc:597] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Couldn't send request to peer c7db7a43db4a4c23bcd749e49623180b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.298377 18841 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:01.299541 19188 raft_consensus.cc:2804] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:01.281687 19065 leader_election.cc:343] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.302980 19145 tablet_bootstrap.cc:654] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.300851 19188 raft_consensus.cc:697] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:01.309319 19188 consensus_queue.cc:237] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.312842 19321 consensus_queue.cc:1048] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:27:01.316716 19151 tablet_bootstrap.cc:654] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.327291 19155 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:01.327981 19155 ts_tablet_manager.cc:1403] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.230s	user 0.036s	sys 0.016s
I20260709 12:27:01.331373 19155 raft_consensus.cc:359] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.332074 19155 raft_consensus.cc:385] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.332352 19155 raft_consensus.cc:740] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.332530 19197 raft_consensus.cc:493] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.325227 19147 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:01.333105 19197 raft_consensus.cc:515] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.333964 19147 ts_tablet_manager.cc:1403] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.228s	user 0.021s	sys 0.013s
I20260709 12:27:01.335807 19065 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:01.333029 19155 consensus_queue.cc:260] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.340449 19155 ts_tablet_manager.cc:1434] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:01.341464 19155 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:01.342954 19186 raft_consensus.cc:2804] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.343364 19186 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.343714 19186 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.348551 19147 raft_consensus.cc:359] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.349285 19147 raft_consensus.cc:385] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.349578 19147 raft_consensus.cc:740] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.350185 19147 consensus_queue.cc:260] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.351779 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.352682 19147 ts_tablet_manager.cc:1434] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:27:01.353121 19155 tablet_bootstrap.cc:654] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.354115 19147 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:01.354517 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "815dce779e1642fd862e279f79c8a118" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.356043 18841 leader_election.cc:304] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.358073 19192 raft_consensus.cc:2749] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:01.351663 19186 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.353533 19065 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:01.359068 19197 leader_election.cc:290] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:01.372184 19222 consensus_queue.cc:1048] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:01.375553 19186 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:01.363446 19310 raft_consensus.cc:515] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.385814 19186 raft_consensus.cc:2804] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.406191 19186 raft_consensus.cc:697] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:01.408720 19145 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:01.408396 19186 consensus_queue.cc:237] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.409432 19145 ts_tablet_manager.cc:1403] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.181s	user 0.023s	sys 0.017s
I20260709 12:27:01.411495 19147 tablet_bootstrap.cc:654] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.412882 19145 raft_consensus.cc:359] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.414103 19145 raft_consensus.cc:385] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.414525 19145 raft_consensus.cc:740] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.418360 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd349f9d1efe4b17a329506502573552" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:01.419230 19027 raft_consensus.cc:3060] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.420789 19145 consensus_queue.cc:260] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.423671 19145 ts_tablet_manager.cc:1434] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:27:01.424765 19145 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:01.435153 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd349f9d1efe4b17a329506502573552" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:01.436514 19222 consensus_queue.cc:1048] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.441967 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:01.452836 19145 tablet_bootstrap.cc:654] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:01.442085 18916 leader_election.cc:343] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.454579 19024 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.457191 18774 catalog_manager.cc:5697] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.445344 19310 leader_election.cc:290] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:01.465490 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:01.468897 19151 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:01.469455 19151 ts_tablet_manager.cc:1403] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.181s	user 0.035s	sys 0.024s
I20260709 12:27:01.470839 19310 raft_consensus.cc:493] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.471338 19310 raft_consensus.cc:515] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.472899 19151 raft_consensus.cc:359] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.477569 19151 raft_consensus.cc:385] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.477705 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27793117bd7440cb8d9d04abcb78f46" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.478123 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27793117bd7440cb8d9d04abcb78f46" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.478421 19026 raft_consensus.cc:2468] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:01.476593 19310 leader_election.cc:290] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:01.479823 18917 leader_election.cc:304] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
W20260709 12:27:01.489043 18917 leader_election.cc:343] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.486028 19263 consensus_queue.cc:1048] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.477968 19151 raft_consensus.cc:740] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.491567 19151 consensus_queue.cc:260] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.497354 19151 ts_tablet_manager.cc:1434] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 12:27:01.498449 19151 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:01.492569 19027 raft_consensus.cc:2468] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:01.504186 19155 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:01.504074 18917 leader_election.cc:304] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.504675 19155 ts_tablet_manager.cc:1403] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.163s	user 0.021s	sys 0.018s
I20260709 12:27:01.495828 19310 raft_consensus.cc:2804] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.507167 19187 raft_consensus.cc:2804] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.507982 19187 raft_consensus.cc:697] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:01.508790 19187 consensus_queue.cc:237] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.510843 19151 tablet_bootstrap.cc:654] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.513140 19310 raft_consensus.cc:493] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.523038 18774 catalog_manager.cc:5697] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:01.524302 19155 raft_consensus.cc:359] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.526698 19155 raft_consensus.cc:385] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.527089 19155 raft_consensus.cc:740] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.512588 19024 raft_consensus.cc:2468] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
W20260709 12:27:01.517951 19065 leader_election.cc:343] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.529023 19155 consensus_queue.cc:260] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.525691 19263 raft_consensus.cc:493] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.527354 19310 raft_consensus.cc:3060] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.532691 19147 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:01.533180 19147 ts_tablet_manager.cc:1403] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.179s	user 0.022s	sys 0.027s
I20260709 12:27:01.536206 19147 raft_consensus.cc:359] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.536831 19147 raft_consensus.cc:385] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.537111 19147 raft_consensus.cc:740] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.537478 19329 raft_consensus.cc:493] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.537750 19147 consensus_queue.cc:260] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.538199 19329 raft_consensus.cc:515] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.539985 19147 ts_tablet_manager.cc:1434] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:01.540827 19147 tablet_bootstrap.cc:492] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
W20260709 12:27:01.542659 19065 leader_election.cc:343] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.542963 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.543678 19100 raft_consensus.cc:2468] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:01.543973 19186 consensus_queue.cc:1048] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.545704 18841 leader_election.cc:304] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:01.547107 19192 raft_consensus.cc:2804] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.547523 19192 raft_consensus.cc:493] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.547874 19192 raft_consensus.cc:3060] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.547971 19310 raft_consensus.cc:515] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.549659 19263 raft_consensus.cc:515] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.551877 19263 leader_election.cc:290] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:01.552399 19310 leader_election.cc:290] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:01.559293 19155 ts_tablet_manager.cc:1434] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 12:27:01.560658 19155 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:01.541198 19329 leader_election.cc:290] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:01.556679 19150 consensus_queue.cc:1048] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:27:01.571053 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27793117bd7440cb8d9d04abcb78f46" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:01.572573 19151 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:01.573042 19151 ts_tablet_manager.cc:1403] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.075s	user 0.008s	sys 0.006s
W20260709 12:27:01.573092 18917 leader_election.cc:343] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.573316 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68288b50f46b45328211be0d64c50c8a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.567432 19065 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:01.577294 19150 raft_consensus.cc:2804] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.577852 19150 raft_consensus.cc:697] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:01.578716 19150 consensus_queue.cc:237] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.579213 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68288b50f46b45328211be0d64c50c8a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:01.580956 18991 leader_election.cc:343] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:01.583315 18990 leader_election.cc:343] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.583810 18990 leader_election.cc:304] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.584064 19192 raft_consensus.cc:515] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.565689 19027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.585930 19263 raft_consensus.cc:2749] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.586503 19027 raft_consensus.cc:2468] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:01.589772 18775 catalog_manager.cc:5697] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.594558 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a27793117bd7440cb8d9d04abcb78f46" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:01.595258 19024 raft_consensus.cc:3060] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.604213 19151 raft_consensus.cc:359] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.605293 19151 raft_consensus.cc:385] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.605677 19151 raft_consensus.cc:740] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.614101 19145 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:01.614722 19145 ts_tablet_manager.cc:1403] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.190s	user 0.012s	sys 0.008s
I20260709 12:27:01.612553 19151 consensus_queue.cc:260] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.627148 19151 ts_tablet_manager.cc:1434] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.054s	user 0.009s	sys 0.001s
I20260709 12:27:01.627266 19147 tablet_bootstrap.cc:654] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.628449 19151 tablet_bootstrap.cc:492] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:01.646909 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:01.647676 19025 raft_consensus.cc:3060] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.650628 19145 raft_consensus.cc:359] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.651412 19145 raft_consensus.cc:385] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.651716 19145 raft_consensus.cc:740] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.652469 19145 consensus_queue.cc:260] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.653842 18776 catalog_manager.cc:5697] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.660607 19024 raft_consensus.cc:2468] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:01.662150 18917 leader_election.cc:304] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:01.664233 19310 raft_consensus.cc:2804] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.662014 19025 raft_consensus.cc:2468] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:01.667439 19155 tablet_bootstrap.cc:654] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.662274 19145 ts_tablet_manager.cc:1434] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.047s	user 0.005s	sys 0.001s
I20260709 12:27:01.670185 19151 tablet_bootstrap.cc:654] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.672700 19145 tablet_bootstrap.cc:492] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:01.664721 19310 raft_consensus.cc:697] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:01.674072 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:01.676119 19101 raft_consensus.cc:3060] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.676406 19310 consensus_queue.cc:237] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.674911 18842 leader_election.cc:304] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:01.680660 19329 raft_consensus.cc:2804] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.681121 19329 raft_consensus.cc:697] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:01.681957 19329 consensus_queue.cc:237] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.666424 19192 leader_election.cc:290] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:01.712627 19147 tablet_bootstrap.cc:492] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:01.713213 19147 ts_tablet_manager.cc:1403] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.173s	user 0.010s	sys 0.005s
I20260709 12:27:01.713526 19101 raft_consensus.cc:2468] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:01.717242 19145 tablet_bootstrap.cc:654] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.716292 19147 raft_consensus.cc:359] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.718550 19147 raft_consensus.cc:385] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.718832 19147 raft_consensus.cc:740] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.719534 19147 consensus_queue.cc:260] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.723626 19147 ts_tablet_manager.cc:1434] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:01.727381 19147 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:01.729768 18776 catalog_manager.cc:5697] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.728575 18773 catalog_manager.cc:5697] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:01.737784 19147 tablet_bootstrap.cc:654] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.749279 19151 tablet_bootstrap.cc:492] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:01.749882 19151 ts_tablet_manager.cc:1403] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.122s	user 0.009s	sys 0.008s
I20260709 12:27:01.755316 19145 tablet_bootstrap.cc:492] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:01.755991 19145 ts_tablet_manager.cc:1403] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.001s
I20260709 12:27:01.757350 19101 raft_consensus.cc:3060] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.759196 19155 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:01.758997 19145 raft_consensus.cc:359] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.759706 19145 raft_consensus.cc:385] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.759662 19155 ts_tablet_manager.cc:1403] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.199s	user 0.016s	sys 0.003s
I20260709 12:27:01.760102 19145 raft_consensus.cc:740] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.759593 19151 raft_consensus.cc:359] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.760879 19151 raft_consensus.cc:385] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.761296 19151 raft_consensus.cc:740] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.761157 19145 consensus_queue.cc:260] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.762423 19151 consensus_queue.cc:260] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.763034 19155 raft_consensus.cc:359] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.763706 19155 raft_consensus.cc:385] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.763887 19145 ts_tablet_manager.cc:1434] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:01.763967 19155 raft_consensus.cc:740] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.764674 19155 consensus_queue.cc:260] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.765789 19145 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:01.768221 19147 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:01.768697 19147 ts_tablet_manager.cc:1403] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.042s	user 0.003s	sys 0.014s
I20260709 12:27:01.770396 19186 raft_consensus.cc:493] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.770925 19186 raft_consensus.cc:515] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.771622 19147 raft_consensus.cc:359] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.772289 19147 raft_consensus.cc:385] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.772542 19147 raft_consensus.cc:740] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.772986 19145 tablet_bootstrap.cc:654] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.773195 19147 consensus_queue.cc:260] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.775348 19147 ts_tablet_manager.cc:1434] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:01.776636 19186 leader_election.cc:290] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.777110 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.777712 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.785028 18878 raft_consensus.cc:2468] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:01.785281 18952 raft_consensus.cc:2468] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:01.786697 19065 leader_election.cc:304] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:01.779482 19155 ts_tablet_manager.cc:1434] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.001s
I20260709 12:27:01.788048 19186 raft_consensus.cc:2804] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.779939 19147 tablet_bootstrap.cc:492] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:01.789055 19186 raft_consensus.cc:493] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.789219 19155 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:01.789462 19186 raft_consensus.cc:3060] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.795557 19147 tablet_bootstrap.cc:654] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.789203 19151 ts_tablet_manager.cc:1434] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.039s	user 0.009s	sys 0.000s
I20260709 12:27:01.809090 19151 tablet_bootstrap.cc:492] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:01.815274 19145 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:01.809593 19155 tablet_bootstrap.cc:654] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.816010 19145 ts_tablet_manager.cc:1403] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.050s	user 0.007s	sys 0.009s
I20260709 12:27:01.819860 18952 raft_consensus.cc:3060] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.820922 19186 raft_consensus.cc:515] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.824054 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:01.824654 18878 raft_consensus.cc:3060] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.826726 19145 raft_consensus.cc:359] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.827373 19145 raft_consensus.cc:385] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.827605 19145 raft_consensus.cc:740] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.829741 18951 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:01.829988 19329 consensus_queue.cc:1048] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.830328 19186 leader_election.cc:290] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.830478 18951 raft_consensus.cc:3060] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.832408 18878 raft_consensus.cc:2468] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:01.833642 19065 leader_election.cc:304] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:01.838822 18951 raft_consensus.cc:2468] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:01.829663 19145 consensus_queue.cc:260] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.843075 19145 ts_tablet_manager.cc:1434] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.000s
I20260709 12:27:01.844137 19145 tablet_bootstrap.cc:492] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:01.850119 19155 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:01.850478 19145 tablet_bootstrap.cc:654] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.850816 19155 ts_tablet_manager.cc:1403] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.000s
I20260709 12:27:01.854326 19151 tablet_bootstrap.cc:654] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.854552 19310 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.855087 19310 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.858202 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.859015 19025 raft_consensus.cc:2393] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:01.856715 19155 raft_consensus.cc:359] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.860769 19155 raft_consensus.cc:385] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.861316 19310 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:01.861285 19155 raft_consensus.cc:740] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.861660 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.862349 19150 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.862212 19329 consensus_queue.cc:1048] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.862833 19150 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.864084 18916 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.864905 19150 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.864095 19192 raft_consensus.cc:493] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.866348 19192 raft_consensus.cc:515] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.870633 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:01.871882 19310 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:01.873739 19065 leader_election.cc:343] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.875211 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:01.876161 19025 raft_consensus.cc:2468] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:01.880901 18842 leader_election.cc:304] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:01.869323 19192 leader_election.cc:290] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:01.882934 19329 raft_consensus.cc:2804] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.884088 19329 raft_consensus.cc:493] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.884508 19329 raft_consensus.cc:3060] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.885241 19155 consensus_queue.cc:260] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.890448 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.891119 18952 raft_consensus.cc:2468] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:01.892282 19065 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:01.893311 19320 raft_consensus.cc:2804] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:01.893704 19320 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.894018 19320 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.883581 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:01.834859 19186 raft_consensus.cc:2804] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:01.902563 18842 leader_election.cc:343] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.903861 19147 tablet_bootstrap.cc:492] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:01.904408 19147 ts_tablet_manager.cc:1403] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.128s	user 0.007s	sys 0.017s
I20260709 12:27:01.906695 19155 ts_tablet_manager.cc:1434] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260709 12:27:01.909669 19155 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:01.923334 19321 consensus_queue.cc:1048] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.923671 19320 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.902595 19186 raft_consensus.cc:697] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:01.926172 19186 consensus_queue.cc:237] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:01.929678 19329 raft_consensus.cc:515] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.935676 19329 leader_election.cc:290] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:27:01.936373 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:01.937906 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:01.938302 19320 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:01.940676 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:01.942416 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:01.943332 19024 raft_consensus.cc:3060] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.945377 19310 raft_consensus.cc:2749] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:01.949878 19065 leader_election.cc:343] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:01.951066 18842 leader_election.cc:343] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.952354 19222 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.953173 19222 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:01.946581 19147 raft_consensus.cc:359] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.954550 19147 raft_consensus.cc:385] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.958846 19147 raft_consensus.cc:740] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.959775 19147 consensus_queue.cc:260] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.955909 19145 tablet_bootstrap.cc:492] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:01.962082 19145 ts_tablet_manager.cc:1403] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.118s	user 0.047s	sys 0.059s
I20260709 12:27:01.956441 19222 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:01.956844 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:01.964375 18952 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:01.957526 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:01.967344 18991 leader_election.cc:343] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.969802 19024 raft_consensus.cc:2468] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:01.970193 19155 tablet_bootstrap.cc:654] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.975871 18842 leader_election.cc:304] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:01.976786 19329 raft_consensus.cc:2804] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.977689 19329 raft_consensus.cc:697] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:01.980051 19329 consensus_queue.cc:237] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:01.970935 19145 raft_consensus.cc:359] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.982192 19145 raft_consensus.cc:385] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.982542 19145 raft_consensus.cc:740] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.983551 19145 consensus_queue.cc:260] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:01.984206 19065 consensus_peers.cc:597] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:01.958300 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:01.973024 19147 ts_tablet_manager.cc:1434] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.002s
I20260709 12:27:01.986550 19145 ts_tablet_manager.cc:1434] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.003s
W20260709 12:27:01.987079 18990 leader_election.cc:343] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:01.987561 18990 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:01.987897 19145 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:01.987712 18952 raft_consensus.cc:2468] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:01.989042 19155 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:01.989207 19222 raft_consensus.cc:2749] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:01.990430 19147 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:01.994518 19151 tablet_bootstrap.cc:492] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:01.994813 19145 tablet_bootstrap.cc:654] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:01.995021 19151 ts_tablet_manager.cc:1403] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.015s
I20260709 12:27:01.989542 19155 ts_tablet_manager.cc:1403] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.000s
I20260709 12:27:01.989398 19065 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:01.997558 19320 raft_consensus.cc:2804] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:01.997843 19151 raft_consensus.cc:359] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.998476 19186 consensus_queue.cc:1048] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:01.998862 19151 raft_consensus.cc:385] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:01.999174 19151 raft_consensus.cc:740] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:01.985821 18776 catalog_manager.cc:5697] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:01.999933 19151 consensus_queue.cc:260] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:01.998142 19320 raft_consensus.cc:697] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:02.002211 19320 consensus_queue.cc:237] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.006580 19155 raft_consensus.cc:359] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.007217 19155 raft_consensus.cc:385] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.007480 19155 raft_consensus.cc:740] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.010375 19147 tablet_bootstrap.cc:654] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.014078 19097 raft_consensus.cc:3060] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.015919 19155 consensus_queue.cc:260] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.002660 19151 ts_tablet_manager.cc:1434] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:02.018551 19151 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:02.018656 19263 raft_consensus.cc:493] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.019338 19263 raft_consensus.cc:515] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:02.022034 19263 leader_election.cc:290] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:02.023959 19155 ts_tablet_manager.cc:1434] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 12:27:02.024912 19155 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:02.027078 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:02.028259 19151 tablet_bootstrap.cc:654] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:02.030396 18991 leader_election.cc:343] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.031483 19147 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:02.031956 19147 ts_tablet_manager.cc:1403] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.042s	user 0.008s	sys 0.002s
I20260709 12:27:02.034721 19147 raft_consensus.cc:359] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.035360 19147 raft_consensus.cc:385] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.035624 19147 raft_consensus.cc:740] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.036073 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:02.036280 19147 consensus_queue.cc:260] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.040902 19145 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:02.041332 19151 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:02.041393 19145 ts_tablet_manager.cc:1403] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.054s	user 0.007s	sys 0.014s
I20260709 12:27:02.044780 19151 ts_tablet_manager.cc:1403] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.026s	user 0.019s	sys 0.000s
I20260709 12:27:02.046577 19155 tablet_bootstrap.cc:654] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.048110 19186 consensus_queue.cc:1048] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:02.051139 18990 leader_election.cc:343] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.051797 18990 leader_election.cc:304] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:02.056198 19151 raft_consensus.cc:359] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.057868 19263 raft_consensus.cc:2749] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:02.057224 19151 raft_consensus.cc:385] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.074151 18878 raft_consensus.cc:3060] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.058849 19151 raft_consensus.cc:740] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.051937 19145 raft_consensus.cc:359] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.056041 19147 ts_tablet_manager.cc:1434] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.000s
I20260709 12:27:02.086318 19145 raft_consensus.cc:385] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.086890 19147 tablet_bootstrap.cc:492] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:02.087694 19145 raft_consensus.cc:740] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.081295 19310 consensus_queue.cc:1048] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:02.089385 19145 consensus_queue.cc:260] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.087007 19151 consensus_queue.cc:260] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.094813 19155 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:02.099359 19155 ts_tablet_manager.cc:1403] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.000s
I20260709 12:27:02.100358 19151 ts_tablet_manager.cc:1434] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.055s	user 0.007s	sys 0.001s
I20260709 12:27:02.101619 19151 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:02.102403 19310 consensus_queue.cc:1048] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:02.102041 19155 raft_consensus.cc:359] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.103343 19155 raft_consensus.cc:385] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.103641 19155 raft_consensus.cc:740] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.105608 19155 consensus_queue.cc:260] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.108604 18775 catalog_manager.cc:5697] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:02.109575 19151 tablet_bootstrap.cc:654] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.117226 19310 consensus_queue.cc:1048] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:02.127036 19322 raft_consensus.cc:493] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.127589 19369 raft_consensus.cc:493] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.127712 19322 raft_consensus.cc:515] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.128196 19369 raft_consensus.cc:515] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:02.130518 19369 leader_election.cc:290] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:02.131560 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cf4aa1eaae45588f5272617a664b12" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.132244 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2586f1cfce5848caaa69ac93ed67b9d6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:02.132494 18877 raft_consensus.cc:2468] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:02.134083 19065 leader_election.cc:304] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:02.134775 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2586f1cfce5848caaa69ac93ed67b9d6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:02.135233 19186 raft_consensus.cc:2804] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.135461 18952 raft_consensus.cc:2468] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:02.135818 19186 raft_consensus.cc:493] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.136374 19186 raft_consensus.cc:3060] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:02.134828 18990 leader_election.cc:343] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.137796 18991 leader_election.cc:304] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:02.139045 19263 raft_consensus.cc:2804] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.139421 19263 raft_consensus.cc:493] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.139761 19263 raft_consensus.cc:3060] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.141645 19145 ts_tablet_manager.cc:1434] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.097s	user 0.004s	sys 0.003s
I20260709 12:27:02.143450 19147 tablet_bootstrap.cc:654] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.145121 19322 leader_election.cc:290] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.146688 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cf4aa1eaae45588f5272617a664b12" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:02.148151 19065 leader_election.cc:343] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.151587 19263 raft_consensus.cc:515] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:02.161867 19145 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:02.178521 19155 ts_tablet_manager.cc:1434] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.079s	user 0.007s	sys 0.000s
I20260709 12:27:02.181838 19155 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:02.194912 19192 consensus_queue.cc:1048] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:02.196261 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2586f1cfce5848caaa69ac93ed67b9d6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:02.197023 18949 raft_consensus.cc:3060] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.202335 19186 raft_consensus.cc:515] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.204615 19186 leader_election.cc:290] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.220467 19187 consensus_queue.cc:1048] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:02.234094 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2586f1cfce5848caaa69ac93ed67b9d6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
W20260709 12:27:02.236013 18990 leader_election.cc:343] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.236951 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cf4aa1eaae45588f5272617a664b12" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:02.238133 19145 tablet_bootstrap.cc:654] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.229594 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cf4aa1eaae45588f5272617a664b12" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:02.239629 18877 raft_consensus.cc:3060] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:02.240296 19065 leader_election.cc:343] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.250806 18773 catalog_manager.cc:5697] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:02.240787 19263 leader_election.cc:290] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:02.348698 19322 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.349463 19322 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:02.302275 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 82850.4us
I20260709 12:27:02.374589 19369 raft_consensus.cc:493] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.375453 19369 raft_consensus.cc:515] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.386189 19375 raft_consensus.cc:493] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.387324 19375 raft_consensus.cc:515] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.398101 18878 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.430888 19186 consensus_queue.cc:1048] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:02.566210 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:02.569859 19023 raft_consensus.cc:2468] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:02.572203 19145 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:02.572428 19151 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:02.572809 19145 ts_tablet_manager.cc:1403] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.430s	user 0.025s	sys 0.032s
I20260709 12:27:02.572871 19151 ts_tablet_manager.cc:1403] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.471s	user 0.055s	sys 0.108s
I20260709 12:27:02.579447 19155 tablet_bootstrap.cc:654] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.293203 19192 consensus_queue.cc:1048] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.282s
I20260709 12:27:02.577913 19375 leader_election.cc:290] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:02.599211 19322 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:02.607057 19369 leader_election.cc:290] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.604738 19065 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:02.609047 19145 raft_consensus.cc:359] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.609989 19145 raft_consensus.cc:385] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.610328 19145 raft_consensus.cc:740] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.611392 19145 consensus_queue.cc:260] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.619247 19145 ts_tablet_manager.cc:1434] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.004s
I20260709 12:27:02.628669 19151 raft_consensus.cc:359] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.630743 19151 raft_consensus.cc:385] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.631155 19145 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:02.631126 19151 raft_consensus.cc:740] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.632086 19151 consensus_queue.cc:260] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.610622 19322 raft_consensus.cc:2804] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.637046 19151 ts_tablet_manager.cc:1434] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.064s	user 0.008s	sys 0.000s
I20260709 12:27:02.635785 19322 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.639827 19322 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.647360 19145 tablet_bootstrap.cc:654] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.659958 19155 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:02.660530 19155 ts_tablet_manager.cc:1403] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.481s	user 0.028s	sys 0.011s
I20260709 12:27:02.660810 19322 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.663395 19322 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:02.664425 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:02.665094 19025 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.666326 19145 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:02.666877 19145 ts_tablet_manager.cc:1403] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.010s
I20260709 12:27:02.666581 19155 raft_consensus.cc:359] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.667349 19155 raft_consensus.cc:385] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.666352 19369 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.667773 19155 raft_consensus.cc:740] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.667932 19369 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.669836 19145 raft_consensus.cc:359] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.670522 19145 raft_consensus.cc:385] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.670818 19145 raft_consensus.cc:740] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.670118 19369 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.671583 19145 consensus_queue.cc:260] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.673882 19145 ts_tablet_manager.cc:1434] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:02.674772 19145 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:02.675163 19188 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.675683 19188 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.677333 19155 consensus_queue.cc:260] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.677826 19025 raft_consensus.cc:2468] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:02.679171 19065 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:02.679435 19155 ts_tablet_manager.cc:1434] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:27:02.680300 19155 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:02.682418 19385 raft_consensus.cc:2804] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:02.682919 19385 raft_consensus.cc:697] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:02.683733 19385 consensus_queue.cc:237] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.687448 18874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.688601 19320 consensus_queue.cc:1048] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:02.689221 19145 tablet_bootstrap.cc:654] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.692690 19155 tablet_bootstrap.cc:654] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:02.692958 19147 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.061s	sys 0.096s
I20260709 12:27:02.699842 19151 tablet_bootstrap.cc:492] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
W20260709 12:27:02.715621 19147 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.062s	sys 0.097s
I20260709 12:27:02.701098 19145 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:02.721812 19145 ts_tablet_manager.cc:1403] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.047s	user 0.006s	sys 0.011s
I20260709 12:27:02.723858 19380 consensus_queue.cc:1048] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:02.724741 19145 raft_consensus.cc:359] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.725569 19145 raft_consensus.cc:385] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.725852 19145 raft_consensus.cc:740] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.701349 18873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
W20260709 12:27:02.705756 19065 leader_election.cc:343] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.726559 19145 consensus_queue.cc:260] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.730141 19151 tablet_bootstrap.cc:654] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:02.730342 19065 leader_election.cc:343] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.734004 19145 ts_tablet_manager.cc:1434] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:27:02.735023 19145 tablet_bootstrap.cc:492] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:02.735711 19147 tablet_bootstrap.cc:492] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:02.736209 19147 ts_tablet_manager.cc:1403] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.650s	user 0.068s	sys 0.103s
I20260709 12:27:02.740650 19145 tablet_bootstrap.cc:654] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.744719 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:02.745563 19026 raft_consensus.cc:2468] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:02.748512 19155 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:02.748998 19155 ts_tablet_manager.cc:1403] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.069s	user 0.013s	sys 0.018s
I20260709 12:27:02.749790 19147 raft_consensus.cc:359] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:02.750494 19147 raft_consensus.cc:385] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.750762 19147 raft_consensus.cc:740] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.751461 19147 consensus_queue.cc:260] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:02.753048 19155 raft_consensus.cc:359] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.753763 19155 raft_consensus.cc:385] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.754040 19155 raft_consensus.cc:740] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.755126 18917 leader_election.cc:304] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:02.756053 19188 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.756577 19376 raft_consensus.cc:2804] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.756986 19376 raft_consensus.cc:493] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.757303 19376 raft_consensus.cc:3060] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.754714 19155 consensus_queue.cc:260] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.759164 19155 ts_tablet_manager.cc:1434] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 12:27:02.760061 19155 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:02.766168 18842 consensus_peers.cc:597] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:02.767362 18952 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:02.768043 18952 raft_consensus.cc:2468] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:02.769487 18875 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.769827 18842 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:02.770910 19188 raft_consensus.cc:2804] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:02.771353 19188 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c7db7a43db4a4c23bcd749e49623180b)
I20260709 12:27:02.771785 19188 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.773373 19155 tablet_bootstrap.cc:654] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.796108 19145 tablet_bootstrap.cc:492] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:02.810438 19145 ts_tablet_manager.cc:1403] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.062s	user 0.012s	sys 0.000s
I20260709 12:27:02.816242 19147 ts_tablet_manager.cc:1434] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.079s	user 0.005s	sys 0.002s
I20260709 12:27:02.818037 19147 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:02.818846 19376 raft_consensus.cc:515] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.783887 19222 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.823179 19222 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.784699 19188 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.835830 19188 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.839269 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:02.840282 18950 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:02.841671 19375 raft_consensus.cc:493] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.842204 19375 raft_consensus.cc:515] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.843381 19222 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:02.844313 19375 leader_election.cc:290] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:27:02.848933 18841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 387402us
I20260709 12:27:02.854992 19376 leader_election.cc:290] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:02.860966 18876 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.862887 18873 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.885257 19369 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.886090 19369 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.888782 19369 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:02.906001 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.907320 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:02.910789 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
W20260709 12:27:02.913652 18877 consensus_meta.cc:287] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Time spent flushing consensus metadata: real 0.673s	user 0.015s	sys 0.006s
I20260709 12:27:02.914183 18877 raft_consensus.cc:2468] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:02.922171 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52337688286f416c8736cfa551d03aea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.923049 18872 raft_consensus.cc:2468] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
W20260709 12:27:02.926406 18991 leader_election.cc:343] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.931324 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:02.931782 18917 leader_election.cc:343] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:02.933960 18917 leader_election.cc:343] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.938532 18917 leader_election.cc:304] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:02.939962 19155 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:02.940521 19155 ts_tablet_manager.cc:1403] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.181s	user 0.018s	sys 0.000s
I20260709 12:27:02.940825 18950 raft_consensus.cc:2468] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:02.941454 19375 raft_consensus.cc:2804] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:02.943773 19375 raft_consensus.cc:493] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:02.944059 18949 consensus_meta.cc:287] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: Time spent flushing consensus metadata: real 0.746s	user 0.020s	sys 0.001s
I20260709 12:27:02.944191 19375 raft_consensus.cc:3060] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.944496 18949 raft_consensus.cc:2468] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:02.944497 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.947499 18842 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
W20260709 12:27:02.948396 18991 leader_election.cc:343] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.948702 19381 raft_consensus.cc:2804] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:02.949188 18991 leader_election.cc:304] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:02.949394 19381 raft_consensus.cc:697] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:02.950480 19381 consensus_queue.cc:237] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:02.952751 19155 raft_consensus.cc:359] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.953523 19155 raft_consensus.cc:385] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:02.959400 19155 raft_consensus.cc:740] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:02.960017 19402 raft_consensus.cc:2804] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:02.960871 19402 raft_consensus.cc:697] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:02.960939 19155 consensus_queue.cc:260] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:02.961966 19402 consensus_queue.cc:237] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:02.963400 19375 raft_consensus.cc:515] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:02.964329 19155 ts_tablet_manager.cc:1434] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:27:02.966491 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52337688286f416c8736cfa551d03aea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:02.967100 18878 raft_consensus.cc:3060] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:02.942881 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:02.976339 18878 raft_consensus.cc:2468] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:02.984414 19155 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:02.984436 18991 leader_election.cc:343] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.993515 19375 leader_election.cc:290] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:27:02.985773 18991 leader_election.cc:343] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:02.994262 18991 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:02.995059 19263 raft_consensus.cc:2749] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:02.994989 18917 leader_election.cc:304] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:02.996158 19155 tablet_bootstrap.cc:654] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:02.996680 19375 raft_consensus.cc:2804] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:02.997427 19375 raft_consensus.cc:697] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:02.998530 19375 consensus_queue.cc:237] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:03.003265 18991 leader_election.cc:343] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.004060 18991 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:03.006234 19263 raft_consensus.cc:2749] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:03.007787 18991 leader_election.cc:343] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.012450 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:03.013743 18953 raft_consensus.cc:2393] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31bb5a47c5b64d31ade62e132c3dda27 in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:03.015311 18991 leader_election.cc:304] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:03.016371 19263 raft_consensus.cc:3060] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.029543 19263 raft_consensus.cc:2749] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.042438 19155 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.043008 19155 ts_tablet_manager.cc:1403] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.013s
I20260709 12:27:03.046054 19155 raft_consensus.cc:359] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.046770 19155 raft_consensus.cc:385] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.047044 19155 raft_consensus.cc:740] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.047736 19155 consensus_queue.cc:260] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.050670 19155 ts_tablet_manager.cc:1434] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:03.051644 19155 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:03.057878 19155 tablet_bootstrap.cc:654] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.063545 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:03.069082 19155 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.069242 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.069650 19155 ts_tablet_manager.cc:1403] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260709 12:27:03.073009 19155 raft_consensus.cc:359] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.073772 19155 raft_consensus.cc:385] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.074079 19155 raft_consensus.cc:740] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.074951 19155 consensus_queue.cc:260] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.077487 19155 ts_tablet_manager.cc:1434] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:03.078444 19155 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:03.081662 19145 raft_consensus.cc:359] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.082540 19145 raft_consensus.cc:385] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.082882 19145 raft_consensus.cc:740] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.083647 19145 consensus_queue.cc:260] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.091027 19145 ts_tablet_manager.cc:1434] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.280s	user 0.009s	sys 0.000s
I20260709 12:27:03.091946 19145 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:03.098192 19321 consensus_queue.cc:1048] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.084806 19155 tablet_bootstrap.cc:654] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.097291 19151 tablet_bootstrap.cc:492] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:03.100257 19065 leader_election.cc:304] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:03.101549 19385 consensus_queue.cc:1048] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.102878 19322 raft_consensus.cc:2804] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:03.104436 19322 raft_consensus.cc:697] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:03.109011 19145 tablet_bootstrap.cc:654] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.100626 19151 ts_tablet_manager.cc:1403] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.401s	user 0.046s	sys 0.054s
I20260709 12:27:03.127282 19151 raft_consensus.cc:359] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.127997 19151 raft_consensus.cc:385] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.128269 19151 raft_consensus.cc:740] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.128458 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.128948 19151 consensus_queue.cc:260] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.122301 19155 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.130270 19155 ts_tablet_manager.cc:1403] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.052s	user 0.012s	sys 0.000s
I20260709 12:27:03.105358 19322 consensus_queue.cc:237] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.133088 19155 raft_consensus.cc:359] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.133821 19155 raft_consensus.cc:385] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.134099 19155 raft_consensus.cc:740] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.136708 19151 ts_tablet_manager.cc:1434] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:03.139005 18773 catalog_manager.cc:5697] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.140547 19151 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:03.144428 19155 consensus_queue.cc:260] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.151420 19155 ts_tablet_manager.cc:1434] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.001s
I20260709 12:27:03.151149 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52337688286f416c8736cfa551d03aea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:03.152110 19023 raft_consensus.cc:2468] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:03.155079 19145 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:03.155629 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:03.157670 19151 tablet_bootstrap.cc:654] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.155638 19145 ts_tablet_manager.cc:1403] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.064s	user 0.011s	sys 0.000s
I20260709 12:27:03.160538 19381 raft_consensus.cc:493] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.161139 19381 raft_consensus.cc:515] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.162493 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "52337688286f416c8736cfa551d03aea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:03.163160 19025 raft_consensus.cc:3060] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.165076 19145 raft_consensus.cc:359] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.165534 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:03.162081 19155 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:03.166603 18953 raft_consensus.cc:2393] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:03.123456 19147 tablet_bootstrap.cc:654] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.165850 19145 raft_consensus.cc:385] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.177618 19145 raft_consensus.cc:740] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.178368 19145 consensus_queue.cc:260] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.181070 19145 ts_tablet_manager.cc:1434] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:27:03.182065 19145 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:03.177258 19155 tablet_bootstrap.cc:654] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:03.190138 18990 leader_election.cc:343] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.190732 18990 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
W20260709 12:27:03.200124 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 99970.1us
I20260709 12:27:03.203653 19145 tablet_bootstrap.cc:654] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.224418 19150 raft_consensus.cc:493] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.224974 19150 raft_consensus.cc:515] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.226989 19150 leader_election.cc:290] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:03.206063 19402 raft_consensus.cc:2749] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.233628 18947 raft_consensus.cc:1240] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Rejecting Update request from peer c7db7a43db4a4c23bcd749e49623180b for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:03.239270 19151 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:03.239835 19151 ts_tablet_manager.cc:1403] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.001s
I20260709 12:27:03.236977 19025 raft_consensus.cc:2468] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:03.238190 19381 leader_election.cc:290] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:03.251179 19155 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.251775 19155 ts_tablet_manager.cc:1403] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.007s
I20260709 12:27:03.259456 19381 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.260237 19381 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.247138 19023 raft_consensus.cc:2468] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:03.263612 19369 raft_consensus.cc:493] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.264153 19369 raft_consensus.cc:515] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.266495 19369 leader_election.cc:290] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:03.270017 18917 leader_election.cc:304] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:03.273823 19381 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:03.276245 18875 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.278297 19376 raft_consensus.cc:2804] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:03.278882 19376 raft_consensus.cc:697] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:03.279796 19376 consensus_queue.cc:237] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.289965 19150 consensus_queue.cc:1059] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:03.304039 18774 catalog_manager.cc:5697] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.299036 19186 raft_consensus.cc:3055] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:03.320178 19151 raft_consensus.cc:359] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.322310 19151 raft_consensus.cc:385] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.322742 19151 raft_consensus.cc:740] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.323975 19408 consensus_queue.cc:1048] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:27:03.336278 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68288b50f46b45328211be0d64c50c8a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.341288 19155 raft_consensus.cc:359] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.343063 19155 raft_consensus.cc:385] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.312774 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "416fa299c26f44b69a5b04ef4d339514" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:03.343473 19155 raft_consensus.cc:740] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.339463 19151 consensus_queue.cc:260] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:03.350376 18990 leader_election.cc:343] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.351012 19155 consensus_queue.cc:260] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:27:03.354296 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:03.354532 19155 ts_tablet_manager.cc:1434] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.102s	user 0.007s	sys 0.001s
I20260709 12:27:03.355544 19155 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:03.349812 19222 raft_consensus.cc:493] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.356578 19222 raft_consensus.cc:515] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.358826 19222 leader_election.cc:290] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:03.360827 19145 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:03.361112 19155 tablet_bootstrap.cc:654] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.361685 19145 ts_tablet_manager.cc:1403] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.180s	user 0.015s	sys 0.000s
I20260709 12:27:03.321732 19186 raft_consensus.cc:740] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:03.365744 19186 consensus_queue.cc:260] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.367547 19186 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:03.361608 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:03.371613 19024 raft_consensus.cc:2393] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:03.373057 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bb9118a5c3400e9e4421d2c5f4a918" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:03.376099 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68288b50f46b45328211be0d64c50c8a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:03.376816 18878 raft_consensus.cc:2468] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:03.365734 19145 raft_consensus.cc:359] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.382411 19145 raft_consensus.cc:385] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.382774 19145 raft_consensus.cc:740] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.383651 19145 consensus_queue.cc:260] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.384789 19023 raft_consensus.cc:2393] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:03.386792 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bb9118a5c3400e9e4421d2c5f4a918" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.387157 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:03.388360 18991 leader_election.cc:343] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.390646 18991 leader_election.cc:304] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:03.391649 19402 raft_consensus.cc:2804] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:03.392097 19402 raft_consensus.cc:493] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.392503 19402 raft_consensus.cc:3060] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:03.392683 19411 log.cc:927] Time spent T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Append to log took a long time: real 0.086s	user 0.002s	sys 0.000s
I20260709 12:27:03.394685 19145 ts_tablet_manager.cc:1434] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:27:03.395776 19145 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:03.398824 19151 ts_tablet_manager.cc:1434] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.159s	user 0.005s	sys 0.003s
W20260709 12:27:03.399876 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 108334us
W20260709 12:27:03.399168 18990 leader_election.cc:343] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.400677 18990 leader_election.cc:304] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:03.399070 18842 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:03.402961 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2586f1cfce5848caaa69ac93ed67b9d6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:03.403294 19147 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:03.404516 19151 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:03.404969 19147 ts_tablet_manager.cc:1403] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.587s	user 0.039s	sys 0.107s
I20260709 12:27:03.406145 18875 raft_consensus.cc:1240] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Rejecting Update request from peer c7db7a43db4a4c23bcd749e49623180b for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:03.409890 19408 consensus_queue.cc:1048] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.412276 19369 raft_consensus.cc:2749] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.415490 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2586f1cfce5848caaa69ac93ed67b9d6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:03.416033 18842 leader_election.cc:304] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:03.416422 18953 raft_consensus.cc:2393] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7db7a43db4a4c23bcd749e49623180b in current term 1: Already voted for candidate 31bb5a47c5b64d31ade62e132c3dda27 in this term.
I20260709 12:27:03.417294 19188 raft_consensus.cc:2749] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.418022 19188 raft_consensus.cc:3060] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.424360 19147 raft_consensus.cc:359] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.425276 19402 raft_consensus.cc:515] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.426457 18772 catalog_manager.cc:5697] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.425145 19147 raft_consensus.cc:385] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.428807 19147 raft_consensus.cc:740] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.429498 19147 consensus_queue.cc:260] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.431684 19147 ts_tablet_manager.cc:1434] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.026s	user 0.005s	sys 0.000s
I20260709 12:27:03.431731 19188 raft_consensus.cc:2749] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.432742 19147 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:03.436399 19065 leader_election.cc:304] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:03.437443 19150 raft_consensus.cc:3060] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.447755 19151 tablet_bootstrap.cc:654] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.441859 19192 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.450505 19155 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.460538 19100 raft_consensus.cc:1275] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.460705 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68288b50f46b45328211be0d64c50c8a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:03.461133 19155 ts_tablet_manager.cc:1403] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.106s	user 0.008s	sys 0.005s
I20260709 12:27:03.451833 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68288b50f46b45328211be0d64c50c8a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:03.461347 18872 raft_consensus.cc:3060] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.461756 19101 raft_consensus.cc:3060] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.462427 19150 raft_consensus.cc:2749] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.463944 19155 raft_consensus.cc:359] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.464619 19155 raft_consensus.cc:385] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.464891 19155 raft_consensus.cc:740] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.465737 19155 consensus_queue.cc:260] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.468174 19145 tablet_bootstrap.cc:654] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.460624 19192 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.470314 19222 raft_consensus.cc:493] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.470979 19222 raft_consensus.cc:515] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.472043 19192 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:03.473970 19222 leader_election.cc:290] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:03.475867 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56e2ce743e6479589da5d8a3788ebb6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.478607 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:03.477495 18990 leader_election.cc:343] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.450443 19402 leader_election.cc:290] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:03.458166 19376 raft_consensus.cc:493] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.460048 19147 tablet_bootstrap.cc:654] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.481731 19155 ts_tablet_manager.cc:1434] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260709 12:27:03.484457 19155 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:03.484433 18842 leader_election.cc:343] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.486094 19375 raft_consensus.cc:493] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.486649 19375 raft_consensus.cc:515] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.483492 19380 consensus_queue.cc:1048] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:27:03.493567 19376 raft_consensus.cc:515] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.498466 19376 leader_election.cc:290] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:03.493791 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:03.499673 19023 raft_consensus.cc:2468] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:03.495668 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56e2ce743e6479589da5d8a3788ebb6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:03.503451 19099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.489382 19375 leader_election.cc:290] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:03.504755 18842 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:03.506031 19380 raft_consensus.cc:2804] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:03.505225 18776 catalog_manager.cc:5697] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.506477 19380 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.506978 19380 raft_consensus.cc:3060] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:03.508579 18916 leader_election.cc:343] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:03.510205 18991 leader_election.cc:343] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.510757 18991 leader_election.cc:304] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:03.515995 18950 raft_consensus.cc:1275] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:03.494518 19155 tablet_bootstrap.cc:654] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.508235 18776 catalog_manager.cc:5697] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.495936 18872 raft_consensus.cc:2468] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:03.495752 19101 raft_consensus.cc:2468] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:03.529598 19188 consensus_queue.cc:1048] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.532722 18990 leader_election.cc:304] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
W20260709 12:27:03.542279 19065 consensus_peers.cc:597] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:03.523567 19402 raft_consensus.cc:2749] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.533856 19222 raft_consensus.cc:2804] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:03.553558 19222 raft_consensus.cc:697] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:03.563581 19369 consensus_queue.cc:1048] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.563481 19222 consensus_queue.cc:237] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.586710 18774 catalog_manager.cc:5697] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.593052 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:03.604452 19155 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.605171 19155 ts_tablet_manager.cc:1403] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.007s
I20260709 12:27:03.605706 19151 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:03.606216 19151 ts_tablet_manager.cc:1403] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.206s	user 0.011s	sys 0.005s
I20260709 12:27:03.612145 19369 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.626032 19369 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.627368 19147 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:03.627863 19147 ts_tablet_manager.cc:1403] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.195s	user 0.024s	sys 0.019s
I20260709 12:27:03.628059 19369 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:03.602537 19402 consensus_queue.cc:1048] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:27:03.629938 19380 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.630209 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:03.634243 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.639848 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
W20260709 12:27:03.642009 18991 leader_election.cc:343] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.643764 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:03.644438 19025 raft_consensus.cc:2468] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:03.644611 19423 consensus_queue.cc:1048] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:27:03.646559 18990 leader_election.cc:343] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.647010 18990 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:03.647580 19380 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:03.651240 19147 raft_consensus.cc:359] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.651973 19147 raft_consensus.cc:385] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.652349 19147 raft_consensus.cc:740] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.652611 19145 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:03.653772 19145 ts_tablet_manager.cc:1403] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.258s	user 0.012s	sys 0.008s
I20260709 12:27:03.644678 18917 leader_election.cc:304] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:03.654628 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:03.660198 18842 leader_election.cc:343] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.659929 18774 catalog_manager.cc:5697] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.660863 19423 raft_consensus.cc:2749] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.662137 19402 raft_consensus.cc:2749] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:03.662693 19376 consensus_queue.cc:1048] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.664152 19322 consensus_queue.cc:1048] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.665658 19147 consensus_queue.cc:260] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.667300 18917 leader_election.cc:304] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:03.667865 19147 ts_tablet_manager.cc:1434] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.003s
I20260709 12:27:03.671919 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:03.674609 19376 raft_consensus.cc:2804] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:03.675082 19376 raft_consensus.cc:493] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.675417 19376 raft_consensus.cc:3060] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.675969 19147 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:03.674631 19026 raft_consensus.cc:3060] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.674589 19151 raft_consensus.cc:359] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.689587 19151 raft_consensus.cc:385] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.689872 19151 raft_consensus.cc:740] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.691485 19376 raft_consensus.cc:515] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.692162 19151 consensus_queue.cc:260] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.694290 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:03.694904 19025 raft_consensus.cc:3060] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.698249 19151 ts_tablet_manager.cc:1434] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.092s	user 0.007s	sys 0.000s
I20260709 12:27:03.699244 19151 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:03.700771 19026 raft_consensus.cc:2468] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:03.701335 19147 tablet_bootstrap.cc:654] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.701930 18842 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:03.702796 19380 raft_consensus.cc:2804] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:03.703310 19380 raft_consensus.cc:697] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:03.704183 19380 consensus_queue.cc:237] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.707495 19151 tablet_bootstrap.cc:654] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.724421 19145 raft_consensus.cc:359] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.725229 19145 raft_consensus.cc:385] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.683916 19155 raft_consensus.cc:359] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.728971 19423 consensus_queue.cc:1048] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:03.735538 19155 raft_consensus.cc:385] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.735944 19155 raft_consensus.cc:740] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.736629 19155 consensus_queue.cc:260] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.739032 19025 raft_consensus.cc:2468] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:03.740525 18917 leader_election.cc:304] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:03.743186 19423 raft_consensus.cc:2804] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:03.743923 19423 raft_consensus.cc:697] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:03.744874 19423 consensus_queue.cc:237] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.725529 19145 raft_consensus.cc:740] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.762478 19145 consensus_queue.cc:260] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.768534 19147 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:03.769600 19147 ts_tablet_manager.cc:1403] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.094s	user 0.013s	sys 0.011s
I20260709 12:27:03.772423 18775 catalog_manager.cc:5697] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:03.773851 19147 raft_consensus.cc:359] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.774617 19147 raft_consensus.cc:385] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.774853 19147 raft_consensus.cc:740] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.775563 19147 consensus_queue.cc:260] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.781877 19147 ts_tablet_manager.cc:1434] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:03.782861 19147 tablet_bootstrap.cc:492] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:03.787173 19329 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.787891 19329 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.790908 19147 tablet_bootstrap.cc:654] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.793898 18950 raft_consensus.cc:3060] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:03.803047 19147 tablet_bootstrap.cc:492] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:03.803669 19147 ts_tablet_manager.cc:1403] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.007s
I20260709 12:27:03.806777 19147 raft_consensus.cc:359] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.807577 19147 raft_consensus.cc:385] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.807955 19147 raft_consensus.cc:740] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.808974 19147 consensus_queue.cc:260] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:03.799757 19329 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:03.810974 19376 leader_election.cc:290] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:03.811895 19147 ts_tablet_manager.cc:1434] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:27:03.812911 19147 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:03.814225 19155 ts_tablet_manager.cc:1434] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.209s	user 0.007s	sys 0.000s
I20260709 12:27:03.818765 19145 ts_tablet_manager.cc:1434] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.165s	user 0.007s	sys 0.000s
I20260709 12:27:03.819211 19147 tablet_bootstrap.cc:654] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.821691 19145 tablet_bootstrap.cc:492] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
W20260709 12:27:03.822088 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 45218.3us
I20260709 12:27:03.815685 19155 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:03.830121 19147 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:03.830698 19147 ts_tablet_manager.cc:1403] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.003s
I20260709 12:27:03.831281 19151 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:03.831830 19151 ts_tablet_manager.cc:1403] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.133s	user 0.027s	sys 0.036s
I20260709 12:27:03.834198 19155 tablet_bootstrap.cc:654] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.833820 19147 raft_consensus.cc:359] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.834658 19147 raft_consensus.cc:385] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.835004 19147 raft_consensus.cc:740] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.834677 19151 raft_consensus.cc:359] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.835657 19151 raft_consensus.cc:385] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:03.836002 19151 raft_consensus.cc:740] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:03.835788 19147 consensus_queue.cc:260] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:03.836796 19151 consensus_queue.cc:260] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:27:03.897858 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 71615.7us
W20260709 12:27:03.904699 18974 debug-util.cc:398] Leaking SignalData structure 0x7b08002d5f60 after lost signal to thread 11395
I20260709 12:27:03.905115 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:03.906978 18974 debug-util.cc:398] Leaking SignalData structure 0x7b08002198a0 after lost signal to thread 18810
W20260709 12:27:03.907457 18842 leader_election.cc:343] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:03.905068 18774 catalog_manager.cc:5697] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:03.909963 18974 debug-util.cc:398] Leaking SignalData structure 0x7b0800152e00 after lost signal to thread 18902
W20260709 12:27:03.913384 18974 debug-util.cc:398] Leaking SignalData structure 0x7b0800063620 after lost signal to thread 18977
I20260709 12:27:03.927614 19310 consensus_queue.cc:1048] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:03.942845 19145 tablet_bootstrap.cc:654] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:03.944370 19151 ts_tablet_manager.cc:1434] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.112s	user 0.006s	sys 0.000s
I20260709 12:27:03.944795 19147 ts_tablet_manager.cc:1434] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.000s
I20260709 12:27:03.946403 19099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:03.947474 19099 raft_consensus.cc:2468] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:03.955929 19151 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:03.958467 18841 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:03.942551 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
W20260709 12:27:03.940285 18974 debug-util.cc:398] Leaking SignalData structure 0x7b08001f6cc0 after lost signal to thread 19051
I20260709 12:27:03.970796 19369 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.972409 18974 debug-util.cc:398] Leaking SignalData structure 0x7b0800061da0 after lost signal to thread 19125
I20260709 12:27:03.971891 19369 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.974920 19381 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.975884 19381 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:03.978349 19150 raft_consensus.cc:493] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.979300 19150 raft_consensus.cc:515] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:03.984117 19155 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:03.985237 19155 ts_tablet_manager.cc:1403] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.170s	user 0.010s	sys 0.003s
W20260709 12:27:03.991093 18916 leader_election.cc:343] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.002115 18875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bc1c45f11a44f79c80125131564f4a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:04.003171 19369 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.005596 19381 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.009179 19192 raft_consensus.cc:2804] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.009749 19192 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.010159 19147 tablet_bootstrap.cc:492] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:04.006736 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:04.008148 18841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 50001.4us
I20260709 12:27:04.013136 18875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:04.014655 18991 leader_election.cc:343] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.017947 19150 leader_election.cc:290] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.018643 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:04.019304 18991 leader_election.cc:343] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.019876 18991 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.021771 19263 raft_consensus.cc:2749] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:04.023079 18842 leader_election.cc:343] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:04.027877 19065 leader_election.cc:343] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.036422 19155 raft_consensus.cc:359] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.042920 19222 consensus_queue.cc:1048] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:04.010200 19192 raft_consensus.cc:3060] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.047341 19321 raft_consensus.cc:493] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.053423 19448 raft_consensus.cc:493] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.055421 19329 raft_consensus.cc:493] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.070778 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bc1c45f11a44f79c80125131564f4a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.105794 19321 raft_consensus.cc:515] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.123468 19321 leader_election.cc:290] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.106138 19448 raft_consensus.cc:515] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.126302 19151 tablet_bootstrap.cc:654] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.126775 19448 leader_election.cc:290] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:04.127054 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.106447 19329 raft_consensus.cc:515] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.129845 19147 tablet_bootstrap.cc:654] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.129683 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.130126 19329 leader_election.cc:290] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:04.131489 19065 leader_election.cc:343] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:04.132139 19065 leader_election.cc:343] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.132516 19065 leader_election.cc:304] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:04.133339 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.135457 18947 raft_consensus.cc:3060] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.136677 19186 raft_consensus.cc:2749] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.140816 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cf4aa1eaae45588f5272617a664b12" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:04.142256 18842 leader_election.cc:343] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.144933 19452 consensus_queue.cc:1048] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:04.150776 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.151571 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:04.152032 19025 raft_consensus.cc:2468] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:04.161003 19147 tablet_bootstrap.cc:492] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:04.161516 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54cf4aa1eaae45588f5272617a664b12" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:04.165144 18842 consensus_peers.cc:597] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:04.105772 19145 tablet_bootstrap.cc:492] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:04.171913 19145 ts_tablet_manager.cc:1403] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.350s	user 0.013s	sys 0.003s
I20260709 12:27:04.172055 18916 leader_election.cc:304] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:04.175751 19145 raft_consensus.cc:359] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.177337 19145 raft_consensus.cc:385] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.177675 19145 raft_consensus.cc:740] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.179119 18842 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
W20260709 12:27:04.179677 18841 leader_election.cc:343] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.181787 19329 raft_consensus.cc:2804] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.093605 19451 raft_consensus.cc:493] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.182257 19329 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.182309 18841 leader_election.cc:304] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:04.182813 19329 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.183423 19447 raft_consensus.cc:2749] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.107517 19155 raft_consensus.cc:385] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.178545 19145 consensus_queue.cc:260] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.184741 19155 raft_consensus.cc:740] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.185655 19155 consensus_queue.cc:260] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.187292 19145 ts_tablet_manager.cc:1434] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:27:04.188651 19155 ts_tablet_manager.cc:1434] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.195s	user 0.009s	sys 0.000s
I20260709 12:27:04.190114 19155 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:04.183073 19451 raft_consensus.cc:515] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.161583 19147 ts_tablet_manager.cc:1403] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.152s	user 0.011s	sys 0.004s
I20260709 12:27:04.198976 18950 raft_consensus.cc:2468] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:04.188679 19145 tablet_bootstrap.cc:492] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:04.202582 19065 leader_election.cc:304] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.204500 19186 raft_consensus.cc:2804] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.204878 19186 raft_consensus.cc:493] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.205191 19186 raft_consensus.cc:3060] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.205639 19329 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.207860 19147 raft_consensus.cc:359] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.211719 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:04.213326 18842 leader_election.cc:343] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.207890 19329 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.112044 19192 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.217381 19186 raft_consensus.cc:515] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.253921 19186 leader_election.cc:290] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.221594 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:04.255540 19026 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.255173 18875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bc1c45f11a44f79c80125131564f4a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:04.256469 18875 raft_consensus.cc:3060] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:04.248579 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 53544us
I20260709 12:27:04.261624 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bc1c45f11a44f79c80125131564f4a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:04.263535 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bc1c45f11a44f79c80125131564f4a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:04.264218 18949 raft_consensus.cc:3060] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.267469 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30bc1c45f11a44f79c80125131564f4a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:04.268358 19101 raft_consensus.cc:2393] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:04.270995 18916 leader_election.cc:304] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:04.218926 19147 raft_consensus.cc:385] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.271658 19147 raft_consensus.cc:740] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.274052 19147 consensus_queue.cc:260] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.277889 19423 consensus_queue.cc:1048] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:04.279431 19147 ts_tablet_manager.cc:1434] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.080s	user 0.005s	sys 0.002s
I20260709 12:27:04.238687 19451 leader_election.cc:290] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:04.246646 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:04.251259 19155 tablet_bootstrap.cc:654] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.282045 19147 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:04.282339 19100 raft_consensus.cc:3060] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.283704 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:04.285032 18842 leader_election.cc:343] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.286790 19026 raft_consensus.cc:2468] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:04.290424 19145 tablet_bootstrap.cc:654] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.289563 19192 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:04.313592 18916 consensus_peers.cc:597] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c -> Peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Couldn't send request to peer c7db7a43db4a4c23bcd749e49623180b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:04.310289 18842 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:04.330045 18875 raft_consensus.cc:2468] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.333630 19376 raft_consensus.cc:2749] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.334031 19186 raft_consensus.cc:493] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.334214 19065 leader_election.cc:304] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:04.334522 19186 raft_consensus.cc:515] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.335311 19150 raft_consensus.cc:2804] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:04.335796 19150 raft_consensus.cc:697] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:04.336695 19186 leader_election.cc:290] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:04.338732 19447 raft_consensus.cc:2804] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:04.339497 19447 raft_consensus.cc:697] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:04.341472 19454 raft_consensus.cc:493] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.340487 18875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56e2ce743e6479589da5d8a3788ebb6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:04.341972 19454 raft_consensus.cc:515] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.345359 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.344245 19454 leader_election.cc:290] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
W20260709 12:27:04.348166 18991 leader_election.cc:343] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.348313 19151 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:04.348868 19151 ts_tablet_manager.cc:1403] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.394s	user 0.018s	sys 0.007s
W20260709 12:27:04.349771 19065 leader_election.cc:343] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.347330 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56e2ce743e6479589da5d8a3788ebb6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.336697 19150 consensus_queue.cc:237] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.350634 19100 raft_consensus.cc:2468] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:04.350600 19026 raft_consensus.cc:2468] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:04.351954 19151 raft_consensus.cc:359] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.352675 19151 raft_consensus.cc:385] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.352960 19151 raft_consensus.cc:740] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.353565 19065 leader_election.cc:304] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.354600 19186 raft_consensus.cc:2804] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.356383 19186 raft_consensus.cc:493] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.357954 19186 raft_consensus.cc:3060] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.358106 19329 consensus_queue.cc:1048] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:04.360073 18841 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:04.363229 19329 raft_consensus.cc:2804] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:04.363711 19329 raft_consensus.cc:697] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:04.364619 19329 consensus_queue.cc:237] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.365681 19186 raft_consensus.cc:515] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.366027 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:04.368531 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56e2ce743e6479589da5d8a3788ebb6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:04.369141 19024 raft_consensus.cc:3060] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:04.371420 18990 leader_election.cc:343] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.371846 18990 leader_election.cc:304] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:04.373310 19402 raft_consensus.cc:2749] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.374904 18949 raft_consensus.cc:2468] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.375514 19448 raft_consensus.cc:2749] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.378870 19151 consensus_queue.cc:260] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.340407 19447 consensus_queue.cc:237] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.391566 19186 leader_election.cc:290] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:04.392386 19151 ts_tablet_manager.cc:1434] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 12:27:04.399870 19151 tablet_bootstrap.cc:492] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:04.402539 18875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f56e2ce743e6479589da5d8a3788ebb6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
W20260709 12:27:04.408735 19065 leader_election.cc:343] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.409062 19151 tablet_bootstrap.cc:654] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.414443 19147 tablet_bootstrap.cc:654] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.416291 19145 tablet_bootstrap.cc:492] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:04.416910 19145 ts_tablet_manager.cc:1403] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.229s	user 0.012s	sys 0.013s
I20260709 12:27:04.424486 19155 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:04.424934 19155 ts_tablet_manager.cc:1403] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.235s	user 0.041s	sys 0.024s
I20260709 12:27:04.429690 19145 raft_consensus.cc:359] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.431089 19145 raft_consensus.cc:385] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.431385 19145 raft_consensus.cc:740] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.437183 19145 consensus_queue.cc:260] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.454202 18774 catalog_manager.cc:5697] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.477485 19145 ts_tablet_manager.cc:1434] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.002s
I20260709 12:27:04.479480 19145 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:04.488909 19024 raft_consensus.cc:2468] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.488973 19155 raft_consensus.cc:359] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.495150 19155 raft_consensus.cc:385] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.495512 19155 raft_consensus.cc:740] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.497393 19155 consensus_queue.cc:260] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.505955 19155 ts_tablet_manager.cc:1434] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.081s	user 0.007s	sys 0.002s
I20260709 12:27:04.512810 18775 catalog_manager.cc:5697] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.519899 19065 leader_election.cc:304] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.520836 19321 raft_consensus.cc:2804] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:04.522176 19321 raft_consensus.cc:697] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:04.523327 19321 consensus_queue.cc:237] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.528813 19147 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:04.529505 19147 ts_tablet_manager.cc:1403] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.248s	user 0.028s	sys 0.015s
I20260709 12:27:04.531136 19155 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:04.531693 19376 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.532231 19376 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.534250 19376 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.534986 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:04.538404 19155 tablet_bootstrap.cc:654] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.539042 19147 raft_consensus.cc:359] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.539821 19147 raft_consensus.cc:385] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.540154 19147 raft_consensus.cc:740] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.540875 19147 consensus_queue.cc:260] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.541241 19151 tablet_bootstrap.cc:492] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:04.543712 19147 ts_tablet_manager.cc:1434] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:04.542706 19151 ts_tablet_manager.cc:1403] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.143s	user 0.011s	sys 0.002s
I20260709 12:27:04.544888 19147 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:04.545101 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.546123 19025 raft_consensus.cc:2393] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c6d7b700141440f8997cb5145ad80f79 in this term.
I20260709 12:27:04.545619 18774 catalog_manager.cc:5697] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.553483 18917 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.554775 19423 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.555629 19147 tablet_bootstrap.cc:654] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.564627 19423 raft_consensus.cc:2749] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.568689 19145 tablet_bootstrap.cc:654] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.570600 19329 raft_consensus.cc:493] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.571107 19329 raft_consensus.cc:515] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.573235 19329 leader_election.cc:290] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.575637 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:04.577535 18841 leader_election.cc:343] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.578404 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:04.583792 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 12:27:04.584548 18842 leader_election.cc:343] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.585233 18842 leader_election.cc:304] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:04.586936 19447 raft_consensus.cc:2749] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.587618 19151 raft_consensus.cc:359] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.588702 19151 raft_consensus.cc:385] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.589097 19151 raft_consensus.cc:740] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.629123 19151 consensus_queue.cc:260] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.630239 19155 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:04.630825 19155 ts_tablet_manager.cc:1403] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.100s	user 0.024s	sys 0.036s
I20260709 12:27:04.631984 18774 catalog_manager.cc:5697] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.634027 19155 raft_consensus.cc:359] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.634757 19155 raft_consensus.cc:385] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.635056 19155 raft_consensus.cc:740] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.636067 19155 consensus_queue.cc:260] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.638598 19155 ts_tablet_manager.cc:1434] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:04.639983 19155 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:04.636955 19151 ts_tablet_manager.cc:1434] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.092s	user 0.008s	sys 0.000s
I20260709 12:27:04.648277 19150 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.648643 19151 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:04.648833 19150 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.652081 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.652916 19025 raft_consensus.cc:2468] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:04.654562 19150 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:04.655823 19155 tablet_bootstrap.cc:654] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.660151 19065 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:04.661481 19150 raft_consensus.cc:2804] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.662016 19150 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.662413 19150 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.665637 18875 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:04.671037 19065 leader_election.cc:343] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.679001 19147 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:04.679632 19147 ts_tablet_manager.cc:1403] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.135s	user 0.010s	sys 0.037s
I20260709 12:27:04.685205 19147 raft_consensus.cc:359] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.687181 19147 raft_consensus.cc:385] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.687487 19147 raft_consensus.cc:740] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.699052 19150 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.700143 19321 raft_consensus.cc:493] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.700680 19321 raft_consensus.cc:515] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.701149 19150 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:04.706835 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:04.707499 19025 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.704273 19147 consensus_queue.cc:260] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.712813 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:04.715044 19151 tablet_bootstrap.cc:654] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:04.716449 19065 leader_election.cc:343] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.717499 19147 ts_tablet_manager.cc:1434] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:27:04.717676 19321 leader_election.cc:290] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.718690 19147 tablet_bootstrap.cc:492] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:04.722919 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bb9118a5c3400e9e4421d2c5f4a918" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.723143 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bb9118a5c3400e9e4421d2c5f4a918" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.723677 18947 raft_consensus.cc:2468] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:04.723925 19024 raft_consensus.cc:2468] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:04.725901 19145 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:04.726533 19025 raft_consensus.cc:2468] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.730587 19145 ts_tablet_manager.cc:1403] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.251s	user 0.013s	sys 0.028s
I20260709 12:27:04.733876 19145 raft_consensus.cc:359] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.734529 19145 raft_consensus.cc:385] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.734799 19145 raft_consensus.cc:740] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.735456 19145 consensus_queue.cc:260] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.738286 19065 leader_election.cc:304] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:04.739431 19065 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.740011 19150 raft_consensus.cc:2804] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:04.740476 19150 raft_consensus.cc:697] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:04.745198 19155 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:04.745815 19155 ts_tablet_manager.cc:1403] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.106s	user 0.034s	sys 0.034s
I20260709 12:27:04.743499 19321 raft_consensus.cc:2804] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.748497 19155 raft_consensus.cc:359] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.748852 19321 raft_consensus.cc:493] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.749208 19155 raft_consensus.cc:385] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.749629 19321 raft_consensus.cc:3060] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.749657 19155 raft_consensus.cc:740] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.750619 19155 consensus_queue.cc:260] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.741371 19150 consensus_queue.cc:237] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.758035 19155 ts_tablet_manager.cc:1434] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 12:27:04.759330 19155 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:04.759709 19145 ts_tablet_manager.cc:1434] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:27:04.760797 19145 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:04.766649 19155 tablet_bootstrap.cc:654] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.768970 19186 raft_consensus.cc:493] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.769531 19186 raft_consensus.cc:515] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.771530 19186 leader_election.cc:290] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.780431 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.771063 19321 raft_consensus.cc:515] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.782840 18773 catalog_manager.cc:5697] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:04.784806 19321 leader_election.cc:290] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.782862 19147 tablet_bootstrap.cc:654] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.787786 19186 consensus_queue.cc:1048] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:04.791383 19065 leader_election.cc:343] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.791236 19454 raft_consensus.cc:493] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.780427 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:04.792606 19454 raft_consensus.cc:515] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.793795 18872 raft_consensus.cc:2468] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:04.794333 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bb9118a5c3400e9e4421d2c5f4a918" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:04.794974 18947 raft_consensus.cc:3060] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.796291 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:04.792869 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "54bb9118a5c3400e9e4421d2c5f4a918" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
W20260709 12:27:04.797674 18991 leader_election.cc:343] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.797677 19025 raft_consensus.cc:3060] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.799675 19454 leader_election.cc:290] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.800482 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:04.802433 18991 leader_election.cc:343] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.802865 18991 leader_election.cc:304] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:04.803627 19454 raft_consensus.cc:2749] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:04.807662 19155 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:04.808267 19155 ts_tablet_manager.cc:1403] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.049s	user 0.012s	sys 0.011s
I20260709 12:27:04.810396 19065 leader_election.cc:304] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:04.811205 19155 raft_consensus.cc:359] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.811480 19025 raft_consensus.cc:2468] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.811959 19145 tablet_bootstrap.cc:654] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.812029 19155 raft_consensus.cc:385] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.813773 19186 raft_consensus.cc:2804] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.815601 19186 raft_consensus.cc:493] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.815944 19186 raft_consensus.cc:3060] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.815279 19155 raft_consensus.cc:740] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.817653 19155 consensus_queue.cc:260] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.820466 19192 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.820986 19155 ts_tablet_manager.cc:1434] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:04.822559 19151 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:04.823022 19155 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:04.823210 19151 ts_tablet_manager.cc:1403] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.175s	user 0.010s	sys 0.003s
I20260709 12:27:04.821100 19192 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.828470 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.830233 19155 tablet_bootstrap.cc:654] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:04.830361 18842 leader_election.cc:343] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.832814 19192 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.833942 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:04.834890 19024 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:04.837487 18842 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:04.814752 18947 raft_consensus.cc:2468] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.840626 19192 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.841182 19192 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.841674 19192 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.851032 19145 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:04.851912 19151 raft_consensus.cc:359] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.854313 19186 raft_consensus.cc:515] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:27:04.856179 18842 consensus_peers.cc:597] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:04.874532 19186 leader_election.cc:290] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:04.855342 19145 ts_tablet_manager.cc:1403] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.095s	user 0.013s	sys 0.000s
I20260709 12:27:04.877991 19147 tablet_bootstrap.cc:492] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:04.878520 19147 ts_tablet_manager.cc:1403] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.160s	user 0.028s	sys 0.029s
I20260709 12:27:04.880297 19329 consensus_queue.cc:1048] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:04.881246 19147 raft_consensus.cc:359] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.882009 19147 raft_consensus.cc:385] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.882330 19147 raft_consensus.cc:740] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.882992 19147 consensus_queue.cc:260] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.885591 19147 ts_tablet_manager.cc:1434] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:04.889196 19147 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:04.895442 19147 tablet_bootstrap.cc:654] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:04.881071 19145 raft_consensus.cc:359] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.870872 19402 raft_consensus.cc:493] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.897730 19192 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:04.916054 19402 raft_consensus.cc:515] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:04.916846 19147 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:04.917479 19147 ts_tablet_manager.cc:1403] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.005s
I20260709 12:27:04.918274 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:04.919586 18842 leader_election.cc:343] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.912950 19380 consensus_queue.cc:1048] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:04.920452 19147 raft_consensus.cc:359] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.921154 19147 raft_consensus.cc:385] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.921471 19147 raft_consensus.cc:740] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.922633 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:04.923822 19025 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.924111 19402 leader_election.cc:290] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:04.923902 19147 consensus_queue.cc:260] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.926443 19147 ts_tablet_manager.cc:1434] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:04.927449 19147 tablet_bootstrap.cc:492] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:04.872642 19151 raft_consensus.cc:385] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.929003 19151 raft_consensus.cc:740] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.929962 19151 consensus_queue.cc:260] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.932300 19151 ts_tablet_manager.cc:1434] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.109s	user 0.007s	sys 0.000s
I20260709 12:27:04.927331 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:04.932932 19101 raft_consensus.cc:2468] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:04.935624 18990 leader_election.cc:304] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:04.936514 19402 raft_consensus.cc:2804] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:04.936900 19402 raft_consensus.cc:493] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.937244 19402 raft_consensus.cc:3060] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.945232 19147 tablet_bootstrap.cc:654] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:04.857914 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 46356.4us
I20260709 12:27:04.950582 19145 raft_consensus.cc:385] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:04.951102 19145 raft_consensus.cc:740] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:04.949328 19380 consensus_queue.cc:1048] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:27:04.965696 18950 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:04.966256 18875 raft_consensus.cc:3060] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.966861 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:04.967440 18878 raft_consensus.cc:3060] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:04.953114 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:04.962826 19145 consensus_queue.cc:260] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:04.971827 19151 tablet_bootstrap.cc:492] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
W20260709 12:27:04.974018 18991 leader_election.cc:343] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.975560 19448 raft_consensus.cc:493] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.976094 19448 raft_consensus.cc:515] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:04.979000 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:04.980719 19145 ts_tablet_manager.cc:1434] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
W20260709 12:27:04.980832 18916 leader_election.cc:343] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:04.981877 19145 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:04.985064 18878 raft_consensus.cc:2468] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:04.922719 19192 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:04.993137 19448 leader_election.cc:290] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:05.005501 19402 raft_consensus.cc:515] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.008527 19151 tablet_bootstrap.cc:654] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.011931 19150 consensus_queue.cc:1048] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.012099 19065 leader_election.cc:304] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:05.013152 19186 raft_consensus.cc:2804] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.013577 19186 raft_consensus.cc:697] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:05.014151 19186 consensus_queue.cc:237] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.014921 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:05.015280 19065 leader_election.cc:304] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:05.015792 18878 raft_consensus.cc:2468] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:05.016005 19150 raft_consensus.cc:2804] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.027932 18917 leader_election.cc:304] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.029922 19376 raft_consensus.cc:2804] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:05.030434 19376 raft_consensus.cc:493] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.030884 19376 raft_consensus.cc:3060] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.016623 19025 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
W20260709 12:27:05.059343 19065 leader_election.cc:343] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.063045 19186 raft_consensus.cc:493] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.063644 19186 raft_consensus.cc:515] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.066015 19186 leader_election.cc:290] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:05.066720 19186 consensus_queue.cc:1048] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.074415 19155 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:05.075166 19155 ts_tablet_manager.cc:1403] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.252s	user 0.049s	sys 0.077s
I20260709 12:27:05.083544 19150 raft_consensus.cc:697] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:05.087961 19380 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.088451 19380 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.085040 19150 consensus_queue.cc:237] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.091091 19402 leader_election.cc:290] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:05.095041 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:05.103253 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:05.103930 19380 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:05.104040 19098 raft_consensus.cc:3060] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:05.111522 18991 leader_election.cc:343] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.083125 18842 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:05.113101 19447 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.113656 19447 raft_consensus.cc:697] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:05.114632 19447 consensus_queue.cc:237] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.118235 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:05.119355 19021 raft_consensus.cc:2393] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:05.098620 19491 raft_consensus.cc:493] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.136540 19145 tablet_bootstrap.cc:654] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.137488 19155 raft_consensus.cc:359] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.155824 19155 raft_consensus.cc:385] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.156133 19155 raft_consensus.cc:740] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.156872 19155 consensus_queue.cc:260] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.139295 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce2d9aff2e749f5b4b14a488b26a084" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:05.143349 19491 raft_consensus.cc:515] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.126689 19376 raft_consensus.cc:515] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.148978 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:05.149689 19147 tablet_bootstrap.cc:492] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
W20260709 12:27:05.160331 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 77474.8us
I20260709 12:27:05.160759 19147 ts_tablet_manager.cc:1403] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.234s	user 0.021s	sys 0.020s
I20260709 12:27:05.162704 19155 ts_tablet_manager.cc:1434] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260709 12:27:05.171392 19021 raft_consensus.cc:2468] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:05.184140 19155 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:05.184535 19151 tablet_bootstrap.cc:492] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:05.185202 19151 ts_tablet_manager.cc:1403] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.214s	user 0.029s	sys 0.018s
I20260709 12:27:05.188987 19151 raft_consensus.cc:359] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.189955 19151 raft_consensus.cc:385] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.190297 19151 raft_consensus.cc:740] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.191083 19151 consensus_queue.cc:260] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.199460 19150 consensus_queue.cc:1048] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:05.209496 19376 leader_election.cc:290] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:05.212105 19065 leader_election.cc:304] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:05.217790 19150 raft_consensus.cc:2804] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:05.218356 19150 raft_consensus.cc:493] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.218778 19150 raft_consensus.cc:3060] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:05.227862 18841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 55654.3us
I20260709 12:27:05.229692 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce2d9aff2e749f5b4b14a488b26a084" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:05.233505 19098 raft_consensus.cc:2468] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:05.237485 18990 leader_election.cc:304] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:05.240964 19155 tablet_bootstrap.cc:654] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.241562 19151 ts_tablet_manager.cc:1434] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.056s	user 0.008s	sys 0.001s
I20260709 12:27:05.243667 18878 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:05.244784 18878 raft_consensus.cc:3060] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.269273 18841 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.242233 19454 raft_consensus.cc:2804] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:05.275676 19065 leader_election.cc:343] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.282881 19192 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.286562 19145 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:05.287154 19145 ts_tablet_manager.cc:1403] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.305s	user 0.029s	sys 0.024s
I20260709 12:27:05.291078 18878 raft_consensus.cc:2468] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:05.292075 19151 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:05.295888 19454 raft_consensus.cc:697] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:05.304569 19145 raft_consensus.cc:359] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.305390 19145 raft_consensus.cc:385] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.308526 19145 raft_consensus.cc:740] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.309279 19145 consensus_queue.cc:260] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.298794 19147 raft_consensus.cc:359] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.326926 19147 raft_consensus.cc:385] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.327344 19147 raft_consensus.cc:740] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.335362 19147 consensus_queue.cc:260] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.341533 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:05.305698 19454 consensus_queue.cc:237] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:05.354372 19065 leader_election.cc:343] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.349709 19150 raft_consensus.cc:515] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.366204 19448 raft_consensus.cc:493] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.366746 19448 raft_consensus.cc:515] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.368852 19448 leader_election.cc:290] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:05.370851 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:05.380259 19192 raft_consensus.cc:2749] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.384248 19150 leader_election.cc:290] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:05.385347 19145 ts_tablet_manager.cc:1434] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.098s	user 0.032s	sys 0.007s
I20260709 12:27:05.409075 19145 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
W20260709 12:27:05.387262 18916 leader_election.cc:343] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.387737 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:05.390009 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c795e825a66b48189a7397f6c172a621" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:05.413915 19100 raft_consensus.cc:2393] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate 31bb5a47c5b64d31ade62e132c3dda27 in this term.
I20260709 12:27:05.392812 19151 tablet_bootstrap.cc:654] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.394580 19447 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.415393 19145 tablet_bootstrap.cc:654] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.415489 19447 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.416501 18917 leader_election.cc:304] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.417762 19447 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:05.418604 19423 raft_consensus.cc:2804] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.419101 19423 raft_consensus.cc:697] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:05.419929 19423 consensus_queue.cc:237] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.363758 19491 leader_election.cc:290] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:05.401072 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce2d9aff2e749f5b4b14a488b26a084" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:05.403829 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:05.404181 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce2d9aff2e749f5b4b14a488b26a084" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:05.422887 19023 raft_consensus.cc:3060] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.405862 19487 consensus_queue.cc:1048] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:05.425843 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:05.426674 18775 catalog_manager.cc:5697] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.428408 18775 catalog_manager.cc:5697] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:05.431839 19065 leader_election.cc:343] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.406926 19147 ts_tablet_manager.cc:1434] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.243s	user 0.007s	sys 0.006s
I20260709 12:27:05.433645 19147 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
W20260709 12:27:05.435432 19065 leader_election.cc:343] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.435911 19065 leader_election.cc:304] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:05.436443 19504 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.436739 19487 consensus_queue.cc:1048] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.436900 19504 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.438120 19487 raft_consensus.cc:2749] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.439157 19504 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:05.440845 18841 leader_election.cc:343] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.442255 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:05.443902 18874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:05.456794 19023 raft_consensus.cc:2468] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
W20260709 12:27:05.445703 18991 leader_election.cc:343] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.461668 19155 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:05.446621 18916 leader_election.cc:304] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.472354 19155 ts_tablet_manager.cc:1403] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.288s	user 0.023s	sys 0.000s
W20260709 12:27:05.474009 18990 leader_election.cc:343] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.477787 18990 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.484287 19376 raft_consensus.cc:3060] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.484673 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:05.485450 19021 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:05.487730 19150 raft_consensus.cc:493] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.488224 19150 raft_consensus.cc:515] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.490525 19065 leader_election.cc:304] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:05.481478 19454 raft_consensus.cc:2749] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.498314 19150 leader_election.cc:290] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:05.506844 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:05.507539 19024 raft_consensus.cc:2468] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:05.495110 19491 raft_consensus.cc:2804] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.508473 19491 raft_consensus.cc:697] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:05.509358 19491 consensus_queue.cc:237] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.513777 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:05.519203 19065 leader_election.cc:304] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:05.520385 19150 raft_consensus.cc:2804] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:27:05.520397 19065 leader_election.cc:343] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:05.495744 18916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 51042.7us
I20260709 12:27:05.521633 19150 raft_consensus.cc:493] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.522816 19150 raft_consensus.cc:3060] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.524840 18842 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.530252 19497 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:05.532420 19145 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:05.533028 19145 ts_tablet_manager.cc:1403] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.007s
I20260709 12:27:05.530778 19497 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.535709 19497 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.542353 19151 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:05.542866 19151 ts_tablet_manager.cc:1403] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.267s	user 0.024s	sys 0.013s
I20260709 12:27:05.546140 19147 tablet_bootstrap.cc:654] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:05.552608 19065 consensus_peers.cc:597] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.555059 19492 consensus_queue.cc:1048] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:05.550586 19155 raft_consensus.cc:359] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.575754 19155 raft_consensus.cc:385] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.579313 19447 consensus_queue.cc:1048] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.584983 19145 raft_consensus.cc:359] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.585933 19145 raft_consensus.cc:385] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.586187 19145 raft_consensus.cc:740] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.586990 19145 consensus_queue.cc:260] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.593194 19376 raft_consensus.cc:2749] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.593812 19151 raft_consensus.cc:359] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.599764 19151 raft_consensus.cc:385] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.600235 19151 raft_consensus.cc:740] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.576208 19155 raft_consensus.cc:740] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.603669 19151 consensus_queue.cc:260] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.607357 19155 consensus_queue.cc:260] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.627192 19145 ts_tablet_manager.cc:1434] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 12:27:05.630121 19155 ts_tablet_manager.cc:1434] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 12:27:05.631307 19155 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:05.604887 19497 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.634505 19145 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:05.635481 19497 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:05.636988 19151 ts_tablet_manager.cc:1434] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.002s
I20260709 12:27:05.637965 19151 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:05.638011 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
W20260709 12:27:05.645495 18841 leader_election.cc:343] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.653728 19150 raft_consensus.cc:515] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.648039 18776 catalog_manager.cc:5697] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.658304 19145 tablet_bootstrap.cc:654] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.662740 19150 leader_election.cc:290] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:05.664541 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:05.674801 19065 leader_election.cc:343] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.676087 19151 tablet_bootstrap.cc:654] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.681999 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:05.682914 19025 raft_consensus.cc:3060] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.684222 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:05.684835 19023 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.689508 19147 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:05.690092 19147 ts_tablet_manager.cc:1403] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.257s	user 0.028s	sys 0.046s
I20260709 12:27:05.708189 18774 catalog_manager.cc:5697] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.713454 18949 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.714056 19147 raft_consensus.cc:359] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.714847 19147 raft_consensus.cc:385] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.715116 19147 raft_consensus.cc:740] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.715797 19147 consensus_queue.cc:260] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.719790 19155 tablet_bootstrap.cc:654] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.723729 19147 ts_tablet_manager.cc:1434] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:27:05.751663 19145 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:05.752292 19145 ts_tablet_manager.cc:1403] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.118s	user 0.009s	sys 0.019s
I20260709 12:27:05.754091 19321 raft_consensus.cc:493] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.754805 19321 raft_consensus.cc:515] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.758561 19023 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:05.759570 19321 leader_election.cc:290] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:05.763607 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:05.764469 18877 raft_consensus.cc:2393] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7db7a43db4a4c23bcd749e49623180b in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:05.767062 19147 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:05.765771 19025 raft_consensus.cc:2468] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:05.775673 19065 leader_election.cc:304] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:05.781992 18842 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.783322 19151 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:05.783578 19380 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.783804 19151 ts_tablet_manager.cc:1403] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.003s
I20260709 12:27:05.784188 19380 raft_consensus.cc:697] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:05.786258 19447 consensus_queue.cc:1048] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:05.787811 19145 raft_consensus.cc:359] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.788542 19145 raft_consensus.cc:385] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.788820 19145 raft_consensus.cc:740] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.789552 19145 consensus_queue.cc:260] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.785457 19491 raft_consensus.cc:2804] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:05.791079 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:05.791792 19491 raft_consensus.cc:697] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:05.792786 19491 consensus_queue.cc:237] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.796849 19145 ts_tablet_manager.cc:1434] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:27:05.797979 19145 tablet_bootstrap.cc:492] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:05.799989 19380 consensus_queue.cc:237] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.769686 19492 consensus_queue.cc:1048] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
I20260709 12:27:05.804855 19145 tablet_bootstrap.cc:654] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.805783 19150 consensus_queue.cc:1048] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.808014 19147 tablet_bootstrap.cc:654] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.808429 19504 consensus_queue.cc:1048] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.809361 19151 raft_consensus.cc:359] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.810123 19151 raft_consensus.cc:385] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.810422 19151 raft_consensus.cc:740] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.812381 19151 consensus_queue.cc:260] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.814023 19155 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:05.825819 19155 ts_tablet_manager.cc:1403] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.195s	user 0.017s	sys 0.012s
I20260709 12:27:05.830209 19065 leader_election.cc:304] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:05.832819 19150 raft_consensus.cc:3060] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.846710 19448 raft_consensus.cc:493] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.847484 19448 raft_consensus.cc:515] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:05.846741 19151 ts_tablet_manager.cc:1434] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.005s
I20260709 12:27:05.855405 19155 raft_consensus.cc:359] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.856143 19155 raft_consensus.cc:385] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.850916 18773 catalog_manager.cc:5697] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:05.856454 19155 raft_consensus.cc:740] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.858289 19150 raft_consensus.cc:2749] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.860630 18776 catalog_manager.cc:5697] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.863370 19155 consensus_queue.cc:260] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.869760 19151 tablet_bootstrap.cc:492] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:05.880245 19448 leader_election.cc:290] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:05.888481 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:05.891108 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:05.897276 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "184620f70ba844b09efb04461363f9b7" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:05.901113 18917 leader_election.cc:304] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:05.902213 19451 raft_consensus.cc:2749] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:05.905360 19151 tablet_bootstrap.cc:654] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.923655 19492 consensus_queue.cc:1048] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:05.906220 19155 ts_tablet_manager.cc:1434] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.079s	user 0.004s	sys 0.002s
I20260709 12:27:05.925645 19155 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:05.927618 19145 tablet_bootstrap.cc:492] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:05.928157 19145 ts_tablet_manager.cc:1403] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.130s	user 0.042s	sys 0.046s
I20260709 12:27:05.937224 19145 raft_consensus.cc:359] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.938222 19504 raft_consensus.cc:493] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.944247 19504 raft_consensus.cc:515] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:05.944916 19155 tablet_bootstrap.cc:654] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:05.946736 19504 leader_election.cc:290] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:05.959898 19065 consensus_peers.cc:597] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:05.962664 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:05.963563 18877 raft_consensus.cc:2468] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:05.964809 19155 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:05.965379 19155 ts_tablet_manager.cc:1403] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.001s
I20260709 12:27:05.965327 18991 leader_election.cc:304] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:05.966455 19454 raft_consensus.cc:2804] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:05.966823 19454 raft_consensus.cc:493] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.967207 19454 raft_consensus.cc:3060] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:05.973695 19508 consensus_queue.cc:1048] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:05.968701 19155 raft_consensus.cc:359] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.974830 19155 raft_consensus.cc:385] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.975137 19155 raft_consensus.cc:740] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:05.961146 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:05.975854 19155 consensus_queue.cc:260] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:05.938079 19145 raft_consensus.cc:385] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:05.981818 19145 raft_consensus.cc:740] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
W20260709 12:27:05.983258 18991 leader_election.cc:343] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:05.982844 19145 consensus_queue.cc:260] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:05.989960 19155 ts_tablet_manager.cc:1434] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.001s
I20260709 12:27:05.994282 19145 ts_tablet_manager.cc:1434] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260709 12:27:05.994905 19147 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:05.995419 19147 ts_tablet_manager.cc:1403] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.245s	user 0.014s	sys 0.005s
I20260709 12:27:06.018978 19151 tablet_bootstrap.cc:492] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:06.019526 19151 ts_tablet_manager.cc:1403] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.150s	user 0.018s	sys 0.006s
I20260709 12:27:06.020774 18947 raft_consensus.cc:3060] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.021570 19495 consensus_queue.cc:1048] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:06.022233 19151 raft_consensus.cc:359] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.022904 19151 raft_consensus.cc:385] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.023167 19151 raft_consensus.cc:740] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.027217 19155 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:06.024677 19151 consensus_queue.cc:260] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.034296 19495 consensus_queue.cc:1048] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:27:06.053573 19508 raft_consensus.cc:493] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.054353 19508 raft_consensus.cc:515] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.058271 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:06.060213 18991 leader_election.cc:343] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.017091 19147 raft_consensus.cc:359] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.065789 19147 raft_consensus.cc:385] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.066077 19147 raft_consensus.cc:740] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.068415 19145 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:06.074231 19508 leader_election.cc:290] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:06.083498 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.084385 19098 raft_consensus.cc:2468] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 0.
I20260709 12:27:06.075477 19151 ts_tablet_manager.cc:1434] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.004s
I20260709 12:27:06.008663 19454 raft_consensus.cc:515] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.088176 19151 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:06.089776 19504 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.092072 18775 catalog_manager.cc:5697] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.094823 18990 leader_election.cc:304] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:06.102173 19145 tablet_bootstrap.cc:654] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.110479 19507 raft_consensus.cc:2804] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:06.110882 19507 raft_consensus.cc:493] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.111241 19507 raft_consensus.cc:3060] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.105305 19155 tablet_bootstrap.cc:654] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.109995 19504 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.117123 19504 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:06.125174 18776 catalog_manager.cc:5697] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.128623 19507 raft_consensus.cc:515] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.132161 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:06.133900 18991 leader_election.cc:343] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.135232 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:06.136951 18991 leader_election.cc:343] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.139024 19380 raft_consensus.cc:493] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.139550 19380 raft_consensus.cc:515] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.145246 19380 leader_election.cc:290] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:06.147238 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:06.150049 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:06.149593 19026 raft_consensus.cc:2468] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
W20260709 12:27:06.151633 18842 leader_election.cc:343] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.153796 18842 leader_election.cc:304] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:06.163619 19447 raft_consensus.cc:2804] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:06.164160 19447 raft_consensus.cc:493] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.164906 19447 raft_consensus.cc:3060] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.174422 19147 consensus_queue.cc:260] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.177349 19147 ts_tablet_manager.cc:1434] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.182s	user 0.008s	sys 0.000s
W20260709 12:27:06.180045 18841 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 85847.8us
I20260709 12:27:06.180575 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:06.182209 18991 leader_election.cc:343] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.189867 19151 tablet_bootstrap.cc:654] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.179565 19454 leader_election.cc:290] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:06.194321 19507 leader_election.cc:290] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:06.194561 19145 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:06.197446 19145 ts_tablet_manager.cc:1403] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.156s	user 0.015s	sys 0.001s
I20260709 12:27:06.195550 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:06.199431 19151 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:06.199923 19151 ts_tablet_manager.cc:1403] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.112s	user 0.010s	sys 0.001s
I20260709 12:27:06.198313 19097 raft_consensus.cc:3060] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.200301 19145 raft_consensus.cc:359] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.201042 19145 raft_consensus.cc:385] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.202116 19145 raft_consensus.cc:740] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.203672 19155 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:06.204322 19155 ts_tablet_manager.cc:1403] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.179s	user 0.007s	sys 0.006s
I20260709 12:27:06.203480 19447 raft_consensus.cc:515] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.204227 19145 consensus_queue.cc:260] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.214371 19155 raft_consensus.cc:359] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.215142 19155 raft_consensus.cc:385] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.215412 19155 raft_consensus.cc:740] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.215507 19145 ts_tablet_manager.cc:1434] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:27:06.215503 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:06.216748 19145 tablet_bootstrap.cc:492] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27: Bootstrap starting.
I20260709 12:27:06.220166 19147 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:06.222066 19447 leader_election.cc:290] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:06.205282 19151 raft_consensus.cc:359] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.222756 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:06.223433 19151 raft_consensus.cc:385] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.223778 18877 raft_consensus.cc:3060] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.223773 19151 raft_consensus.cc:740] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.225853 19155 consensus_queue.cc:260] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.226092 19151 consensus_queue.cc:260] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.226555 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:06.227152 19026 raft_consensus.cc:3060] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.227289 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
W20260709 12:27:06.228965 18842 leader_election.cc:343] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.229012 19155 ts_tablet_manager.cc:1434] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.002s
I20260709 12:27:06.230304 19155 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:06.232671 19151 ts_tablet_manager.cc:1434] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.032s	user 0.011s	sys 0.000s
I20260709 12:27:06.233814 19151 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:06.234977 19026 raft_consensus.cc:2468] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:06.236402 18842 leader_election.cc:304] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:06.236896 19155 tablet_bootstrap.cc:654] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.237308 19447 raft_consensus.cc:2804] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:06.237912 19447 raft_consensus.cc:697] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:06.238768 19447 consensus_queue.cc:237] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.244982 19147 tablet_bootstrap.cc:654] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.261986 19145 tablet_bootstrap.cc:654] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:06.263650 18991 leader_election.cc:343] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.264142 18991 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
W20260709 12:27:06.266868 18841 consensus_peers.cc:597] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 -> Peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Couldn't send request to peer c7db7a43db4a4c23bcd749e49623180b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.267411 19155 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:06.267760 19151 tablet_bootstrap.cc:654] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.267925 19155 ts_tablet_manager.cc:1403] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.038s	user 0.011s	sys 0.000s
I20260709 12:27:06.269770 19454 raft_consensus.cc:2749] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.271071 19380 consensus_queue.cc:1048] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:06.272018 18877 raft_consensus.cc:2468] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:06.273622 19155 raft_consensus.cc:359] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.274595 19155 raft_consensus.cc:385] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.274940 19155 raft_consensus.cc:740] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.275810 19155 consensus_queue.cc:260] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.290098 18991 leader_election.cc:304] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:06.292524 19507 raft_consensus.cc:2804] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:06.297634 19507 raft_consensus.cc:697] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:06.300156 19507 consensus_queue.cc:237] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.307802 19097 raft_consensus.cc:2468] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:06.309864 19448 raft_consensus.cc:493] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.309906 18990 leader_election.cc:304] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:06.310442 19448 raft_consensus.cc:515] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.313809 19155 ts_tablet_manager.cc:1434] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.002s
I20260709 12:27:06.317173 19155 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:06.312677 19454 raft_consensus.cc:2804] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:06.319944 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:06.320978 19023 raft_consensus.cc:2393] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c7db7a43db4a4c23bcd749e49623180b in this term.
I20260709 12:27:06.323099 19454 raft_consensus.cc:697] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:06.324281 19454 consensus_queue.cc:237] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.314503 19448 leader_election.cc:290] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:06.329649 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78854dfb3b15485bb2c2f3f6cc5b294d" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.331256 18916 leader_election.cc:304] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.332284 19495 raft_consensus.cc:3060] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.333680 19380 raft_consensus.cc:493] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.334420 19151 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:06.334206 19380 raft_consensus.cc:515] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.334913 19151 ts_tablet_manager.cc:1403] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.101s	user 0.027s	sys 0.022s
I20260709 12:27:06.333231 18774 catalog_manager.cc:5697] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:06.360765 19151 raft_consensus.cc:359] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.361500 19151 raft_consensus.cc:385] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.362020 19151 raft_consensus.cc:740] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.367517 19151 consensus_queue.cc:260] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.380204 19145 tablet_bootstrap.cc:492] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27: No bootstrap required, opened a new log
I20260709 12:27:06.380712 19145 ts_tablet_manager.cc:1403] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent bootstrapping tablet: real 0.164s	user 0.006s	sys 0.015s
I20260709 12:27:06.381011 19147 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:06.381147 19380 leader_election.cc:290] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:06.374853 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.381999 19147 ts_tablet_manager.cc:1403] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.162s	user 0.010s	sys 0.016s
I20260709 12:27:06.375757 18774 catalog_manager.cc:5697] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.383800 19495 raft_consensus.cc:2749] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.384613 19147 raft_consensus.cc:359] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.385284 19147 raft_consensus.cc:385] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.385569 19147 raft_consensus.cc:740] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.385692 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:06.386186 19147 consensus_queue.cc:260] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.386410 19491 consensus_queue.cc:1048] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:06.386871 18842 leader_election.cc:343] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:06.388012 18841 leader_election.cc:343] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.388394 18841 leader_election.cc:304] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.394379 19147 ts_tablet_manager.cc:1434] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:06.395653 19145 raft_consensus.cc:359] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.396989 19145 raft_consensus.cc:385] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.389195 19380 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.397441 19145 raft_consensus.cc:740] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.399147 19145 consensus_queue.cc:260] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.401249 19147 tablet_bootstrap.cc:492] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:06.390798 19447 raft_consensus.cc:2749] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.401331 19145 ts_tablet_manager.cc:1434] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.006s
I20260709 12:27:06.408806 18877 raft_consensus.cc:3060] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.422076 19151 ts_tablet_manager.cc:1434] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.087s	user 0.007s	sys 0.002s
I20260709 12:27:06.417311 19380 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.425822 19491 consensus_queue.cc:1048] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:06.441015 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:06.441865 19025 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:06.442289 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.443369 18842 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:06.446406 19155 tablet_bootstrap.cc:654] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.424572 19147 tablet_bootstrap.cc:654] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.449198 19500 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:06.449831 19151 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:06.449779 19380 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
W20260709 12:27:06.450474 18841 leader_election.cc:343] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.448411 19321 raft_consensus.cc:493] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.451344 19500 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.452306 19500 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.452229 19321 raft_consensus.cc:515] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.454562 19321 leader_election.cc:290] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:06.455075 18874 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d55ad11d73d42569f54ef540ebedcc9" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:06.458073 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d55ad11d73d42569f54ef540ebedcc9" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:06.459728 19065 leader_election.cc:343] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:06.460355 19065 leader_election.cc:343] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.460040 19500 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.460798 19065 leader_election.cc:304] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:06.461591 19321 raft_consensus.cc:2749] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:06.466935 19554 log.cc:927] Time spent T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:27:06.481251 19500 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:06.483893 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:06.484012 18775 catalog_manager.cc:5697] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:06.485778 18841 leader_election.cc:343] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.489163 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:06.489799 19026 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.499790 19151 tablet_bootstrap.cc:654] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.504678 19192 raft_consensus.cc:493] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c7db7a43db4a4c23bcd749e49623180b)
I20260709 12:27:06.505280 19192 raft_consensus.cc:515] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.523451 19192 leader_election.cc:290] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:06.525326 19026 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:06.548934 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce2d9aff2e749f5b4b14a488b26a084" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:06.528678 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bce2d9aff2e749f5b4b14a488b26a084" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.560395 18947 raft_consensus.cc:3060] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.566838 18842 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.569159 19447 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:06.569691 19447 raft_consensus.cc:697] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:06.570487 19447 consensus_queue.cc:237] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.577687 19504 raft_consensus.cc:493] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.578265 19504 raft_consensus.cc:515] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.578302 18842 leader_election.cc:304] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.588529 19192 raft_consensus.cc:2749] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:06.604662 19147 tablet_bootstrap.cc:492] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:06.605206 19147 ts_tablet_manager.cc:1403] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.204s	user 0.021s	sys 0.012s
I20260709 12:27:06.616441 19151 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:06.618384 19151 ts_tablet_manager.cc:1403] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.169s	user 0.012s	sys 0.003s
I20260709 12:27:06.621299 19147 raft_consensus.cc:359] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.621681 19504 leader_election.cc:290] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:06.621871 19151 raft_consensus.cc:359] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.623239 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880c860fdd004c5c801a87289851b335" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.623803 19147 raft_consensus.cc:385] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.624155 19147 raft_consensus.cc:740] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.624603 19151 raft_consensus.cc:385] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:06.624961 18990 leader_election.cc:343] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.624795 19147 consensus_queue.cc:260] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.625041 19151 raft_consensus.cc:740] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.626410 19151 consensus_queue.cc:260] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.628401 19492 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.629076 19492 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:06.629819 19495 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:06.630465 19495 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.626998 19147 ts_tablet_manager.cc:1434] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:27:06.631585 19492 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:06.629184 19151 ts_tablet_manager.cc:1434] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:06.632563 19147 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:06.635401 19448 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.635982 19448 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:06.637113 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:06.638298 19448 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:06.639139 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:06.633844 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.647183 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:06.634066 19495 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:06.650246 19151 tablet_bootstrap.cc:492] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:06.654538 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880c860fdd004c5c801a87289851b335" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:06.657590 19151 tablet_bootstrap.cc:654] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.657730 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:06.662045 18877 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
W20260709 12:27:06.663349 18991 leader_election.cc:343] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.663782 18991 leader_election.cc:304] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.664523 19504 raft_consensus.cc:2749] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.667570 18917 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.668910 18917 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:06.670466 19495 raft_consensus.cc:2749] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:06.672526 19065 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:06.676064 19491 raft_consensus.cc:2749] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.679620 19098 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.675417 19155 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:06.675287 19448 raft_consensus.cc:2749] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.684948 19155 ts_tablet_manager.cc:1403] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.369s	user 0.029s	sys 0.008s
I20260709 12:27:06.688818 19155 raft_consensus.cc:359] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.695132 19155 raft_consensus.cc:385] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.695461 19155 raft_consensus.cc:740] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.696190 19155 consensus_queue.cc:260] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.699752 19155 ts_tablet_manager.cc:1434] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:06.700858 19155 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:06.702275 18774 catalog_manager.cc:5697] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:06.710199 19155 tablet_bootstrap.cc:654] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.717708 18949 raft_consensus.cc:3060] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.721909 19504 consensus_queue.cc:1048] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:06.730247 19508 consensus_queue.cc:1048] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:06.735352 19147 tablet_bootstrap.cc:654] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.745499 19508 consensus_queue.cc:1048] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:06.747869 19151 tablet_bootstrap.cc:492] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:06.748546 19151 ts_tablet_manager.cc:1403] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.099s	user 0.022s	sys 0.013s
I20260709 12:27:06.751438 19151 raft_consensus.cc:359] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:06.759457 18991 consensus_peers.cc:597] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.760224 18947 raft_consensus.cc:3060] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.768932 19151 raft_consensus.cc:385] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.769383 19151 raft_consensus.cc:740] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.770203 19151 consensus_queue.cc:260] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.772940 19151 ts_tablet_manager.cc:1434] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.003s
I20260709 12:27:06.775364 19151 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:06.785176 19151 tablet_bootstrap.cc:654] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.803445 19147 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:06.804044 19147 ts_tablet_manager.cc:1403] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.172s	user 0.008s	sys 0.002s
I20260709 12:27:06.806671 19147 raft_consensus.cc:359] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.807328 19147 raft_consensus.cc:385] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.807587 19147 raft_consensus.cc:740] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.824936 19097 raft_consensus.cc:3060] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.834556 19454 raft_consensus.cc:493] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.835130 19454 raft_consensus.cc:515] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:06.837209 19454 leader_election.cc:290] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:06.840514 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:06.842047 18991 leader_election.cc:343] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.842648 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.843809 19155 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:06.844317 19155 ts_tablet_manager.cc:1403] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.144s	user 0.014s	sys 0.012s
I20260709 12:27:06.844673 19561 consensus_queue.cc:1048] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:06.858245 18990 leader_election.cc:343] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:06.858704 18990 leader_election.cc:304] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:06.857990 19147 consensus_queue.cc:260] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.846926 19155 raft_consensus.cc:359] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.861361 19155 raft_consensus.cc:385] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.861658 19155 raft_consensus.cc:740] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:06.863888 19147 ts_tablet_manager.cc:1434] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.002s
I20260709 12:27:06.864348 19151 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:06.865105 19151 ts_tablet_manager.cc:1403] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.090s	user 0.012s	sys 0.024s
I20260709 12:27:06.865617 19147 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:06.862330 19155 consensus_queue.cc:260] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.867796 19508 raft_consensus.cc:2749] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:06.880786 19155 ts_tablet_manager.cc:1434] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:27:06.885509 19155 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:06.896433 19151 raft_consensus.cc:359] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.897260 19151 raft_consensus.cc:385] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:06.897637 19151 raft_consensus.cc:740] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
W20260709 12:27:06.898449 18842 consensus_peers.cc:597] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:06.898298 19151 consensus_queue.cc:260] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.913371 19151 ts_tablet_manager.cc:1434] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.048s	user 0.003s	sys 0.003s
I20260709 12:27:06.914992 19151 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:06.921386 19147 tablet_bootstrap.cc:654] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.921766 19447 raft_consensus.cc:493] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.922268 19447 raft_consensus.cc:515] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:06.925732 19447 leader_election.cc:290] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:06.930519 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:06.936972 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:06.940446 19098 raft_consensus.cc:2468] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:06.956738 18841 leader_election.cc:304] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:06.960335 19500 raft_consensus.cc:2804] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:06.967051 19147 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:06.968040 19147 ts_tablet_manager.cc:1403] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.103s	user 0.018s	sys 0.011s
I20260709 12:27:06.968219 19500 raft_consensus.cc:493] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:06.977460 19500 raft_consensus.cc:3060] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:06.978559 19155 tablet_bootstrap.cc:654] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:06.980746 19151 tablet_bootstrap.cc:654] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:06.991235 18823 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:07.004985 19151 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:07.005626 19151 ts_tablet_manager.cc:1403] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.091s	user 0.013s	sys 0.008s
I20260709 12:27:07.008683 19151 raft_consensus.cc:359] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.009421 19151 raft_consensus.cc:385] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.009670 19151 raft_consensus.cc:740] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.010418 19151 consensus_queue.cc:260] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.016289 19151 ts_tablet_manager.cc:1434] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:27:07.017486 19151 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:07.020536 19500 raft_consensus.cc:515] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.023237 19500 leader_election.cc:290] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:07.024469 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:07.028604 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:07.029265 19098 raft_consensus.cc:3060] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.029938 19151 tablet_bootstrap.cc:654] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:07.031204 18842 leader_election.cc:343] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:07.032380 18842 leader_election.cc:343] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:07.034938 18841 consensus_peers.cc:597] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 -> Peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Couldn't send request to peer c7db7a43db4a4c23bcd749e49623180b. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:07.047058 19447 consensus_queue.cc:1048] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:07.055334 19098 raft_consensus.cc:2468] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:07.056844 18841 leader_election.cc:304] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:07.058000 19447 raft_consensus.cc:2804] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.058548 19447 raft_consensus.cc:697] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:07.059437 19447 consensus_queue.cc:237] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.060082 19147 raft_consensus.cc:359] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.060850 19147 raft_consensus.cc:385] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.061158 19147 raft_consensus.cc:740] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.066093 19147 consensus_queue.cc:260] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.068516 19151 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:07.069059 19151 ts_tablet_manager.cc:1403] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.014s
I20260709 12:27:07.071033 19147 ts_tablet_manager.cc:1434] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.103s	user 0.006s	sys 0.001s
I20260709 12:27:07.072047 19151 raft_consensus.cc:359] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.072777 19151 raft_consensus.cc:385] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.073036 19151 raft_consensus.cc:740] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.077987 19151 consensus_queue.cc:260] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.078614 19147 tablet_bootstrap.cc:492] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:07.080488 19151 ts_tablet_manager.cc:1434] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:07.081867 19151 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:07.084509 19155 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:07.085006 19155 ts_tablet_manager.cc:1403] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.200s	user 0.019s	sys 0.015s
I20260709 12:27:07.092350 19151 tablet_bootstrap.cc:654] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.101356 19147 tablet_bootstrap.cc:654] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.105507 19448 raft_consensus.cc:493] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.106083 19448 raft_consensus.cc:515] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.109719 19448 leader_election.cc:290] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:07.139910 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:07.113802 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:07.144286 18872 raft_consensus.cc:2468] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
W20260709 12:27:07.144937 18916 leader_election.cc:343] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:07.145679 18917 leader_election.cc:304] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:07.138267 19448 raft_consensus.cc:493] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.150307 19451 raft_consensus.cc:2804] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:07.150786 19451 raft_consensus.cc:493] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.150521 19448 raft_consensus.cc:515] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.151140 19451 raft_consensus.cc:3060] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.152632 19448 leader_election.cc:290] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:07.158419 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:07.159215 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6a522629731a40c491e370cd123e39e6" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:07.161648 18916 leader_election.cc:304] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:07.162693 19495 raft_consensus.cc:2749] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:07.164525 19495 raft_consensus.cc:493] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.168160 19495 raft_consensus.cc:515] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.171357 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d55ad11d73d42569f54ef540ebedcc9" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:07.172214 19495 leader_election.cc:290] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:07.172448 19098 raft_consensus.cc:2468] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:07.173498 19151 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:07.174010 19151 ts_tablet_manager.cc:1403] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.092s	user 0.024s	sys 0.010s
I20260709 12:27:07.174109 18916 leader_election.cc:304] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:07.174396 19451 raft_consensus.cc:515] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.171543 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d55ad11d73d42569f54ef540ebedcc9" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:07.175433 18872 raft_consensus.cc:2468] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:07.176678 19495 raft_consensus.cc:2804] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:07.177121 19495 raft_consensus.cc:493] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.177346 19147 tablet_bootstrap.cc:492] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:07.177564 19495 raft_consensus.cc:3060] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.177975 19147 ts_tablet_manager.cc:1403] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.008s
I20260709 12:27:07.178166 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:07.180907 19147 raft_consensus.cc:359] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.181617 19147 raft_consensus.cc:385] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.181878 19147 raft_consensus.cc:740] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
W20260709 12:27:07.182567 18916 leader_election.cc:343] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:07.182734 19147 consensus_queue.cc:260] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.185047 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:07.185668 18872 raft_consensus.cc:3060] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.171342 19155 raft_consensus.cc:359] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.187117 19155 raft_consensus.cc:385] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.187438 19155 raft_consensus.cc:740] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.188256 19155 consensus_queue.cc:260] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.190709 19155 ts_tablet_manager.cc:1434] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.105s	user 0.004s	sys 0.004s
I20260709 12:27:07.191772 19155 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:07.192075 19451 leader_election.cc:290] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:07.194561 18872 raft_consensus.cc:2468] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:07.195089 19147 ts_tablet_manager.cc:1434] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:27:07.195971 18917 leader_election.cc:304] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:07.197139 19451 raft_consensus.cc:2804] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.197854 19451 raft_consensus.cc:697] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:07.197659 19151 raft_consensus.cc:359] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.198413 19151 raft_consensus.cc:385] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.198697 19151 raft_consensus.cc:740] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.198889 19451 consensus_queue.cc:237] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.200896 19147 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:07.207890 19495 raft_consensus.cc:515] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.206809 19151 consensus_queue.cc:260] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.211222 19495 leader_election.cc:290] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:07.212505 19151 ts_tablet_manager.cc:1434] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.000s
I20260709 12:27:07.212378 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d55ad11d73d42569f54ef540ebedcc9" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:07.213069 19098 raft_consensus.cc:3060] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.213655 19151 tablet_bootstrap.cc:492] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:07.216321 19147 tablet_bootstrap.cc:654] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.220603 19151 tablet_bootstrap.cc:654] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.222548 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4d55ad11d73d42569f54ef540ebedcc9" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:07.223245 18872 raft_consensus.cc:3060] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.244545 18953 raft_consensus.cc:3060] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.249049 19151 tablet_bootstrap.cc:492] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:07.249672 19151 ts_tablet_manager.cc:1403] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.009s
I20260709 12:27:07.255028 19147 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:07.255568 19147 ts_tablet_manager.cc:1403] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.055s	user 0.032s	sys 0.008s
I20260709 12:27:07.257503 19155 tablet_bootstrap.cc:654] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.259510 19147 raft_consensus.cc:359] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.260308 19147 raft_consensus.cc:385] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.260576 19147 raft_consensus.cc:740] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.261189 19147 consensus_queue.cc:260] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.263687 19147 ts_tablet_manager.cc:1434] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:07.264410 19151 raft_consensus.cc:359] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.265098 19151 raft_consensus.cc:385] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.265305 19147 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b: Bootstrap starting.
I20260709 12:27:07.265376 19151 raft_consensus.cc:740] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.268555 19151 consensus_queue.cc:260] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.265264 18774 catalog_manager.cc:5697] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.273204 19147 tablet_bootstrap.cc:654] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.280416 19155 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: No bootstrap required, opened a new log
I20260709 12:27:07.281023 19155 ts_tablet_manager.cc:1403] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.089s	user 0.017s	sys 0.002s
I20260709 12:27:07.283953 19155 raft_consensus.cc:359] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.284789 19155 raft_consensus.cc:385] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.285147 19155 raft_consensus.cc:740] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.286211 19151 ts_tablet_manager.cc:1434] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 12:27:07.286038 19155 consensus_queue.cc:260] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.287372 19151 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c: Bootstrap starting.
I20260709 12:27:07.291514 19155 ts_tablet_manager.cc:1434] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:27:07.298918 19151 tablet_bootstrap.cc:654] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:07.308135 19151 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c: No bootstrap required, opened a new log
I20260709 12:27:07.308725 19151 ts_tablet_manager.cc:1403] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:27:07.310539 19448 raft_consensus.cc:493] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.311158 19448 raft_consensus.cc:515] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.312081 19151 raft_consensus.cc:359] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.312785 19147 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b: No bootstrap required, opened a new log
I20260709 12:27:07.313310 19147 ts_tablet_manager.cc:1403] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b: Time spent bootstrapping tablet: real 0.048s	user 0.003s	sys 0.031s
I20260709 12:27:07.313807 19448 leader_election.cc:290] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:07.314389 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:07.315030 19023 raft_consensus.cc:2468] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:07.315268 19097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:07.315919 19097 raft_consensus.cc:2468] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 0.
I20260709 12:27:07.316270 18917 leader_election.cc:304] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:07.312813 19151 raft_consensus.cc:385] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.317567 19448 raft_consensus.cc:2804] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:07.317866 19151 raft_consensus.cc:740] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.318063 19448 raft_consensus.cc:493] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.318544 19448 raft_consensus.cc:3060] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.321655 19147 raft_consensus.cc:359] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.322324 19147 raft_consensus.cc:385] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:07.318595 19151 consensus_queue.cc:260] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.322595 19147 raft_consensus.cc:740] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Initialized, Role: FOLLOWER
I20260709 12:27:07.323395 19147 consensus_queue.cc:260] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.325613 19147 ts_tablet_manager.cc:1434] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:07.326784 19151 ts_tablet_manager.cc:1434] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.005s
I20260709 12:27:07.334942 19448 raft_consensus.cc:515] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.323011 19098 raft_consensus.cc:2468] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:07.326912 18872 raft_consensus.cc:2468] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:07.337760 18916 leader_election.cc:304] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:07.338078 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:07.338753 19023 raft_consensus.cc:3060] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.343451 19495 raft_consensus.cc:2804] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.369306 19448 leader_election.cc:290] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:07.374274 19023 raft_consensus.cc:2468] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:07.376478 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:07.376983 19594 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.377450 19098 raft_consensus.cc:3060] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.377552 19594 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.379781 19594 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:07.392063 19097 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.394701 19561 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.395301 19561 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.400107 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:07.400835 18948 raft_consensus.cc:2468] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:07.402122 18842 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:07.402863 19447 raft_consensus.cc:2804] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:07.403247 19447 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.403590 19447 raft_consensus.cc:3060] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.404688 19561 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:07.409446 19098 raft_consensus.cc:2468] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:07.409984 18949 raft_consensus.cc:3060] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.410780 18916 leader_election.cc:304] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:07.411630 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:07.412369 19023 raft_consensus.cc:2468] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 0.
I20260709 12:27:07.415997 19448 raft_consensus.cc:2804] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.416970 19448 raft_consensus.cc:697] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:07.417892 19448 consensus_queue.cc:237] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:07.430240 18773 catalog_manager.cc:5697] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.431632 19447 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.435711 19495 raft_consensus.cc:697] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:07.436753 19495 consensus_queue.cc:237] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.438143 19447 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:07.438843 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:07.439612 18948 raft_consensus.cc:3060] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.441977 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:07.442582 19026 raft_consensus.cc:3060] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.443230 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:07.449456 19492 raft_consensus.cc:493] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.449929 19492 raft_consensus.cc:515] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.451324 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:07.452008 19492 leader_election.cc:290] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:07.452376 18872 raft_consensus.cc:2393] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 1: Already voted for candidate c6d7b700141440f8997cb5145ad80f79 in this term.
I20260709 12:27:07.453619 18947 raft_consensus.cc:3060] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.455067 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880c860fdd004c5c801a87289851b335" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:07.459102 18872 raft_consensus.cc:2468] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:07.459249 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880c860fdd004c5c801a87289851b335" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:07.459956 19022 raft_consensus.cc:2468] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 0.
I20260709 12:27:07.461493 19065 leader_election.cc:304] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:07.465574 19321 raft_consensus.cc:2804] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:07.465962 19321 raft_consensus.cc:493] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.466303 19321 raft_consensus.cc:3060] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.468393 18948 raft_consensus.cc:2468] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:07.472533 19026 raft_consensus.cc:2468] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 1.
I20260709 12:27:07.474998 18842 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:07.475999 18917 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:07.476387 19447 raft_consensus.cc:2804] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.477195 19447 raft_consensus.cc:697] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:07.479010 19595 raft_consensus.cc:2749] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:07.480875 19561 consensus_queue.cc:1048] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.481336 19492 raft_consensus.cc:493] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.481926 19492 raft_consensus.cc:515] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:07.478153 19447 consensus_queue.cc:237] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:07.484836 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:07.485635 18872 raft_consensus.cc:2393] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c7db7a43db4a4c23bcd749e49623180b in current term 1: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:07.487762 19321 raft_consensus.cc:515] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.489866 19321 leader_election.cc:290] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:07.497831 18872 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880c860fdd004c5c801a87289851b335" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:07.498521 18872 raft_consensus.cc:3060] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.502139 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "819615c6672d40979e8058dd998c1dff" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:07.503314 19492 leader_election.cc:290] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:07.504168 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "880c860fdd004c5c801a87289851b335" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:07.504804 19023 raft_consensus.cc:3060] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.506111 19065 leader_election.cc:304] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:07.517165 19192 consensus_queue.cc:1048] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.511751 19492 raft_consensus.cc:3060] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:07.566520 19492 raft_consensus.cc:2749] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:07.571272 18872 raft_consensus.cc:2468] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:07.568697 19023 raft_consensus.cc:2468] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:07.581534 19065 leader_election.cc:304] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:07.592525 19492 raft_consensus.cc:2804] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:07.593098 19492 raft_consensus.cc:697] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:07.594012 19492 consensus_queue.cc:237] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:07.601663 19495 consensus_queue.cc:1048] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:07.613289 18773 catalog_manager.cc:5697] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 0 to 1, leader changed from <none> to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.618674 18776 catalog_manager.cc:5697] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.620723 18776 catalog_manager.cc:5697] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:07.624182 19596 consensus_queue.cc:1048] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.641862 18774 catalog_manager.cc:5697] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 0 to 1, leader changed from <none> to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 1 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:07.836539 19594 consensus_queue.cc:1048] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.852756 19594 consensus_queue.cc:1048] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.894433 19447 consensus_queue.cc:1048] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.913149 19594 consensus_queue.cc:1048] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.914672 19380 consensus_queue.cc:1048] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.924692 19594 consensus_queue.cc:1048] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:07.989480 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
W20260709 12:27:07.993022 18991 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:08.042022 19491 consensus_queue.cc:1048] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:08.084074 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 76501.6us
W20260709 12:27:08.089306 19065 consensus_peers.cc:597] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.093250 19065 consensus_peers.cc:597] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.094753 18991 consensus_peers.cc:597] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.097474 18991 consensus_peers.cc:597] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.105211 18917 consensus_peers.cc:597] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.108559 18917 consensus_peers.cc:597] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.109583 19065 consensus_peers.cc:597] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.113610 19065 consensus_peers.cc:597] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.116163 18991 consensus_peers.cc:597] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.123981 19065 consensus_peers.cc:597] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.130316 19065 consensus_peers.cc:597] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.132004 18917 consensus_peers.cc:597] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.157650 19491 consensus_queue.cc:1048] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:08.182852 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:27:08.179630 18991 consensus_peers.cc:597] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.185945 11392 tablet_replica.cc:333] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.187379 11392 raft_consensus.cc:2243] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:08.187565 18917 consensus_peers.cc:597] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.187928 11392 raft_consensus.cc:2272] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.194895 11392 tablet_replica.cc:333] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.196727 11392 raft_consensus.cc:2243] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.197779 11392 raft_consensus.cc:2272] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.200379 11392 tablet_replica.cc:333] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.201004 11392 raft_consensus.cc:2243] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.201493 11392 raft_consensus.cc:2272] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.204054 11392 tablet_replica.cc:333] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.204972 11392 raft_consensus.cc:2243] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.206010 11392 raft_consensus.cc:2272] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.208719 11392 tablet_replica.cc:333] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.209657 11392 raft_consensus.cc:2243] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.210263 11392 raft_consensus.cc:2272] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.211309 19065 consensus_peers.cc:597] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.211982 19065 consensus_peers.cc:597] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.212783 11392 tablet_replica.cc:333] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.213881 11392 raft_consensus.cc:2243] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.214372 11392 raft_consensus.cc:2272] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.216734 11392 tablet_replica.cc:333] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.217571 11392 raft_consensus.cc:2243] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.218534 11392 raft_consensus.cc:2272] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.220970 11392 tablet_replica.cc:333] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.221890 11392 raft_consensus.cc:2243] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.222409 11392 raft_consensus.cc:2272] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.224684 11392 tablet_replica.cc:333] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.225451 11392 raft_consensus.cc:2243] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.226409 11392 raft_consensus.cc:2272] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.229184 11392 tablet_replica.cc:333] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.230067 11392 raft_consensus.cc:2243] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.230999 11392 raft_consensus.cc:2272] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.233369 11392 tablet_replica.cc:333] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
W20260709 12:27:08.234027 18917 consensus_peers.cc:597] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.234176 11392 raft_consensus.cc:2243] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.234777 11392 raft_consensus.cc:2272] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.237537 11392 tablet_replica.cc:333] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.238364 11392 raft_consensus.cc:2243] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.241360 11392 raft_consensus.cc:2272] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.243549 19065 consensus_peers.cc:597] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.244316 11392 tablet_replica.cc:333] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.245085 11392 raft_consensus.cc:2243] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.245641 11392 raft_consensus.cc:2272] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.248230 11392 tablet_replica.cc:333] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.249040 11392 raft_consensus.cc:2243] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.249577 11392 raft_consensus.cc:2272] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.252624 11392 tablet_replica.cc:333] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.253556 11392 raft_consensus.cc:2243] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.254549 11392 raft_consensus.cc:2272] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.257210 11392 tablet_replica.cc:333] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.257858 11392 raft_consensus.cc:2243] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.258260 11392 raft_consensus.cc:2272] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.260908 11392 tablet_replica.cc:333] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.261713 11392 raft_consensus.cc:2243] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.262240 11392 raft_consensus.cc:2272] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.264863 11392 tablet_replica.cc:333] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.265638 11392 raft_consensus.cc:2243] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.266150 11392 raft_consensus.cc:2272] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.268605 11392 tablet_replica.cc:333] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.269385 11392 raft_consensus.cc:2243] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.270352 11392 raft_consensus.cc:2272] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.272994 11392 tablet_replica.cc:333] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.273761 11392 raft_consensus.cc:2243] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.274212 11392 raft_consensus.cc:2272] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.276640 11392 tablet_replica.cc:333] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.277479 11392 raft_consensus.cc:2243] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.278482 11392 raft_consensus.cc:2272] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.281024 11392 tablet_replica.cc:333] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.281744 11392 raft_consensus.cc:2243] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.282685 11392 raft_consensus.cc:2272] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.284785 11392 tablet_replica.cc:333] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.285399 11392 raft_consensus.cc:2243] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.285903 11392 raft_consensus.cc:2272] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.288203 11392 tablet_replica.cc:333] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.288870 11392 raft_consensus.cc:2243] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.289294 11392 raft_consensus.cc:2272] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.291404 11392 tablet_replica.cc:333] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.292140 11392 raft_consensus.cc:2243] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.292644 11392 raft_consensus.cc:2272] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.295938 11392 tablet_replica.cc:333] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.296517 11392 raft_consensus.cc:2243] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.297343 11392 raft_consensus.cc:2272] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.299363 11392 tablet_replica.cc:333] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.299921 11392 raft_consensus.cc:2243] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.300355 11392 raft_consensus.cc:2272] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.302258 11392 tablet_replica.cc:333] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.302924 11392 raft_consensus.cc:2243] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.303709 11392 raft_consensus.cc:2272] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.305776 11392 tablet_replica.cc:333] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.306563 11392 raft_consensus.cc:2243] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.307391 11392 raft_consensus.cc:2272] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.309198 11392 tablet_replica.cc:333] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.309756 11392 raft_consensus.cc:2243] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.310232 11392 raft_consensus.cc:2272] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.312184 11392 tablet_replica.cc:333] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.312698 11392 raft_consensus.cc:2243] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.313148 11392 raft_consensus.cc:2272] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.315136 11392 tablet_replica.cc:333] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.315666 11392 raft_consensus.cc:2243] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.316164 11392 raft_consensus.cc:2272] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.318478 11392 tablet_replica.cc:333] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.319168 11392 raft_consensus.cc:2243] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.319618 11392 raft_consensus.cc:2272] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.321879 11392 tablet_replica.cc:333] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.322681 11392 raft_consensus.cc:2243] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.323238 11392 raft_consensus.cc:2272] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.325731 11392 tablet_replica.cc:333] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.326427 11392 raft_consensus.cc:2243] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.327422 11392 raft_consensus.cc:2272] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.329818 11392 tablet_replica.cc:333] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.330508 11392 raft_consensus.cc:2243] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:08.330631 19065 consensus_peers.cc:597] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.330935 11392 raft_consensus.cc:2272] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.332760 11392 tablet_replica.cc:333] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.333297 11392 raft_consensus.cc:2243] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.333750 11392 raft_consensus.cc:2272] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.335623 11392 tablet_replica.cc:333] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.336133 11392 raft_consensus.cc:2243] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.336633 11392 raft_consensus.cc:2272] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.338734 11392 tablet_replica.cc:333] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.339439 11392 raft_consensus.cc:2243] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.340243 11392 raft_consensus.cc:2272] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.342342 11392 tablet_replica.cc:333] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.342957 11392 raft_consensus.cc:2243] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.343442 11392 raft_consensus.cc:2272] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.345934 11392 tablet_replica.cc:333] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.346637 11392 raft_consensus.cc:2243] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.347554 11392 raft_consensus.cc:2272] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.349705 11392 tablet_replica.cc:333] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.350222 11392 raft_consensus.cc:2243] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.350618 11392 raft_consensus.cc:2272] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.352502 11392 tablet_replica.cc:333] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.353005 11392 raft_consensus.cc:2243] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.353492 11392 raft_consensus.cc:2272] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.356032 11392 tablet_replica.cc:333] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.356694 11392 raft_consensus.cc:2243] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:08.357623 11392 raft_consensus.cc:2272] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:08.359783 11392 tablet_replica.cc:333] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: stopping tablet replica
I20260709 12:27:08.360358 11392 raft_consensus.cc:2243] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:08.449739 11392 raft_consensus.cc:2272] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:08.450929 19065 consensus_peers.cc:597] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.469802 18991 consensus_peers.cc:597] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.491200 18917 consensus_peers.cc:597] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.492789 18917 consensus_peers.cc:597] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.496331 19065 consensus_peers.cc:597] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.497074 19065 consensus_peers.cc:597] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.592623 18917 consensus_peers.cc:597] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.618045 19065 consensus_peers.cc:597] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:08.631836 18917 consensus_peers.cc:597] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:08.683797 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
I20260709 12:27:08.807071 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:08.816453 19640 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:08.818113 19641 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:08.819681 19643 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:08.828408 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:08.835922 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:08.836251 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:08.836513 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600028836495 us; error 0 us; skew 500 ppm
I20260709 12:27:08.837303 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:08.842334 11392 webserver.cc:533] Webserver started at http://127.11.32.1:32783/ using document root <none> and password file <none>
I20260709 12:27:08.843045 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:08.843309 11392 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:08.848752 11392 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:27:08.861162 19648 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:08.862855 11392 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:27:08.863251 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "c6d7b700141440f8997cb5145ad80f79"
format_stamp: "Formatted at 2026-07-09 12:26:56 on dist-test-slave-sckv"
I20260709 12:27:08.863816 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:08.891460 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:08.893157 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:08.896274 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:08.903661 19655 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 12:27:09.284868 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:27:09.285166 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.383s	user 0.009s	sys 0.000s
I20260709 12:27:09.285517 11392 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:27:09.290141 19655 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:09.301077 19492 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.301672 19492 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.303797 19492 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.306918 19451 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.308497 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.307439 19451 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.313139 19451 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:27:09.318334 19065 leader_election.cc:336] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.319407 19630 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.319917 19630 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.322036 19630 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.322535 19655 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:09.323678 19655 tablet_bootstrap.cc:492] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:09.324311 19655 ts_tablet_manager.cc:1403] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.034s	user 0.024s	sys 0.008s
I20260709 12:27:09.326443 19451 raft_consensus.cc:493] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.326784 19655 raft_consensus.cc:359] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.327024 19451 raft_consensus.cc:515] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.327589 19655 raft_consensus.cc:740] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:09.328606 19655 consensus_queue.cc:260] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.330756 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.333287 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.334606 19451 leader_election.cc:290] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.339604 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
W20260709 12:27:09.344698 18991 leader_election.cc:336] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.345443 18991 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.318811 19065 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.351840 19492 raft_consensus.cc:2749] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.352931 19630 raft_consensus.cc:2749] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.354352 19655 ts_tablet_manager.cc:1434] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.030s	user 0.014s	sys 0.016s
W20260709 12:27:09.344148 18917 leader_election.cc:336] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.357507 19655 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:09.358678 18917 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.360987 19596 raft_consensus.cc:2749] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:09.366626 18917 leader_election.cc:336] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.367206 18917 leader_election.cc:304] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.368055 19596 raft_consensus.cc:2749] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.382917 19492 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.383522 19492 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.385550 19492 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.385752 19655 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:09.386687 19655 tablet_bootstrap.cc:492] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:09.387311 19655 ts_tablet_manager.cc:1403] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.031s	user 0.024s	sys 0.003s
I20260709 12:27:09.389736 19655 raft_consensus.cc:359] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.390389 19655 raft_consensus.cc:740] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:09.391001 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.392405 19596 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.391052 19655 consensus_queue.cc:260] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.393010 19596 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.394600 19655 ts_tablet_manager.cc:1434] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:09.395442 19655 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:09.395769 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.397974 19596 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.403609 19492 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.404157 19492 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.418543 19630 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.420217 19492 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.425772 19634 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.426486 19634 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.417479 19596 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.428486 19630 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.428793 19596 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.429988 19634 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.431109 19596 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.432032 19630 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.432727 19492 raft_consensus.cc:493] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.433200 19492 raft_consensus.cc:515] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.433804 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.434082 19150 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.434506 18947 raft_consensus.cc:2468] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.434537 19150 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:09.433826 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.436429 19150 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.435604 19492 leader_election.cc:290] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.438059 18991 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
W20260709 12:27:09.438839 18991 leader_election.cc:336] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.439350 18991 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:09.438884 19630 raft_consensus.cc:2804] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.442436 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
W20260709 12:27:09.440215 18991 leader_election.cc:336] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.442304 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.442523 19634 raft_consensus.cc:2749] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.443003 19630 raft_consensus.cc:493] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.443909 19630 raft_consensus.cc:3060] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:09.444072 18917 leader_election.cc:336] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.444551 18917 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:09.445622 19596 raft_consensus.cc:2749] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:09.440894 19655 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:09.446947 19655 tablet_bootstrap.cc:492] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:09.447599 19655 ts_tablet_manager.cc:1403] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.009s
I20260709 12:27:09.450003 19655 raft_consensus.cc:359] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.450623 19655 raft_consensus.cc:740] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:09.451508 19655 consensus_queue.cc:260] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.453545 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.454857 19655 ts_tablet_manager.cc:1434] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:09.455703 19655 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:09.455610 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
W20260709 12:27:09.455672 18917 leader_election.cc:336] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.464296 19630 raft_consensus.cc:515] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:09.468669 19065 leader_election.cc:336] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.469174 19065 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.469956 19660 raft_consensus.cc:2749] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.482822 19451 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.483610 19451 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.486311 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.493587 19451 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:09.499727 18917 leader_election.cc:336] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.500213 18917 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:09.500994 19451 raft_consensus.cc:2749] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.501672 19026 raft_consensus.cc:2393] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 2: Already voted for candidate 31bb5a47c5b64d31ade62e132c3dda27 in this term.
W20260709 12:27:09.511559 18991 leader_election.cc:336] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.511644 19451 raft_consensus.cc:493] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.512391 19451 raft_consensus.cc:515] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:09.513482 19065 leader_election.cc:336] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.517273 19065 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.516753 19630 leader_election.cc:290] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.514249 19655 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:09.519555 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5338350bbc37481288c0046192ce133a" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:09.520260 18948 raft_consensus.cc:3060] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.520916 19655 tablet_bootstrap.cc:492] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:09.523885 19655 ts_tablet_manager.cc:1403] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.068s	user 0.022s	sys 0.031s
I20260709 12:27:09.522271 19150 raft_consensus.cc:2749] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:09.523000 19065 leader_election.cc:336] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.524770 19065 leader_election.cc:304] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.521685 18917 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.530743 19150 raft_consensus.cc:2749] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:09.531716 19065 leader_election.cc:336] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.534404 19065 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.535144 19150 raft_consensus.cc:2749] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:09.533905 18917 leader_election.cc:336] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.537923 19451 leader_election.cc:290] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.527637 19655 raft_consensus.cc:359] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.540335 19655 raft_consensus.cc:740] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:09.543725 18948 raft_consensus.cc:2468] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:09.544253 19596 raft_consensus.cc:2749] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.545068 19150 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.545636 19150 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.547489 19150 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.548314 18991 leader_election.cc:304] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.555372 19596 raft_consensus.cc:493] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.559156 19596 raft_consensus.cc:515] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.561890 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.562309 19596 leader_election.cc:290] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.563886 19630 raft_consensus.cc:493] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.564396 19630 raft_consensus.cc:515] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.566309 19630 leader_election.cc:290] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.567366 19630 raft_consensus.cc:2804] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.567759 19630 raft_consensus.cc:697] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:09.568554 19630 consensus_queue.cc:237] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.542073 19655 consensus_queue.cc:260] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.558548 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:09.573000 18917 leader_election.cc:336] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.577314 18917 leader_election.cc:304] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:09.573738 19655 ts_tablet_manager.cc:1434] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.048s	user 0.006s	sys 0.000s
I20260709 12:27:09.578545 19664 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
W20260709 12:27:09.579777 18990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 55668.5us
I20260709 12:27:09.583166 19664 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.583644 19655 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:09.585207 19664 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.585726 19596 raft_consensus.cc:2749] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.586115 19663 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
W20260709 12:27:09.575789 19065 leader_election.cc:336] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.586644 19663 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.585762 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.588857 19065 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.589084 18947 raft_consensus.cc:2468] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.593184 19150 raft_consensus.cc:2749] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.590178 19663 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.591413 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.591686 19660 raft_consensus.cc:493] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.594103 19660 raft_consensus.cc:515] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.596138 19660 leader_election.cc:290] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.592382 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.596915 19096 raft_consensus.cc:2468] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.598497 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.600375 18917 leader_election.cc:304] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.602494 19663 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.603580 19596 raft_consensus.cc:2749] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.604298 19451 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.604825 19451 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.606868 19451 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.603443 19663 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.608666 19663 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.609562 18991 leader_election.cc:304] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:09.611514 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.612193 18947 raft_consensus.cc:2468] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:09.609338 18990 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.618407 19663 raft_consensus.cc:2804] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.618847 19663 raft_consensus.cc:493] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.619216 19663 raft_consensus.cc:3060] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.622856 19065 leader_election.cc:304] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.626544 19660 raft_consensus.cc:2804] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:09.625811 18917 leader_election.cc:336] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.629237 19594 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.629568 19660 raft_consensus.cc:493] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.630173 19660 raft_consensus.cc:3060] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.631335 19664 raft_consensus.cc:2804] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.631762 19664 raft_consensus.cc:493] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
W20260709 12:27:09.632112 18991 leader_election.cc:336] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.632155 19664 raft_consensus.cc:3060] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.633292 19634 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.633829 19634 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:09.626699 19065 leader_election.cc:336] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.630172 19594 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.637935 19594 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.636111 19634 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:09.638597 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.639218 19096 raft_consensus.cc:2468] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:09.640286 19664 raft_consensus.cc:515] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.640578 18916 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.642334 19664 leader_election.cc:290] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.643051 19596 raft_consensus.cc:2804] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.643474 19596 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.643819 19596 raft_consensus.cc:3060] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.646458 19660 raft_consensus.cc:515] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.648766 19660 leader_election.cc:290] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.654675 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.655321 19026 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:09.656396 19596 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.660805 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.661497 19096 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.664322 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "96d263d5e9d1495c814b3ea85c3f7c3b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:09.664850 19096 raft_consensus.cc:3060] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.666352 19660 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.666947 19660 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:09.668568 18917 leader_election.cc:336] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.669747 19451 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.671657 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dacdbc9e2aed4919814e17b608ac4e19" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:09.672226 18947 raft_consensus.cc:3060] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.676157 19655 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:09.677137 19655 tablet_bootstrap.cc:492] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:09.677798 19655 ts_tablet_manager.cc:1403] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.094s	user 0.017s	sys 0.000s
I20260709 12:27:09.679075 19451 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.682204 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.688000 18948 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.688166 19150 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.688555 19596 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.682336 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.688683 19150 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.689239 19023 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:09.690495 19150 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.684175 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba70b230ee84643b59da80ba7390a2a" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:09.691121 19100 raft_consensus.cc:3060] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.691094 19655 raft_consensus.cc:359] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.685359 19630 raft_consensus.cc:493] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.692009 19630 raft_consensus.cc:515] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.693250 19664 raft_consensus.cc:493] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.693753 19664 raft_consensus.cc:515] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.695019 19630 leader_election.cc:290] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:09.684924 18991 leader_election.cc:336] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.695642 18991 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
W20260709 12:27:09.696549 18991 leader_election.cc:336] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.681515 18947 raft_consensus.cc:2468] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:09.687177 18917 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.686482 19660 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.691475 19451 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.698414 19594 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.686957 19663 raft_consensus.cc:515] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.698809 19594 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.699226 19594 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.699110 18776 catalog_manager.cc:5697] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:09.700300 19065 leader_election.cc:304] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.701295 18990 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.703971 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.704557 19150 raft_consensus.cc:2804] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.704707 19634 raft_consensus.cc:2749] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:09.705483 19634 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.705837 19634 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.706168 19634 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.706451 19150 raft_consensus.cc:697] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:09.707257 18947 raft_consensus.cc:2468] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.702360 19655 raft_consensus.cc:740] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:09.695653 19664 leader_election.cc:290] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.707301 19150 consensus_queue.cc:237] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.703137 19100 raft_consensus.cc:2468] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
W20260709 12:27:09.711205 19065 leader_election.cc:336] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.709091 19663 leader_election.cc:290] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.712399 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.711074 18916 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.713176 19596 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.713750 19596 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.715395 19100 raft_consensus.cc:2468] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.717592 19630 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.718111 19630 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.718600 19596 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.719305 19596 raft_consensus.cc:2804] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.719866 19596 raft_consensus.cc:697] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:09.720013 19630 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.720824 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.721426 19594 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.721316 19596 consensus_queue.cc:237] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.721467 18947 raft_consensus.cc:2468] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:09.723505 19594 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.724165 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.724825 19100 raft_consensus.cc:2468] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:09.726006 18916 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.726398 19065 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.727492 19634 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:09.728048 19625 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.728492 19625 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.710419 19655 consensus_queue.cc:260] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.728869 19625 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.716691 18991 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:09.732373 19655 ts_tablet_manager.cc:1434] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:27:09.733000 19096 raft_consensus.cc:2468] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:09.730439 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:09.734320 19100 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:09.733369 19655 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:09.736106 19065 leader_election.cc:336] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.737962 19660 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.738453 19660 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.738991 18991 leader_election.cc:304] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:09.736617 19594 raft_consensus.cc:2804] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.740090 19625 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.740562 19594 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.740895 19664 raft_consensus.cc:2804] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.741010 19594 raft_consensus.cc:3060] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.741346 19664 raft_consensus.cc:493] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.741655 19634 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:09.741772 19664 raft_consensus.cc:3060] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.741963 19660 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.742971 19625 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:09.740422 18991 leader_election.cc:336] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.747673 18991 leader_election.cc:336] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.748347 18991 leader_election.cc:336] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.750586 18990 leader_election.cc:304] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.751698 18990 leader_election.cc:304] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.751921 19662 raft_consensus.cc:2804] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.752314 19662 raft_consensus.cc:493] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.752667 19662 raft_consensus.cc:3060] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.756106 18773 catalog_manager.cc:5697] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 2 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:09.759117 19065 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.762310 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:09.763026 19023 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:09.763259 19065 leader_election.cc:336] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.769037 19065 leader_election.cc:336] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.769709 19625 raft_consensus.cc:2804] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:09.783041 19065 leader_election.cc:336] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.783210 19664 raft_consensus.cc:515] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.757346 19663 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:09.784327 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 83504.3us
I20260709 12:27:09.791523 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cfe17266fa484c2ebe1f408f2348126b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:09.792146 18947 raft_consensus.cc:3060] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.793262 19023 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:09.797159 19065 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.798134 19150 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.798609 19150 raft_consensus.cc:697] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:09.799039 19596 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.799458 19150 consensus_queue.cc:237] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.799604 19596 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.801028 18947 raft_consensus.cc:2468] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
W20260709 12:27:09.802861 18990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 51223.9us
I20260709 12:27:09.803646 18990 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.805593 19596 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:09.787322 19664 leader_election.cc:290] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.807348 19662 raft_consensus.cc:515] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.784934 19625 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.809226 19625 raft_consensus.cc:3060] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.798333 19663 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.809921 19663 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.783406 19630 raft_consensus.cc:2804] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.828953 19594 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.845868 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:09.846505 19100 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.851667 19663 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.851222 18774 catalog_manager.cc:5697] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:09.856662 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "40be63f36321487394bd3ee0bd3e794c" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:09.857261 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:09.857957 18947 raft_consensus.cc:2468] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:09.857321 18948 raft_consensus.cc:3060] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.839396 19634 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.863023 19634 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.863514 19634 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.829254 19630 raft_consensus.cc:697] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:09.866721 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5af4e1d5b3e4e3f81b1e55817e8ef53" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:09.866428 19630 consensus_queue.cc:237] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.865434 19100 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:09.870951 19065 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.872076 19680 raft_consensus.cc:2804] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:27:09.872816 18991 leader_election.cc:336] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.867605 19098 raft_consensus.cc:3060] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:09.873778 18991 leader_election.cc:336] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.876228 19023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.878863 19023 raft_consensus.cc:2468] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
W20260709 12:27:09.878981 18991 leader_election.cc:336] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:09.877116 18990 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.876924 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:09.881009 18991 leader_election.cc:304] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.882411 19025 raft_consensus.cc:2393] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 1e1f5beea2f147c9a99d564bf624643c in current term 2: Already voted for candidate 31bb5a47c5b64d31ade62e132c3dda27 in this term.
I20260709 12:27:09.884435 19677 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.884917 19677 raft_consensus.cc:697] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:09.885759 19677 consensus_queue.cc:237] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:09.891896 19664 raft_consensus.cc:2804] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.892560 19664 raft_consensus.cc:697] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:09.894521 19663 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.894687 19675 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.895292 19675 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:09.900398 19655 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:09.880475 19662 leader_election.cc:290] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.897326 19675 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.873454 19680 raft_consensus.cc:493] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.902405 19594 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:09.902691 19680 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:09.904664 19100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:09.907877 19100 raft_consensus.cc:3060] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.920674 19100 raft_consensus.cc:2468] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
W20260709 12:27:09.921588 18990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 44576.1us
I20260709 12:27:09.927597 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:09.928227 19025 raft_consensus.cc:2468] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 1.
I20260709 12:27:09.926055 18916 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:09.932581 19655 tablet_bootstrap.cc:492] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:09.933584 19655 ts_tablet_manager.cc:1403] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.200s	user 0.027s	sys 0.010s
I20260709 12:27:09.937788 18948 raft_consensus.cc:2468] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:09.941234 11392 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:27:09.941596 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.656s	user 0.282s	sys 0.003s
I20260709 12:27:09.935465 19594 raft_consensus.cc:2804] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:09.931777 19664 consensus_queue.cc:237] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:09.963541 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 91341.8us
I20260709 12:27:09.968346 18917 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:09.971485 18917 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:09.974694 19596 raft_consensus.cc:2804] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.975077 19596 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.975427 19596 raft_consensus.cc:3060] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.975850 19634 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:09.977277 19625 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:09.979346 19625 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:09.965042 19594 raft_consensus.cc:697] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:09.980245 19667 raft_consensus.cc:2804] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:09.980666 19667 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:09.981032 19667 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:09.980688 19594 consensus_queue.cc:237] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:27:09.990645 18917 leader_election.cc:336] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.991601 18917 leader_election.cc:336] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.992424 18917 leader_election.cc:336] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.998838 18917 leader_election.cc:336] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:09.999830 18917 leader_election.cc:336] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.000308 18917 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:09.998870 19098 raft_consensus.cc:2468] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
W20260709 12:27:10.001500 19679 log.cc:927] Time spent T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 12:27:10.002292 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:10.004154 19096 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.001605 19634 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:10.009886 18917 leader_election.cc:336] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.013666 18990 leader_election.cc:304] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:10.010288 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:10.020040 18948 raft_consensus.cc:3060] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.010957 19596 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.027665 19596 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:27:10.028389 19689 log.cc:927] Time spent T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:27:10.029011 18948 raft_consensus.cc:2468] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:10.021106 19655 raft_consensus.cc:359] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:10.030021 19655 raft_consensus.cc:740] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.010035 19451 raft_consensus.cc:2749] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:10.036753 19680 raft_consensus.cc:515] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.041333 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1234203a94d043c99f919323ab576971" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:10.041916 19025 raft_consensus.cc:3060] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.045284 19677 raft_consensus.cc:2804] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.047294 19677 raft_consensus.cc:697] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:10.049093 19025 raft_consensus.cc:2468] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
I20260709 12:27:10.049865 19065 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:10.048154 19677 consensus_queue.cc:237] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:10.054148 18917 leader_election.cc:336] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.054364 19667 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.056720 19667 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:10.038636 19655 consensus_queue.cc:260] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:10.060096 19065 leader_election.cc:336] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.061074 19655 ts_tablet_manager.cc:1434] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.127s	user 0.007s	sys 0.001s
I20260709 12:27:10.062265 19655 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:10.062541 18917 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:10.063024 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:10.064039 19025 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.066039 19686 raft_consensus.cc:2804] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.067480 19686 raft_consensus.cc:697] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:10.068612 19686 consensus_queue.cc:237] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.071978 19096 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:10.073237 18990 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:10.074049 19677 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.074085 19596 raft_consensus.cc:2804] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.075675 19596 raft_consensus.cc:697] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:10.075265 19677 raft_consensus.cc:697] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:10.076647 19596 consensus_queue.cc:237] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.077702 19677 consensus_queue.cc:237] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:10.083443 18917 leader_election.cc:336] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.074944 19680 leader_election.cc:290] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:10.093534 19692 log.cc:927] Time spent T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:27:10.099211 18774 catalog_manager.cc:5697] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 2 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.104079 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bfbd1061e0be4511b027499bf152444a" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:10.104736 18948 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:10.098534 18776 catalog_manager.cc:5697] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.110334 18773 catalog_manager.cc:5697] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.111979 18773 catalog_manager.cc:5697] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.121743 18773 catalog_manager.cc:5697] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:10.098428 18991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 217508us
I20260709 12:27:10.125883 19025 raft_consensus.cc:2468] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
I20260709 12:27:10.132557 18991 leader_election.cc:304] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:10.133354 19664 raft_consensus.cc:2804] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.133919 19664 raft_consensus.cc:697] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:10.134737 19664 consensus_queue.cc:237] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.133931 18948 raft_consensus.cc:2468] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 3.
I20260709 12:27:10.133283 18917 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:10.141191 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:10.142249 18949 raft_consensus.cc:2393] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 31bb5a47c5b64d31ade62e132c3dda27 in current term 2: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:10.150053 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:10.150799 18948 raft_consensus.cc:2468] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 1.
I20260709 12:27:10.145859 19596 raft_consensus.cc:2804] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.155218 19596 raft_consensus.cc:697] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:10.156386 19596 consensus_queue.cc:237] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.168246 19096 raft_consensus.cc:1275] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.171039 19594 consensus_queue.cc:1048] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.171597 19065 leader_election.cc:304] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:10.173668 18948 raft_consensus.cc:1275] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.176216 19660 raft_consensus.cc:2804] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:10.177146 19660 raft_consensus.cc:697] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 3 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:10.178037 19660 consensus_queue.cc:237] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.179118 18773 catalog_manager.cc:5697] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:10.197813 18917 consensus_peers.cc:597] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.189581 18991 leader_election.cc:336] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:10.198945 18991 leader_election.cc:336] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.192447 19655 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.200265 19655 tablet_bootstrap.cc:492] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
W20260709 12:27:10.200534 18991 leader_election.cc:336] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.200933 19655 ts_tablet_manager.cc:1403] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.139s	user 0.018s	sys 0.009s
I20260709 12:27:10.201839 18774 catalog_manager.cc:5697] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 2 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.203354 19655 raft_consensus.cc:359] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.206393 18776 catalog_manager.cc:5697] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.215147 19655 raft_consensus.cc:740] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.215953 19655 consensus_queue.cc:260] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.218495 19655 ts_tablet_manager.cc:1434] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 12:27:10.216012 18776 catalog_manager.cc:5697] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:10.222896 18776 catalog_manager.cc:5697] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.228976 18991 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:10.235391 19664 raft_consensus.cc:2804] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:10.235762 19664 raft_consensus.cc:493] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:10.236109 19664 raft_consensus.cc:3060] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.240811 18774 catalog_manager.cc:5697] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 2 to 3, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 3 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.243727 19664 raft_consensus.cc:515] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.246981 19655 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:10.191177 19065 consensus_peers.cc:597] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.248602 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 57459.2us
W20260709 12:27:10.249078 19065 leader_election.cc:336] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.251201 18948 raft_consensus.cc:1275] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.260891 19664 leader_election.cc:290] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:10.264657 19677 consensus_queue.cc:1048] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.264322 18773 catalog_manager.cc:5697] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:10.302037 18991 leader_election.cc:336] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:10.317116 18991 leader_election.cc:336] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.330622 18991 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:10.331424 19677 raft_consensus.cc:2749] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:27:10.332429 18991 leader_election.cc:336] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:10.333206 18991 leader_election.cc:336] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.343894 19025 raft_consensus.cc:1275] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.347832 19686 consensus_queue.cc:1048] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.368124 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9c10ea4afc7740068972f8bc611ae37e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:10.368793 18948 raft_consensus.cc:3060] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:10.378859 18948 raft_consensus.cc:2468] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:10.383914 19655 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.385015 19655 tablet_bootstrap.cc:492] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
W20260709 12:27:10.421454 18917 consensus_peers.cc:597] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.451164 18917 consensus_peers.cc:597] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:10.453860 19655 ts_tablet_manager.cc:1403] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.235s	user 0.019s	sys 0.000s
W20260709 12:27:10.462442 18991 consensus_peers.cc:597] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.471733 19655 raft_consensus.cc:359] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.476190 19625 consensus_queue.cc:1048] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:10.485224 19655 raft_consensus.cc:740] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:10.486763 19655 consensus_queue.cc:260] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.487825 18991 leader_election.cc:304] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:10.488770 19677 raft_consensus.cc:2804] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:10.491485 19677 raft_consensus.cc:697] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:10.492575 19677 consensus_queue.cc:237] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:10.496203 18991 leader_election.cc:336] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:10.497866 19655 ts_tablet_manager.cc:1434] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.000s
I20260709 12:27:10.500169 19655 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:10.503539 19065 consensus_peers.cc:597] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.511616 19096 raft_consensus.cc:1275] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.520931 18949 raft_consensus.cc:1275] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.513602 18948 raft_consensus.cc:1275] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.543498 19682 consensus_queue.cc:1048] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:10.546685 18991 consensus_peers.cc:597] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:10.547192 18991 consensus_peers.cc:597] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.549225 19691 consensus_queue.cc:1048] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:10.547935 18991 consensus_peers.cc:597] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.560540 19096 raft_consensus.cc:1275] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.562209 19451 consensus_queue.cc:1048] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:10.564146 18917 consensus_peers.cc:597] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.587611 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 46183.7us
W20260709 12:27:10.589864 18990 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 74090.8us
I20260709 12:27:10.594833 19096 raft_consensus.cc:1275] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.619175 19657 raft_consensus.cc:493] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.653159 19660 consensus_queue.cc:1048] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 12:27:10.703025 18949 raft_consensus.cc:1275] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.644748 19657 raft_consensus.cc:515] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:10.706554 19718 consensus_queue.cc:1048] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:27:10.745448 19655 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:10.758941 19657 leader_election.cc:290] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:10.760334 19722 log.cc:927] Time spent T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:27:10.766883 19655 tablet_bootstrap.cc:492] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
W20260709 12:27:10.766323 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 130153us
I20260709 12:27:10.767905 19655 ts_tablet_manager.cc:1403] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.268s	user 0.018s	sys 0.013s
I20260709 12:27:10.773171 19023 raft_consensus.cc:1275] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.792657 18773 catalog_manager.cc:5697] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:10.797101 18917 consensus_peers.cc:597] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:10.800730 19655 raft_consensus.cc:359] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:10.816488 19655 raft_consensus.cc:740] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
W20260709 12:27:10.817119 18991 consensus_peers.cc:597] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.817809 19655 consensus_queue.cc:260] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:10.819205 18917 consensus_peers.cc:597] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:10.819705 18917 consensus_peers.cc:597] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:10.820075 18917 consensus_peers.cc:597] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.821059 18991 consensus_peers.cc:597] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.827936 19655 ts_tablet_manager.cc:1434] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.060s	user 0.009s	sys 0.000s
I20260709 12:27:10.834134 19655 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:10.838996 18991 consensus_peers.cc:597] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:10.840561 18991 consensus_peers.cc:597] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:10.859751 19725 consensus_queue.cc:1048] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:10.882747 19026 raft_consensus.cc:1275] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:10.884338 18949 raft_consensus.cc:1275] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:10.891316 19730 consensus_queue.cc:1048] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:27:10.880432 19634 consensus_queue.cc:1048] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:27:10.886332 19657 raft_consensus.cc:493] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.902787 19657 raft_consensus.cc:515] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:10.929235 18917 consensus_peers.cc:597] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:10.929863 18917 consensus_peers.cc:597] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:10.969915 19065 consensus_peers.cc:597] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:10.983057 19100 raft_consensus.cc:1275] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:10.991423 18991 consensus_peers.cc:597] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:10.993266 18991 consensus_peers.cc:597] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.010615 18949 raft_consensus.cc:1275] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:11.006125 19098 raft_consensus.cc:1275] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:11.012625 19680 consensus_queue.cc:1048] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:11.005321 19657 leader_election.cc:290] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:11.046612 19657 raft_consensus.cc:493] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.058003 19657 raft_consensus.cc:515] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:11.060413 19657 leader_election.cc:290] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:11.096160 19065 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 47770.1us
W20260709 12:27:11.097976 18991 consensus_peers.cc:597] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.100471 19065 consensus_peers.cc:597] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.101368 19065 consensus_peers.cc:597] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.103576 19065 consensus_peers.cc:597] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.104790 19065 consensus_peers.cc:597] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.105254 19065 consensus_peers.cc:597] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.105142 18917 consensus_peers.cc:597] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.106132 19065 consensus_peers.cc:597] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.095072 19718 consensus_queue.cc:1048] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 12:27:11.099288 19634 consensus_queue.cc:1048] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:27:11.124955 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:11.107684 19664 consensus_queue.cc:1048] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:27:11.138329 18947 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:11.144025 19657 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.144614 19657 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
W20260709 12:27:11.169157 18916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 55095.8us
W20260709 12:27:11.176491 19065 consensus_peers.cc:597] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.177062 19065 consensus_peers.cc:597] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:11.178814 19065 consensus_peers.cc:597] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.179345 19065 consensus_peers.cc:597] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.181366 19065 consensus_peers.cc:597] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.151165 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
W20260709 12:27:11.184442 19065 consensus_peers.cc:597] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.205999 18917 consensus_peers.cc:597] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.213786 19657 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:11.223479 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:11.266863 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9def37a54ca4491ba21f9e74d8ebe4ed" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:11.267379 18917 consensus_peers.cc:597] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.250850 19657 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.274820 19657 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:11.279807 19657 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:11.286252 18948 raft_consensus.cc:2393] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 2: Already voted for candidate 1e1f5beea2f147c9a99d564bf624643c in this term.
I20260709 12:27:11.322731 19655 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.324038 19655 tablet_bootstrap.cc:492] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.324769 19655 ts_tablet_manager.cc:1403] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.495s	user 0.027s	sys 0.024s
I20260709 12:27:11.321988 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:11.316747 19649 leader_election.cc:304] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:11.355744 19657 raft_consensus.cc:2749] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:11.355967 19649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 63946.7us
I20260709 12:27:11.365661 19096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "238ed3f1ff024aaeaf72c97d614e3c01" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:11.396379 19655 raft_consensus.cc:359] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.397176 19655 raft_consensus.cc:740] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.398013 19655 consensus_queue.cc:260] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.401885 19655 ts_tablet_manager.cc:1434] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.077s	user 0.004s	sys 0.003s
I20260709 12:27:11.402648 19655 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:11.405588 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a6baecd84a26405bb8e40a75edcabb9d" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:11.433781 19649 leader_election.cc:304] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:11.464002 19025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:11.464288 19026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:11.465647 19026 raft_consensus.cc:2393] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c6d7b700141440f8997cb5145ad80f79 in current term 2: Already voted for candidate 31bb5a47c5b64d31ade62e132c3dda27 in this term.
I20260709 12:27:11.458897 19657 raft_consensus.cc:2749] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:11.516160 19065 consensus_peers.cc:597] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.494335 19650 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
W20260709 12:27:11.537156 19065 consensus_peers.cc:597] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.537240 19650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 54377.6us
I20260709 12:27:11.562824 19650 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:11.537853 19657 raft_consensus.cc:2749] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:11.564154 19657 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:11.580214 19657 raft_consensus.cc:2749] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:11.555905 18991 consensus_peers.cc:597] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:11.581743 18991 consensus_peers.cc:597] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:11.609036 19655 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.610165 19655 tablet_bootstrap.cc:492] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.610862 19655 ts_tablet_manager.cc:1403] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.208s	user 0.016s	sys 0.017s
I20260709 12:27:11.615248 19655 raft_consensus.cc:359] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.615911 19655 raft_consensus.cc:740] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.616636 19655 consensus_queue.cc:260] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.627200 19655 ts_tablet_manager.cc:1434] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:27:11.628037 19655 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:11.683861 19650 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 121156us
I20260709 12:27:11.684736 19650 leader_election.cc:304] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:11.686223 19793 raft_consensus.cc:2749] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:11.715808 19655 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.717036 19655 tablet_bootstrap.cc:492] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.717902 19655 ts_tablet_manager.cc:1403] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.090s	user 0.019s	sys 0.007s
I20260709 12:27:11.721017 19655 raft_consensus.cc:359] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.721868 19655 raft_consensus.cc:740] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.722739 19655 consensus_queue.cc:260] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.725193 19655 ts_tablet_manager.cc:1434] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:11.726336 19655 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:11.733934 19793 raft_consensus.cc:493] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.734479 19793 raft_consensus.cc:515] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:11.736577 19793 leader_election.cc:290] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:11.739645 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfebe89eac4fb0a7733f516b04b007" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:11.740957 18949 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "59bfebe89eac4fb0a7733f516b04b007" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:11.745560 19649 leader_election.cc:304] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:11.750590 19793 raft_consensus.cc:2749] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:11.749629 19655 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.754592 19655 tablet_bootstrap.cc:492] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.755359 19655 ts_tablet_manager.cc:1403] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.004s
I20260709 12:27:11.757891 19655 raft_consensus.cc:359] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:11.758563 19655 raft_consensus.cc:740] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.759280 19655 consensus_queue.cc:260] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:11.760896 19655 ts_tablet_manager.cc:1434] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:27:11.761973 19655 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:11.807319 19655 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.808557 19655 tablet_bootstrap.cc:492] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.809259 19655 ts_tablet_manager.cc:1403] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.008s
I20260709 12:27:11.812332 19655 raft_consensus.cc:359] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:11.813236 19655 raft_consensus.cc:740] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.814261 19655 consensus_queue.cc:260] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:11.816783 19655 ts_tablet_manager.cc:1434] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:11.817677 19655 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:11.855496 19793 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.856060 19793 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.860036 19793 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:11.862103 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:11.863926 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:11.865694 19649 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:11.866952 19793 raft_consensus.cc:2749] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:11.868683 19655 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.872450 19655 tablet_bootstrap.cc:492] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.877184 19655 ts_tablet_manager.cc:1403] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.020s
I20260709 12:27:11.918694 19655 raft_consensus.cc:359] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.919370 19655 raft_consensus.cc:740] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.922999 19655 consensus_queue.cc:260] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:11.927402 19655 ts_tablet_manager.cc:1434] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.050s	user 0.006s	sys 0.000s
I20260709 12:27:11.928484 19655 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:11.972456 19655 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:11.991110 19655 tablet_bootstrap.cc:492] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:11.992050 19655 ts_tablet_manager.cc:1403] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.064s	user 0.025s	sys 0.008s
I20260709 12:27:11.994839 19655 raft_consensus.cc:359] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:11.995548 19655 raft_consensus.cc:740] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:11.996245 19655 consensus_queue.cc:260] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:11.997809 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:44929
I20260709 12:27:11.997925 19832 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:44929 every 8 connection(s)
I20260709 12:27:11.998695 19655 ts_tablet_manager.cc:1434] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:11.999562 19655 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.005825 19793 raft_consensus.cc:493] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.006417 19793 raft_consensus.cc:515] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.008591 19793 leader_election.cc:290] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:12.010569 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e1f5beea2f147c9a99d564bf624643c" is_pre_election: true
I20260709 12:27:12.010896 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9b30962081764c9e846593f0908f6cea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:12.013024 19650 leader_election.cc:304] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:12.016559 19793 raft_consensus.cc:2749] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:12.034320 19655 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.035332 19655 tablet_bootstrap.cc:492] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.035974 19655 ts_tablet_manager.cc:1403] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.006s
I20260709 12:27:12.038673 19655 raft_consensus.cc:359] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.039376 19655 raft_consensus.cc:740] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.041343 19727 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.042006 19727 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.046612 19655 consensus_queue.cc:260] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.047999 19727 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:12.049444 19655 ts_tablet_manager.cc:1434] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.000s
I20260709 12:27:12.050523 19655 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.051967 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:12.052654 19022 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
I20260709 12:27:12.053834 18917 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:12.054543 19727 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:12.054936 19727 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.066331 19727 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.090108 19727 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.091940 19803 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79" is_pre_election: true
I20260709 12:27:12.111297 19803 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
I20260709 12:27:12.108794 19800 raft_consensus.cc:3060] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.115840 19727 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:12.116849 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:12.121115 19022 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.145777 19804 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.145951 19799 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
I20260709 12:27:12.146762 19799 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.148839 19833 heartbeater.cc:344] Connected to a master server at 127.11.32.62:37705
I20260709 12:27:12.149300 19833 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:12.173247 19802 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.181931 19833 heartbeater.cc:507] Master 127.11.32.62:37705 requested a full tablet report, sending...
I20260709 12:27:12.201385 19022 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 3.
I20260709 12:27:12.202793 18917 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:12.204512 19596 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:12.205540 19596 raft_consensus.cc:697] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:12.213734 19655 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.206398 19596 consensus_queue.cc:237] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.225597 19655 tablet_bootstrap.cc:492] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.226361 19655 ts_tablet_manager.cc:1403] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.176s	user 0.019s	sys 0.000s
I20260709 12:27:12.229187 19655 raft_consensus.cc:359] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.229918 19655 raft_consensus.cc:740] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.230643 19655 consensus_queue.cc:260] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.234115 19655 ts_tablet_manager.cc:1434] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:12.234970 19655 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.240096 19799 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 3.
I20260709 12:27:12.265247 19655 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.290859 19655 tablet_bootstrap.cc:492] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.292021 19655 ts_tablet_manager.cc:1403] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.004s
I20260709 12:27:12.295015 19655 raft_consensus.cc:359] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.295643 19655 raft_consensus.cc:740] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.295789 18776 ts_manager.cc:194] Re-registered known tserver with Master: c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:12.296401 19655 consensus_queue.cc:260] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.299314 18774 catalog_manager.cc:5697] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 1 to 3, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 3 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:12.298836 19655 ts_tablet_manager.cc:1434] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:12.302676 19655 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.328150 19655 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.329095 19655 tablet_bootstrap.cc:492] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.329767 19655 ts_tablet_manager.cc:1403] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.001s
I20260709 12:27:12.332319 19655 raft_consensus.cc:359] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.333027 19655 raft_consensus.cc:740] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.333995 19655 consensus_queue.cc:260] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.336220 19655 ts_tablet_manager.cc:1434] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:12.336844 19655 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.358489 19655 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.359453 19655 tablet_bootstrap.cc:492] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.360074 19655 ts_tablet_manager.cc:1403] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.000s
I20260709 12:27:12.362915 19655 raft_consensus.cc:359] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.363597 19655 raft_consensus.cc:740] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.364353 19655 consensus_queue.cc:260] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.367061 19655 ts_tablet_manager.cc:1434] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:12.367843 19655 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.396314 18776 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41104
I20260709 12:27:12.401051 19655 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.401966 19833 heartbeater.cc:499] Master 127.11.32.62:37705 was elected leader, sending a full tablet report...
I20260709 12:27:12.403728 19655 tablet_bootstrap.cc:492] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.405578 19655 ts_tablet_manager.cc:1403] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.008s
I20260709 12:27:12.410804 19655 raft_consensus.cc:359] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.413681 19655 raft_consensus.cc:740] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.414410 19655 consensus_queue.cc:260] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.418478 19655 ts_tablet_manager.cc:1434] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:27:12.419407 19655 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.419549 19802 raft_consensus.cc:3060] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.424569 19799 raft_consensus.cc:3060] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.471838 19804 raft_consensus.cc:3060] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:12.476099 19655 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.478186 19655 tablet_bootstrap.cc:492] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.478871 19655 ts_tablet_manager.cc:1403] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.006s
I20260709 12:27:12.482463 19655 raft_consensus.cc:359] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.483208 19655 raft_consensus.cc:740] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.483911 19655 consensus_queue.cc:260] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.485540 19655 ts_tablet_manager.cc:1434] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:12.486572 19655 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.502982 19800 raft_consensus.cc:3060] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.512425 19655 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.513572 19655 tablet_bootstrap.cc:492] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.514259 19655 ts_tablet_manager.cc:1403] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.008s
I20260709 12:27:12.517052 19655 raft_consensus.cc:359] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.517899 19655 raft_consensus.cc:740] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.518671 19655 consensus_queue.cc:260] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.521557 19655 ts_tablet_manager.cc:1434] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:12.522436 19655 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.549036 19655 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.550271 19655 tablet_bootstrap.cc:492] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.550971 19655 ts_tablet_manager.cc:1403] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.011s
I20260709 12:27:12.558849 19655 raft_consensus.cc:359] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.562529 19655 raft_consensus.cc:740] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.563764 19655 consensus_queue.cc:260] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.568168 19655 ts_tablet_manager.cc:1434] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:27:12.569038 19655 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.599128 19655 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.600044 19655 tablet_bootstrap.cc:492] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.600677 19655 ts_tablet_manager.cc:1403] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.005s
I20260709 12:27:12.603528 19655 raft_consensus.cc:359] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.604176 19655 raft_consensus.cc:740] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.604840 19655 consensus_queue.cc:260] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.606978 19655 ts_tablet_manager.cc:1434] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:27:12.607729 19655 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.624039 19655 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.625118 19655 tablet_bootstrap.cc:492] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.625869 19655 ts_tablet_manager.cc:1403] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:27:12.628113 19655 raft_consensus.cc:359] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.628832 19655 raft_consensus.cc:740] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.629673 19655 consensus_queue.cc:260] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.633695 19655 ts_tablet_manager.cc:1434] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:12.634579 19655 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.650658 19655 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.651818 19655 tablet_bootstrap.cc:492] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.652565 19655 ts_tablet_manager.cc:1403] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.001s
I20260709 12:27:12.656415 19655 raft_consensus.cc:359] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.657182 19655 raft_consensus.cc:740] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.658424 19655 consensus_queue.cc:260] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.668298 19655 ts_tablet_manager.cc:1434] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.001s
I20260709 12:27:12.669068 19655 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.699115 19800 raft_consensus.cc:3060] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.710726 19022 raft_consensus.cc:1275] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:12.717092 19799 raft_consensus.cc:3060] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:12.717617 19596 consensus_queue.cc:1048] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:12.725239 19655 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.726272 19655 tablet_bootstrap.cc:492] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.726904 19655 ts_tablet_manager.cc:1403] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.008s
I20260709 12:27:12.729429 19655 raft_consensus.cc:359] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.730091 19655 raft_consensus.cc:740] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.730836 19655 consensus_queue.cc:260] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:12.732880 19655 ts_tablet_manager.cc:1434] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:12.733633 19655 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:12.769649 18991 consensus_peers.cc:597] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:12.778124 19804 raft_consensus.cc:1275] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:12.780063 19725 consensus_queue.cc:1048] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:12.946061 19655 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.947081 19655 tablet_bootstrap.cc:492] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.947714 19655 ts_tablet_manager.cc:1403] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.214s	user 0.059s	sys 0.108s
I20260709 12:27:12.950281 19655 raft_consensus.cc:359] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.950987 19655 raft_consensus.cc:740] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.951804 19655 consensus_queue.cc:260] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.954183 19655 ts_tablet_manager.cc:1434] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:12.955000 19655 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:12.959342 18991 consensus_peers.cc:597] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:12.972287 19655 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.973259 19655 tablet_bootstrap.cc:492] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.973917 19655 ts_tablet_manager.cc:1403] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.003s
I20260709 12:27:12.976737 19655 raft_consensus.cc:359] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.977391 19655 raft_consensus.cc:740] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.978120 19655 consensus_queue.cc:260] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:12.980049 19655 ts_tablet_manager.cc:1434] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:12.980790 19655 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:12.994738 19655 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:12.995609 19655 tablet_bootstrap.cc:492] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:12.996251 19655 ts_tablet_manager.cc:1403] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.016s	user 0.012s	sys 0.000s
I20260709 12:27:12.998570 19655 raft_consensus.cc:359] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:12.999202 19655 raft_consensus.cc:740] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:12.999737 19655 consensus_queue.cc:260] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.001536 19655 ts_tablet_manager.cc:1434] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:13.002840 19655 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.016782 19655 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.017724 19655 tablet_bootstrap.cc:492] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.018381 19655 ts_tablet_manager.cc:1403] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.016s	user 0.013s	sys 0.000s
I20260709 12:27:13.021111 19655 raft_consensus.cc:359] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.021780 19655 raft_consensus.cc:740] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.022538 19800 raft_consensus.cc:3060] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.022408 19655 consensus_queue.cc:260] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:13.023713 19065 consensus_peers.cc:597] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:13.024356 19655 ts_tablet_manager.cc:1434] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:13.025197 19655 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.041193 19799 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.073086 19655 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.074339 19655 tablet_bootstrap.cc:492] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.075222 19655 ts_tablet_manager.cc:1403] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.050s	user 0.021s	sys 0.012s
I20260709 12:27:13.080623 19655 raft_consensus.cc:359] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.081284 19655 raft_consensus.cc:740] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.081926 19655 consensus_queue.cc:260] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.084065 19655 ts_tablet_manager.cc:1434] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:13.089572 19655 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:13.112202 18991 consensus_peers.cc:597] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:13.122967 19655 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.123842 19655 tablet_bootstrap.cc:492] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.124354 19655 ts_tablet_manager.cc:1403] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.000s
I20260709 12:27:13.126565 19655 raft_consensus.cc:359] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.127213 19655 raft_consensus.cc:740] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.127908 19655 consensus_queue.cc:260] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.129845 19655 ts_tablet_manager.cc:1434] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260709 12:27:13.130851 19655 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.154078 19655 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.154838 19655 tablet_bootstrap.cc:492] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.155489 19655 ts_tablet_manager.cc:1403] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.010s
I20260709 12:27:13.157716 19655 raft_consensus.cc:359] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.158207 19655 raft_consensus.cc:740] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.158792 19655 consensus_queue.cc:260] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.160624 19655 ts_tablet_manager.cc:1434] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:13.161700 19655 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.183275 19655 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.184500 19655 tablet_bootstrap.cc:492] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.185256 19655 ts_tablet_manager.cc:1403] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 12:27:13.191161 19655 raft_consensus.cc:359] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.191934 19655 raft_consensus.cc:740] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.193192 19655 consensus_queue.cc:260] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.195691 19655 ts_tablet_manager.cc:1434] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:27:13.196578 19655 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.214269 19655 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.215093 19655 tablet_bootstrap.cc:492] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.215619 19655 ts_tablet_manager.cc:1403] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 12:27:13.217370 19655 raft_consensus.cc:359] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.217932 19655 raft_consensus.cc:740] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.218516 19655 consensus_queue.cc:260] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.220293 19655 ts_tablet_manager.cc:1434] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:13.221297 19655 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.239228 19655 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.240305 19655 tablet_bootstrap.cc:492] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.241089 19655 ts_tablet_manager.cc:1403] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:27:13.244036 19655 raft_consensus.cc:359] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.244812 19655 raft_consensus.cc:740] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.245662 19655 consensus_queue.cc:260] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.249151 19655 ts_tablet_manager.cc:1434] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:27:13.252782 19655 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
W20260709 12:27:13.335726 19065 consensus_peers.cc:597] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:13.339751 19655 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.340749 19655 tablet_bootstrap.cc:492] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.341378 19655 ts_tablet_manager.cc:1403] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.089s	user 0.037s	sys 0.030s
I20260709 12:27:13.349694 19655 raft_consensus.cc:359] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.350366 19655 raft_consensus.cc:740] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
W20260709 12:27:13.358070 18991 consensus_peers.cc:597] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:13.351166 19655 consensus_queue.cc:260] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.360759 19655 ts_tablet_manager.cc:1434] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 12:27:13.378396 19655 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.382237 19800 raft_consensus.cc:3060] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.402915 19655 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.403906 19655 tablet_bootstrap.cc:492] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.404539 19655 ts_tablet_manager.cc:1403] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.011s
I20260709 12:27:13.407007 19655 raft_consensus.cc:359] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.407680 19655 raft_consensus.cc:740] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.408528 19655 consensus_queue.cc:260] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:13.412842 19655 ts_tablet_manager.cc:1434] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:13.415727 19799 raft_consensus.cc:3060] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.427444 19655 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.435463 19800 raft_consensus.cc:3060] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.446112 19804 raft_consensus.cc:3060] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.454731 19655 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.455904 19655 tablet_bootstrap.cc:492] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.456650 19655 ts_tablet_manager.cc:1403] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.029s	user 0.022s	sys 0.004s
I20260709 12:27:13.459367 19655 raft_consensus.cc:359] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.460182 19655 raft_consensus.cc:740] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.460917 19655 consensus_queue.cc:260] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.463603 19655 ts_tablet_manager.cc:1434] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260709 12:27:13.464499 19655 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.487250 19655 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.488693 19655 tablet_bootstrap.cc:492] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.489436 19655 ts_tablet_manager.cc:1403] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.007s
I20260709 12:27:13.492209 19655 raft_consensus.cc:359] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.493042 19655 raft_consensus.cc:740] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.493883 19655 consensus_queue.cc:260] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:13.496548 19655 ts_tablet_manager.cc:1434] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 12:27:13.497471 19655 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.514357 19655 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.515276 19655 tablet_bootstrap.cc:492] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.516062 19655 ts_tablet_manager.cc:1403] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.007s
I20260709 12:27:13.518807 19655 raft_consensus.cc:359] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.519563 19655 raft_consensus.cc:740] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.520342 19655 consensus_queue.cc:260] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.522878 19655 ts_tablet_manager.cc:1434] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:13.523839 19655 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Bootstrap starting.
I20260709 12:27:13.534901 19799 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:13.552654 19655 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:13.553758 19655 tablet_bootstrap.cc:492] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Bootstrap complete.
I20260709 12:27:13.554463 19655 ts_tablet_manager.cc:1403] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.011s
I20260709 12:27:13.557299 19655 raft_consensus.cc:359] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.558113 19655 raft_consensus.cc:740] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Initialized, Role: FOLLOWER
I20260709 12:27:13.559137 19655 consensus_queue.cc:260] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:13.561697 19655 ts_tablet_manager.cc:1434] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:22.088809 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.140190 19098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "43a5a064384d4367a357c422ea87190e"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:22.141067 19098 raft_consensus.cc:606] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:22.153553 19022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2"
dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:36534
I20260709 12:27:22.154141 19022 raft_consensus.cc:606] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:22.169721 18948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea"
dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:59680
I20260709 12:27:22.170279 18948 raft_consensus.cc:606] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:22.172502 19022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d157f6240cb74405827f910790c760e7"
dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:36534
I20260709 12:27:22.172971 19022 raft_consensus.cc:606] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:22.176280 18948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dd349f9d1efe4b17a329506502573552"
dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
mode: GRACEFUL
new_leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
 from {username='slave'} at 127.0.0.1:59680
I20260709 12:27:22.176734 18948 raft_consensus.cc:606] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Received request to transfer leadership to TS 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:22.178695 18948 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3"
dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:59680
I20260709 12:27:22.179104 18948 raft_consensus.cc:606] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:22.179968 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:22.181084 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:22.181838 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.234987 19914 raft_consensus.cc:993] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.235448 19914 raft_consensus.cc:1081] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.237275 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "43a5a064384d4367a357c422ea87190e"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:22.237838 19802 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.238214 19802 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.243763 19802 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:22.245525 19802 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:22.246580 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:22.246342 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:22.247167 19098 raft_consensus.cc:3055] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.247424 19022 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.247540 19098 raft_consensus.cc:740] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:22.248463 19098 consensus_queue.cc:260] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:22.249675 19098 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.254848 19022 raft_consensus.cc:2468] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.260859 19650 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:22.264315 19923 raft_consensus.cc:2804] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.271149 19923 raft_consensus.cc:697] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:22.272763 19923 consensus_queue.cc:237] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:22.275375 19098 raft_consensus.cc:2468] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.285853 18776 catalog_manager.cc:5697] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.325311 19917 raft_consensus.cc:993] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.325903 19915 raft_consensus.cc:1081] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.327180 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d157f6240cb74405827f910790c760e7"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41178
I20260709 12:27:22.327576 19802 raft_consensus.cc:493] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.327811 19802 raft_consensus.cc:3060] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.333010 19802 raft_consensus.cc:515] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.334667 19802 leader_election.cc:290] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:22.335551 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:22.335721 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d157f6240cb74405827f910790c760e7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:22.336118 18948 raft_consensus.cc:3060] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.336333 19022 raft_consensus.cc:3055] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.336676 19022 raft_consensus.cc:740] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:22.337379 19022 consensus_queue.cc:260] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.338384 19022 raft_consensus.cc:3060] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.341323 18948 raft_consensus.cc:2468] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.342685 19650 leader_election.cc:304] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:22.343485 19022 raft_consensus.cc:2468] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.343529 19923 raft_consensus.cc:2804] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.344221 19923 raft_consensus.cc:697] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:22.345086 19923 consensus_queue.cc:237] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.353525 18776 catalog_manager.cc:5697] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.423429 19912 raft_consensus.cc:993] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.423992 19916 raft_consensus.cc:1081] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.425299 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:27:22.425799 19802 raft_consensus.cc:493] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.426079 19802 raft_consensus.cc:3060] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.430503 19802 raft_consensus.cc:515] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.432039 19802 leader_election.cc:290] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:22.433004 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:22.432950 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c3a84e41a54b46b74cd3e02e00bbe3" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:22.433837 18948 raft_consensus.cc:3055] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.433846 19022 raft_consensus.cc:3060] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.434146 18948 raft_consensus.cc:740] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:22.434976 18948 consensus_queue.cc:260] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.436015 18948 raft_consensus.cc:3060] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.439105 19022 raft_consensus.cc:2468] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.440125 19650 leader_election.cc:304] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:22.440902 19923 raft_consensus.cc:2804] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.441223 18948 raft_consensus.cc:2468] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.441350 19923 raft_consensus.cc:697] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:22.442440 19923 consensus_queue.cc:237] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.451539 18776 catalog_manager.cc:5697] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.499953 19912 raft_consensus.cc:993] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.500546 19912 raft_consensus.cc:1081] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.502238 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:27:22.502751 19802 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.503109 19802 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.510093 19802 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.511907 19802 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 4 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:22.512789 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:22.512863 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b4b3804e576c4d499ffeed1aabe213ea" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:22.513566 18948 raft_consensus.cc:3055] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:22.513598 19022 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.514003 18948 raft_consensus.cc:740] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:22.514773 18948 consensus_queue.cc:260] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.515614 18948 raft_consensus.cc:3060] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:22.518409 19022 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 4.
I20260709 12:27:22.519265 19650 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:22.519956 19923 raft_consensus.cc:2804] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:22.520073 18948 raft_consensus.cc:2468] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 4.
I20260709 12:27:22.520349 19923 raft_consensus.cc:697] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 4 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:22.521335 19923 consensus_queue.cc:237] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.530962 18776 catalog_manager.cc:5697] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 3 to 4, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 4 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.537567 19915 raft_consensus.cc:993] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.538235 19934 raft_consensus.cc:1081] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:22.540057 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41178
I20260709 12:27:22.540505 19802 raft_consensus.cc:493] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.540853 19802 raft_consensus.cc:3060] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.546820 19802 raft_consensus.cc:515] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.548139 19802 leader_election.cc:290] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:22.549162 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:22.549332 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "acf2707a8bd640fda22add252bcd5bd2" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:22.549693 19021 raft_consensus.cc:3055] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.549889 18948 raft_consensus.cc:3060] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.550027 19021 raft_consensus.cc:740] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:22.550748 19021 consensus_queue.cc:260] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.551640 19021 raft_consensus.cc:3060] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.554595 18948 raft_consensus.cc:2468] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.555968 19650 leader_election.cc:304] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:22.556895 19923 raft_consensus.cc:2804] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.557341 19923 raft_consensus.cc:697] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:22.557885 19021 raft_consensus.cc:2468] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:22.558178 19923 consensus_queue.cc:237] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:22.567310 18776 catalog_manager.cc:5697] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.575565 19912 raft_consensus.cc:993] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: : Instructing follower 31bb5a47c5b64d31ade62e132c3dda27 to start an election
I20260709 12:27:22.576033 19916 raft_consensus.cc:1081] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Signalling peer 31bb5a47c5b64d31ade62e132c3dda27 to start an election
I20260709 12:27:22.577376 19021 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dd349f9d1efe4b17a329506502573552"
dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
 from {username='slave'} at 127.0.0.1:43934
I20260709 12:27:22.577837 19021 raft_consensus.cc:493] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:22.578090 19021 raft_consensus.cc:3060] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.583242 19021 raft_consensus.cc:515] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:22.585289 19021 leader_election.cc:290] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:22.585827 18948 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd349f9d1efe4b17a329506502573552" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:22.586175 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dd349f9d1efe4b17a329506502573552" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:22.586436 18948 raft_consensus.cc:3055] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:22.586755 19098 raft_consensus.cc:3060] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.586773 18948 raft_consensus.cc:740] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:22.587679 18948 consensus_queue.cc:260] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:22.588725 18948 raft_consensus.cc:3060] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:22.591655 19098 raft_consensus.cc:2468] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:22.593021 18990 leader_election.cc:304] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:22.593796 19934 raft_consensus.cc:2804] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:22.594246 19934 raft_consensus.cc:697] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:22.594906 18948 raft_consensus.cc:2468] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:22.595757 19934 consensus_queue.cc:237] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:22.605777 18776 catalog_manager.cc:5697] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 1 to 2, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.812016 19098 raft_consensus.cc:1275] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.813030 19923 consensus_queue.cc:1048] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.828213 19022 raft_consensus.cc:1275] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.829885 19923 consensus_queue.cc:1048] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:22.835706 18948 raft_consensus.cc:1275] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.841722 19924 consensus_queue.cc:1048] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:22.849059 19021 raft_consensus.cc:1275] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.852056 19923 consensus_queue.cc:1048] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.882720 18948 raft_consensus.cc:1275] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.886482 19943 consensus_queue.cc:1048] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:22.898926 19022 raft_consensus.cc:1275] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.900656 19943 consensus_queue.cc:1048] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.937846 18948 raft_consensus.cc:1275] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.939019 19943 consensus_queue.cc:1048] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:22.948927 19022 raft_consensus.cc:1275] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:22.950532 19949 consensus_queue.cc:1048] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:23.058441 18948 raft_consensus.cc:1275] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 4 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:23.059784 19949 consensus_queue.cc:1048] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.068138 19022 raft_consensus.cc:1275] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:23.069890 19924 consensus_queue.cc:1048] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.090757 18948 raft_consensus.cc:1275] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:23.092046 19934 consensus_queue.cc:1048] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.096705 19098 raft_consensus.cc:1275] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:23.103188 19915 consensus_queue.cc:1048] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:23.225508 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.279937 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:23.280436 19094 raft_consensus.cc:606] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:23.282929 19024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f"
dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:36534
I20260709 12:27:23.283401 19024 raft_consensus.cc:606] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:23.285938 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "402a280e12134198878e344533753066"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:23.286511 19094 raft_consensus.cc:606] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:23.288978 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:23.289516 19094 raft_consensus.cc:606] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:23.292294 19024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088"
dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:36534
I20260709 12:27:23.292955 19024 raft_consensus.cc:606] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:23.294100 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:23.295143 19954 raft_consensus.cc:993] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.295660 19954 raft_consensus.cc:1081] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.295796 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:23.297439 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:23.297461 19804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41178
I20260709 12:27:23.298920 19804 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.299299 19804 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.307806 19804 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.309897 19804 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:23.310006 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:23.310410 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:23.310732 19024 raft_consensus.cc:3055] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:23.311053 19094 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.311079 19024 raft_consensus.cc:740] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:23.312062 19024 consensus_queue.cc:260] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.313076 19024 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.318209 19024 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:23.318789 19094 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:23.319562 19650 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:23.321623 19923 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:23.322139 19923 raft_consensus.cc:697] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:23.323035 19923 consensus_queue.cc:237] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.351006 18776 catalog_manager.cc:5697] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 2 to 3, leader changed from 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.459961 19954 raft_consensus.cc:993] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.460657 19958 raft_consensus.cc:1081] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.462143 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41178
I20260709 12:27:23.462608 19802 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.462882 19802 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.467715 19802 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:23.469192 19802 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:23.469805 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:23.470175 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:23.470382 19024 raft_consensus.cc:3055] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:23.470634 19024 raft_consensus.cc:740] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:23.470640 19094 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.471457 19024 consensus_queue.cc:260] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:23.472604 19024 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:23.477105 19094 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:23.478816 19024 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:23.479729 19649 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:23.480561 19949 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:23.481011 19949 raft_consensus.cc:697] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:23.481873 19949 consensus_queue.cc:237] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:23.493973 18776 catalog_manager.cc:5697] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 2 to 3, leader changed from 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.635411 19922 raft_consensus.cc:993] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.636148 19899 raft_consensus.cc:1081] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.637704 19804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:23.638137 19804 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.638355 19804 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.644019 19804 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.646359 19024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:23.646595 19804 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:23.646915 19024 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.652208 19024 raft_consensus.cc:2468] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:23.653133 19650 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:23.654309 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:23.654922 19101 raft_consensus.cc:3055] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.655133 19101 raft_consensus.cc:740] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:23.655261 19949 raft_consensus.cc:2804] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:23.655833 19949 raft_consensus.cc:697] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:23.655934 19101 consensus_queue.cc:260] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.656565 19949 consensus_queue.cc:237] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.657105 19101 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.662979 19101 raft_consensus.cc:2468] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:23.664839 18776 catalog_manager.cc:5697] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.761093 19922 raft_consensus.cc:993] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.761561 19914 raft_consensus.cc:1081] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.762835 19804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:23.763263 19804 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.763542 19804 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.769263 19804 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.770771 19804 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:23.771281 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:23.771566 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:23.771898 19022 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.772104 19101 raft_consensus.cc:3055] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.772444 19101 raft_consensus.cc:740] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:23.773178 19101 consensus_queue.cc:260] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.774335 19101 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.780779 19101 raft_consensus.cc:2468] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:23.781359 19022 raft_consensus.cc:2468] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:23.781997 19649 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:23.783361 19949 raft_consensus.cc:2804] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:23.783845 19949 raft_consensus.cc:697] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:23.784668 19949 consensus_queue.cc:237] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:23.791059 19024 raft_consensus.cc:1275] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.793768 19923 consensus_queue.cc:1048] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.816015 19922 raft_consensus.cc:993] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.816527 19914 raft_consensus.cc:1081] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:23.818219 19804 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "402a280e12134198878e344533753066"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:23.818822 19804 raft_consensus.cc:493] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.819208 19804 raft_consensus.cc:3060] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.823072 18776 catalog_manager.cc:5697] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:23.827490 19804 raft_consensus.cc:515] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:23.830195 19804 leader_election.cc:290] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:23.830830 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:23.831357 19101 raft_consensus.cc:3055] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:23.831565 19101 raft_consensus.cc:740] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:23.832293 19101 consensus_queue.cc:260] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:23.832676 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "402a280e12134198878e344533753066" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:23.833091 19101 raft_consensus.cc:3060] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.833261 18953 raft_consensus.cc:3060] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:23.839605 19101 raft_consensus.cc:2468] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:23.840850 19649 leader_election.cc:304] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:23.842229 19924 raft_consensus.cc:2804] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:23.842918 19924 raft_consensus.cc:697] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:23.844050 19924 consensus_queue.cc:237] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:23.848580 19101 raft_consensus.cc:1275] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.849854 19943 consensus_queue.cc:1048] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.851227 18953 raft_consensus.cc:2468] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:23.863339 18773 catalog_manager.cc:5697] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:23.902734 19101 raft_consensus.cc:1275] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.905537 19943 consensus_queue.cc:1048] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:23.919731 19024 raft_consensus.cc:1275] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:23.921873 19924 consensus_queue.cc:1048] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:24.047953 19094 raft_consensus.cc:1275] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.049225 19924 consensus_queue.cc:1048] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:24.187742 18991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.1:44929, user_credentials={real_user=slave}} blocked reactor thread for 47216.9us
I20260709 12:27:24.208079 19021 raft_consensus.cc:1275] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.215973 19923 consensus_queue.cc:1048] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:24.228616 19024 raft_consensus.cc:1275] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:24.262028 18916 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.4:34167, user_credentials={real_user=slave}} blocked reactor thread for 89725.5us
I20260709 12:27:24.268821 19923 consensus_queue.cc:1048] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:24.283942 19098 raft_consensus.cc:1275] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.285573 19923 consensus_queue.cc:1048] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:24.354939 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.401407 19094 raft_consensus.cc:1275] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.402566 18953 raft_consensus.cc:1275] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:24.402947 19924 consensus_queue.cc:1048] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:24.404960 19924 consensus_queue.cc:1048] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:24.483779 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:24.484557 19094 raft_consensus.cc:606] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:24.488351 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:24.489120 19094 raft_consensus.cc:606] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:24.492319 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b8e124074de848de84792c3456059de8"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "1e1f5beea2f147c9a99d564bf624643c"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:24.492815 19094 raft_consensus.cc:606] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Received request to transfer leadership to TS 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:24.495064 19094 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7"
dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:58476
I20260709 12:27:24.495512 19094 raft_consensus.cc:606] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:24.496603 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:27:24.497781 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:24.498688 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.571364 19983 raft_consensus.cc:993] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:24.571966 19989 raft_consensus.cc:1081] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:24.573293 19800 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:24.573750 19800 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.573974 19800 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.579869 19800 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:24.581347 19800 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:24.582288 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:24.582309 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:24.583070 19022 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.583127 19094 raft_consensus.cc:3055] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:24.583580 19094 raft_consensus.cc:740] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:24.585656 19094 consensus_queue.cc:260] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:24.587023 19094 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:24.590052 19022 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:24.591560 19650 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:24.592615 19923 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:24.593292 19923 raft_consensus.cc:697] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:24.594302 19923 consensus_queue.cc:237] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:24.609213 19094 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:24.616955 18773 catalog_manager.cc:5697] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 2 to 3, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.651837 19983 raft_consensus.cc:993] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower 1e1f5beea2f147c9a99d564bf624643c to start an election
I20260709 12:27:24.652328 19989 raft_consensus.cc:1081] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer 1e1f5beea2f147c9a99d564bf624643c to start an election
I20260709 12:27:24.653683 18949 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b8e124074de848de84792c3456059de8"
dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
 from {username='slave'} at 127.0.0.1:40580
I20260709 12:27:24.654160 18949 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.654448 18949 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.659958 18949 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:24.662748 18949 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:24.662987 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:24.663317 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "1e1f5beea2f147c9a99d564bf624643c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:24.663542 19022 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.663870 19094 raft_consensus.cc:3055] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.664143 19094 raft_consensus.cc:740] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:24.664830 19094 consensus_queue.cc:260] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:24.665706 19094 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.669896 19022 raft_consensus.cc:2468] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
I20260709 12:27:24.671233 18917 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27; no voters: 
I20260709 12:27:24.672096 19957 raft_consensus.cc:2804] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.672629 19957 raft_consensus.cc:697] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Becoming Leader. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:24.673774 19094 raft_consensus.cc:2468] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e1f5beea2f147c9a99d564bf624643c in term 2.
I20260709 12:27:24.673599 19957 consensus_queue.cc:237] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:24.683117 18773 catalog_manager.cc:5697] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "1e1f5beea2f147c9a99d564bf624643c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:24.795274 19983 raft_consensus.cc:993] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:24.795842 19983 raft_consensus.cc:1081] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:24.797770 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:24.798337 19802 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.798676 19802 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.804138 19802 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:24.805665 19802 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:24.806416 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:24.806520 19098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:24.806994 19022 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.807148 19098 raft_consensus.cc:3055] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.807566 19098 raft_consensus.cc:740] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:24.808257 19098 consensus_queue.cc:260] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:24.809197 19098 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.813745 19022 raft_consensus.cc:2468] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:24.814877 19650 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:24.815711 19923 raft_consensus.cc:2804] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.816175 19923 raft_consensus.cc:697] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:24.817179 19923 consensus_queue.cc:237] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:24.818536 19098 raft_consensus.cc:2468] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:24.827322 18773 catalog_manager.cc:5697] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:24.920027 19983 raft_consensus.cc:993] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:24.920671 19989 raft_consensus.cc:1081] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:24.921964 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41160
I20260709 12:27:24.922354 19802 raft_consensus.cc:493] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:24.922701 19802 raft_consensus.cc:3060] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.929575 19802 raft_consensus.cc:515] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:24.932054 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:24.932092 19802 leader_election.cc:290] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:24.932542 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1b4107fcf756467ab86dd05df9d8a366" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:24.932561 19094 raft_consensus.cc:3055] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:24.933215 19094 raft_consensus.cc:740] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:24.933240 18953 raft_consensus.cc:3060] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.934151 19094 consensus_queue.cc:260] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:24.935189 19094 raft_consensus.cc:3060] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:24.940289 18953 raft_consensus.cc:2468] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:24.941380 19650 leader_election.cc:304] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:24.941553 19094 raft_consensus.cc:2468] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 2.
I20260709 12:27:24.942320 19949 raft_consensus.cc:2804] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:24.943419 19949 raft_consensus.cc:697] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:24.944360 19949 consensus_queue.cc:237] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:24.955459 18773 catalog_manager.cc:5697] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 1 to 2, leader changed from c7db7a43db4a4c23bcd749e49623180b (127.11.32.4) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:25.072783 19094 raft_consensus.cc:1275] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.074055 19985 consensus_queue.cc:1048] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.086629 19021 raft_consensus.cc:1275] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer 1e1f5beea2f147c9a99d564bf624643c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.090692 19985 consensus_queue.cc:1048] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.158617 19021 raft_consensus.cc:1275] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:25.160049 19949 consensus_queue.cc:1048] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:25.178745 19094 raft_consensus.cc:1275] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:25.181002 19923 consensus_queue.cc:1048] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:25.287612 19094 raft_consensus.cc:1275] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.288715 19923 consensus_queue.cc:1048] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.300951 19021 raft_consensus.cc:1275] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.302613 19923 consensus_queue.cc:1048] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.436609 18953 raft_consensus.cc:1275] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.438048 19923 consensus_queue.cc:1048] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.451227 19094 raft_consensus.cc:1275] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:25.455947 19924 consensus_queue.cc:1048] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:25.540170 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:25.599808 18953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927"
dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
mode: GRACEFUL
new_leader_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:59680
I20260709 12:27:25.600467 18953 raft_consensus.cc:606] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Received request to transfer leadership to TS c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:25.602661 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:27:25.604063 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:25.604630 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:25.627283 19957 raft_consensus.cc:993] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: : Instructing follower c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:25.627872 19957 raft_consensus.cc:1081] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Signalling peer c6d7b700141440f8997cb5145ad80f79 to start an election
I20260709 12:27:25.629969 19802 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927"
dest_uuid: "c6d7b700141440f8997cb5145ad80f79"
 from {username='slave'} at 127.0.0.1:41170
I20260709 12:27:25.630467 19802 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:25.630805 19802 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.636902 19802 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:25.639628 19802 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:25.640527 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:25.641144 18953 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "caee18f264a54f23a0400a742d9f7927" candidate_uuid: "c6d7b700141440f8997cb5145ad80f79" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e1f5beea2f147c9a99d564bf624643c"
I20260709 12:27:25.641172 19021 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.641710 18953 raft_consensus.cc:3055] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:25.642009 18953 raft_consensus.cc:740] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e1f5beea2f147c9a99d564bf624643c, State: Running, Role: LEADER
I20260709 12:27:25.642737 18953 consensus_queue.cc:260] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:25.643925 18953 raft_consensus.cc:3060] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:25.648866 18953 raft_consensus.cc:2468] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:25.649875 19650 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79; no voters: 
I20260709 12:27:25.650952 19943 raft_consensus.cc:2804] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:25.651700 19943 raft_consensus.cc:697] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Becoming Leader. State: Replica: c6d7b700141440f8997cb5145ad80f79, State: Running, Role: LEADER
I20260709 12:27:25.648883 19021 raft_consensus.cc:2468] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c6d7b700141440f8997cb5145ad80f79 in term 3.
I20260709 12:27:25.653520 19943 consensus_queue.cc:237] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:25.673265 18774 catalog_manager.cc:5697] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 reported cstate change: term changed from 2 to 3, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to c6d7b700141440f8997cb5145ad80f79 (127.11.32.1). New cstate: current_term: 3 leader_uuid: "c6d7b700141440f8997cb5145ad80f79" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:26.143286 19022 raft_consensus.cc:1275] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:26.144510 19949 consensus_queue.cc:1048] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:26.157629 18949 raft_consensus.cc:1275] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Refusing update from remote peer c6d7b700141440f8997cb5145ad80f79: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:26.159075 19924 consensus_queue.cc:1048] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:26.652786 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.689502 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:26.690907 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:26.691588 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.732864 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:26.784062 11392 tablet_server.cc:179] TabletServer@127.11.32.1:44929 shutting down...
W20260709 12:27:26.799602 18991 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 317 similar messages]
W20260709 12:27:26.808943 18991 consensus_peers.cc:597] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.828296 18991 consensus_peers.cc:597] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.830950 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:26.831833 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:26.832677 11392 raft_consensus.cc:2243] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.833182 11392 raft_consensus.cc:2272] T 4d55ad11d73d42569f54ef540ebedcc9 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.836879 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:26.837880 11392 raft_consensus.cc:2243] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.838366 11392 raft_consensus.cc:2272] T 54cf4aa1eaae45588f5272617a664b12 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.841709 11392 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:26.841709 18917 consensus_peers.cc:597] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.842739 11392 raft_consensus.cc:2243] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.843355 11392 raft_consensus.cc:2272] T 556d72ded831470a830cb0f4451a480b P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.845968 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:26.846658 11392 raft_consensus.cc:2243] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.847071 11392 raft_consensus.cc:2272] T dacdbc9e2aed4919814e17b608ac4e19 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.849901 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:26.852051 11392 raft_consensus.cc:2243] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.852476 11392 raft_consensus.cc:2272] T cfe17266fa484c2ebe1f408f2348126b P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.854744 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:26.855607 11392 raft_consensus.cc:2243] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.856170 11392 raft_consensus.cc:2272] T a27793117bd7440cb8d9d04abcb78f46 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.858913 11392 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:26.859598 18917 consensus_peers.cc:597] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.859606 11392 raft_consensus.cc:2243] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:26.861534 11392 raft_consensus.cc:2272] T 880c860fdd004c5c801a87289851b335 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:26.864660 11392 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:26.865427 19065 consensus_peers.cc:597] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.865549 11392 raft_consensus.cc:2243] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:26.866572 11392 raft_consensus.cc:2272] T 304e743b0b1c476ead5c8073437f5c1f P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:26.891367 18991 consensus_peers.cc:597] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.897750 18991 consensus_peers.cc:597] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.908243 19065 consensus_peers.cc:597] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.932821 18991 consensus_peers.cc:597] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.934777 19065 consensus_peers.cc:597] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.941774 19065 consensus_peers.cc:597] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:26.947866 19065 consensus_peers.cc:597] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:26.985814 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:26.991876 11392 raft_consensus.cc:2243] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.000660 11392 raft_consensus.cc:2272] T a78687d4c1044976aff39a7a2fd653f1 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.005640 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.027842 11392 raft_consensus.cc:2243] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.028679 11392 raft_consensus.cc:2272] T caee18f264a54f23a0400a742d9f7927 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.033175 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.033957 11392 raft_consensus.cc:2243] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.037957 11392 raft_consensus.cc:2272] T bce2d9aff2e749f5b4b14a488b26a084 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.041494 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.042847 11392 raft_consensus.cc:2243] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.043462 11392 raft_consensus.cc:2272] T 184620f70ba844b09efb04461363f9b7 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.048069 11392 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:27.048398 19065 consensus_peers.cc:597] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.049129 11392 raft_consensus.cc:2243] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.050756 11392 raft_consensus.cc:2272] T bda58a59bd074fd3bce74d63822c2671 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.054332 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.056041 11392 raft_consensus.cc:2243] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.057157 11392 raft_consensus.cc:2272] T bfbd1061e0be4511b027499bf152444a P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.062578 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.063647 11392 raft_consensus.cc:2243] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.064378 11392 raft_consensus.cc:2272] T 1234203a94d043c99f919323ab576971 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.067698 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.069011 11392 raft_consensus.cc:2243] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.073150 11392 raft_consensus.cc:2272] T 30bc1c45f11a44f79c80125131564f4a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.076699 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.077634 11392 raft_consensus.cc:2243] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.078302 11392 raft_consensus.cc:2272] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.081794 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.082742 11392 raft_consensus.cc:2243] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.083431 11392 raft_consensus.cc:2272] T 96d263d5e9d1495c814b3ea85c3f7c3b P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.088634 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.089856 11392 raft_consensus.cc:2243] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.090519 11392 raft_consensus.cc:2272] T 416fa299c26f44b69a5b04ef4d339514 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.093966 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.095021 11392 raft_consensus.cc:2243] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.095718 11392 raft_consensus.cc:2272] T e029f7a7f4cc40c0adcc3767c9c581df P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.099231 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.100345 11392 raft_consensus.cc:2243] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.111644 11392 raft_consensus.cc:2272] T bba70b230ee84643b59da80ba7390a2a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.115635 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.116710 11392 raft_consensus.cc:2243] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.117331 11392 raft_consensus.cc:2272] T f56e2ce743e6479589da5d8a3788ebb6 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.151513 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.152704 11392 raft_consensus.cc:2243] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.304088 11392 raft_consensus.cc:2272] T f20c40417f904c7d97367b1ed0a0c088 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.307632 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.308552 11392 raft_consensus.cc:2243] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.309177 11392 raft_consensus.cc:2272] T 815dce779e1642fd862e279f79c8a118 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.312172 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.313090 11392 raft_consensus.cc:2243] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.313704 11392 raft_consensus.cc:2272] T 9c10ea4afc7740068972f8bc611ae37e P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.319769 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.320533 11392 raft_consensus.cc:2243] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.321077 11392 raft_consensus.cc:2272] T 52337688286f416c8736cfa551d03aea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.323971 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.324749 11392 raft_consensus.cc:2243] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.325429 11392 raft_consensus.cc:2272] T 40be63f36321487394bd3ee0bd3e794c P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.330394 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.331447 11392 raft_consensus.cc:2243] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.331985 11392 raft_consensus.cc:2272] T 68288b50f46b45328211be0d64c50c8a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.334807 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.335433 11392 raft_consensus.cc:2243] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.335997 11392 raft_consensus.cc:2272] T b50d7fdee8a244cfa677109bb9ca854a P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.338696 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.339535 11392 raft_consensus.cc:2243] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.340747 11392 raft_consensus.cc:2272] T 43a5a064384d4367a357c422ea87190e P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.343787 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.344583 11392 raft_consensus.cc:2243] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.345188 11392 raft_consensus.cc:2272] T a6baecd84a26405bb8e40a75edcabb9d P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.348265 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.349025 11392 raft_consensus.cc:2243] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.349912 11392 raft_consensus.cc:2272] T 195b142675bd4c3ba085b783eccf665f P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.350201 18991 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:37853, user_credentials={real_user=slave}} blocked reactor thread for 277387us
I20260709 12:27:27.355695 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.356667 11392 raft_consensus.cc:2243] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.357656 11392 raft_consensus.cc:2272] T d157f6240cb74405827f910790c760e7 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.360724 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.361511 11392 raft_consensus.cc:2243] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.362133 11392 raft_consensus.cc:2272] T 238ed3f1ff024aaeaf72c97d614e3c01 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.365072 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.365978 11392 raft_consensus.cc:2243] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.366531 11392 raft_consensus.cc:2272] T 9def37a54ca4491ba21f9e74d8ebe4ed P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.369565 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.370343 11392 raft_consensus.cc:2243] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.370895 11392 raft_consensus.cc:2272] T 9b30962081764c9e846593f0908f6cea P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.373854 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.374702 11392 raft_consensus.cc:2243] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.380508 11392 raft_consensus.cc:2272] T acf2707a8bd640fda22add252bcd5bd2 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.383818 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.384843 11392 raft_consensus.cc:2243] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.385440 11392 raft_consensus.cc:2272] T 819615c6672d40979e8058dd998c1dff P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.388797 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.390239 11392 raft_consensus.cc:2243] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.394176 11392 raft_consensus.cc:2272] T cb73782ff8474ba5bfef53d8399b01a7 P c6d7b700141440f8997cb5145ad80f79 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.398483 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.402372 11392 raft_consensus.cc:2243] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.403787 11392 raft_consensus.cc:2272] T 1b4107fcf756467ab86dd05df9d8a366 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.406610 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.407375 11392 raft_consensus.cc:2243] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.408082 11392 raft_consensus.cc:2272] T 402a280e12134198878e344533753066 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.411980 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.412866 11392 raft_consensus.cc:2243] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.413400 11392 raft_consensus.cc:2272] T 59bfebe89eac4fb0a7733f516b04b007 P c6d7b700141440f8997cb5145ad80f79 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.447367 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.451678 11392 raft_consensus.cc:2243] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.453783 11392 raft_consensus.cc:2272] T f5c3a84e41a54b46b74cd3e02e00bbe3 P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.461091 11392 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:27.457041 18991 consensus_peers.cc:597] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.466755 18991 consensus_peers.cc:597] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.467701 18991 consensus_peers.cc:597] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.468827 18991 consensus_peers.cc:597] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.470420 11392 raft_consensus.cc:2243] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.471092 11392 raft_consensus.cc:2272] T 5338350bbc37481288c0046192ce133a P c6d7b700141440f8997cb5145ad80f79 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.475075 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:27.476596 11392 raft_consensus.cc:2243] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.478085 11392 raft_consensus.cc:2272] T b4b3804e576c4d499ffeed1aabe213ea P c6d7b700141440f8997cb5145ad80f79 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.509472 18917 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:45785, user_credentials={real_user=slave}} blocked reactor thread for 68042.8us
W20260709 12:27:27.518363 18917 consensus_peers.cc:597] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.518616 19065 consensus_peers.cc:597] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.519083 18917 consensus_peers.cc:597] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.520921 18917 consensus_peers.cc:597] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.521531 18917 consensus_peers.cc:597] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.522316 18917 consensus_peers.cc:597] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.525326 19065 consensus_peers.cc:597] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.526913 19065 consensus_peers.cc:597] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.527851 19065 consensus_peers.cc:597] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.528795 19065 consensus_peers.cc:597] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.539728 18917 consensus_peers.cc:597] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.541153 18917 consensus_peers.cc:597] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.541908 18917 consensus_peers.cc:597] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.543156 18917 consensus_peers.cc:597] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.578502 11392 tablet_server.cc:196] TabletServer@127.11.32.1:44929 shutdown complete.
I20260709 12:27:27.692226 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
W20260709 12:27:27.722337 19065 consensus_peers.cc:597] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.742969 18991 consensus_peers.cc:597] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.763473 18991 consensus_peers.cc:597] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.799829 19065 consensus_peers.cc:597] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.809899 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:27.812565 11392 tablet_replica.cc:333] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.813675 11392 raft_consensus.cc:2243] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.814265 11392 raft_consensus.cc:2272] T dacdbc9e2aed4919814e17b608ac4e19 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.817188 11392 tablet_replica.cc:333] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.817830 11392 raft_consensus.cc:2243] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.818619 11392 raft_consensus.cc:2272] T 4d55ad11d73d42569f54ef540ebedcc9 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.820818 11392 tablet_replica.cc:333] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.821485 11392 raft_consensus.cc:2243] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.822110 11392 raft_consensus.cc:2272] T 6a522629731a40c491e370cd123e39e6 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.824260 11392 tablet_replica.cc:333] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.824905 11392 raft_consensus.cc:2243] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.825320 11392 raft_consensus.cc:2272] T 9c10ea4afc7740068972f8bc611ae37e P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.827374 11392 tablet_replica.cc:333] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.828030 11392 raft_consensus.cc:2243] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.828823 11392 raft_consensus.cc:2272] T 1590223762b24a92b589c7d9db79bb28 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.831140 11392 tablet_replica.cc:333] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.831821 11392 raft_consensus.cc:2243] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.832365 11392 raft_consensus.cc:2272] T d157f6240cb74405827f910790c760e7 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.834712 11392 tablet_replica.cc:333] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.835302 11392 raft_consensus.cc:2243] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.835745 11392 raft_consensus.cc:2272] T a6baecd84a26405bb8e40a75edcabb9d P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.837752 11392 tablet_replica.cc:333] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.838307 11392 raft_consensus.cc:2243] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.838716 11392 raft_consensus.cc:2272] T 78854dfb3b15485bb2c2f3f6cc5b294d P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.840583 11392 tablet_replica.cc:333] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.841115 11392 raft_consensus.cc:2243] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.841570 11392 raft_consensus.cc:2272] T 184620f70ba844b09efb04461363f9b7 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.843559 11392 tablet_replica.cc:333] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.844205 11392 raft_consensus.cc:2243] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.844774 11392 raft_consensus.cc:2272] T 5338350bbc37481288c0046192ce133a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.847612 11392 tablet_replica.cc:333] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.848472 11392 raft_consensus.cc:2243] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.849013 11392 raft_consensus.cc:2272] T b4b3804e576c4d499ffeed1aabe213ea P 1e1f5beea2f147c9a99d564bf624643c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.851117 11392 tablet_replica.cc:333] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.851763 11392 raft_consensus.cc:2243] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.852206 11392 raft_consensus.cc:2272] T 54bb9118a5c3400e9e4421d2c5f4a918 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.854763 11392 tablet_replica.cc:333] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.855576 11392 raft_consensus.cc:2243] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.856067 11392 raft_consensus.cc:2272] T caee18f264a54f23a0400a742d9f7927 P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.858829 11392 tablet_replica.cc:333] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.859565 11392 raft_consensus.cc:2243] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.860057 11392 raft_consensus.cc:2272] T 40be63f36321487394bd3ee0bd3e794c P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.862527 11392 tablet_replica.cc:333] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.863111 11392 raft_consensus.cc:2243] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.863938 11392 raft_consensus.cc:2272] T 5ce7cd3504f34236b92a9304bae7977b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.865859 11392 tablet_replica.cc:333] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.866367 11392 raft_consensus.cc:2243] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.867128 11392 raft_consensus.cc:2272] T 52337688286f416c8736cfa551d03aea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.868930 11392 tablet_replica.cc:333] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.869590 11392 raft_consensus.cc:2243] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.870054 11392 raft_consensus.cc:2272] T cfe17266fa484c2ebe1f408f2348126b P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.871960 11392 tablet_replica.cc:333] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.872551 11392 raft_consensus.cc:2243] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.872979 11392 raft_consensus.cc:2272] T 2586f1cfce5848caaa69ac93ed67b9d6 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.875737 11392 tablet_replica.cc:333] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.876717 11392 raft_consensus.cc:2243] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.877341 11392 raft_consensus.cc:2272] T 402a280e12134198878e344533753066 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.880532 11392 tablet_replica.cc:333] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.881520 11392 raft_consensus.cc:2243] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.882129 11392 raft_consensus.cc:2272] T 1b4107fcf756467ab86dd05df9d8a366 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.883785 18991 consensus_peers.cc:597] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.885336 11392 tablet_replica.cc:333] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.886384 11392 raft_consensus.cc:2243] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.887575 11392 raft_consensus.cc:2272] T a27793117bd7440cb8d9d04abcb78f46 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.890571 18991 consensus_peers.cc:597] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.890914 11392 tablet_replica.cc:333] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
W20260709 12:27:27.891057 19065 consensus_peers.cc:597] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.892043 11392 raft_consensus.cc:2243] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.892668 11392 raft_consensus.cc:2272] T c795e825a66b48189a7397f6c172a621 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.896011 11392 tablet_replica.cc:333] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.896993 11392 raft_consensus.cc:2243] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.897696 11392 raft_consensus.cc:2272] T 54cf4aa1eaae45588f5272617a664b12 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.900967 11392 tablet_replica.cc:333] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.901880 11392 raft_consensus.cc:2243] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.902804 11392 raft_consensus.cc:2272] T b8e124074de848de84792c3456059de8 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.907810 11392 tablet_replica.cc:333] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.908354 20030 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:27.908886 11392 raft_consensus.cc:2243] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.908952 20030 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:27.909729 11392 raft_consensus.cc:2272] T 5c531f84ef5f49dca1527adcd178ed3a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.911659 20030 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:27.913128 11392 tablet_replica.cc:333] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.914191 11392 raft_consensus.cc:2243] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.915463 11392 raft_consensus.cc:2272] T 819615c6672d40979e8058dd998c1dff P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.918982 11392 tablet_replica.cc:333] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.919931 11392 raft_consensus.cc:2243] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.920595 11392 raft_consensus.cc:2272] T acf2707a8bd640fda22add252bcd5bd2 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.923784 11392 tablet_replica.cc:333] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.924603 11392 raft_consensus.cc:2243] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.925258 11392 raft_consensus.cc:2272] T 556d72ded831470a830cb0f4451a480b P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.925896 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:27.928488 11392 tablet_replica.cc:333] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
W20260709 12:27:27.929381 19065 consensus_peers.cc:597] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.929471 11392 raft_consensus.cc:2243] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.931030 11392 raft_consensus.cc:2272] T 59bfebe89eac4fb0a7733f516b04b007 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.932824 19065 leader_election.cc:336] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:27.934379 11392 tablet_replica.cc:333] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.935424 11392 raft_consensus.cc:2243] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.935627 19065 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:27.936582 20030 raft_consensus.cc:2749] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:27.936654 11392 raft_consensus.cc:2272] T 154018e97da948d78c303aec9ff51f57 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.940338 11392 tablet_replica.cc:333] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
W20260709 12:27:27.941233 19065 consensus_peers.cc:597] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.941339 11392 raft_consensus.cc:2243] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:27.942135 19065 consensus_peers.cc:597] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.942237 11392 raft_consensus.cc:2272] T ee3fe50916684ab8ad38a191ae892eb2 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.945866 11392 tablet_replica.cc:333] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.946780 11392 raft_consensus.cc:2243] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:27:27.946805 19065 consensus_peers.cc:597] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.947695 18991 consensus_peers.cc:597] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.947685 19065 consensus_peers.cc:597] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.948190 11392 raft_consensus.cc:2272] T 238ed3f1ff024aaeaf72c97d614e3c01 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.951058 11392 tablet_replica.cc:333] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.951900 11392 raft_consensus.cc:2243] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.952472 11392 raft_consensus.cc:2272] T dd349f9d1efe4b17a329506502573552 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.954334 19065 consensus_peers.cc:597] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.955294 11392 tablet_replica.cc:333] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.955888 11392 raft_consensus.cc:2243] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.956339 11392 raft_consensus.cc:2272] T 30bc1c45f11a44f79c80125131564f4a P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.956569 19065 consensus_peers.cc:597] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.958451 11392 tablet_replica.cc:333] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.959051 11392 raft_consensus.cc:2243] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.959769 11392 raft_consensus.cc:2272] T 1234203a94d043c99f919323ab576971 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.961910 11392 tablet_replica.cc:333] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.962622 11392 raft_consensus.cc:2243] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.963367 11392 raft_consensus.cc:2272] T 416fa299c26f44b69a5b04ef4d339514 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.964922 18991 consensus_peers.cc:597] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.965190 11392 tablet_replica.cc:333] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.966037 11392 raft_consensus.cc:2243] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.966454 11392 raft_consensus.cc:2272] T e029f7a7f4cc40c0adcc3767c9c581df P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.968683 11392 tablet_replica.cc:333] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.969193 11392 raft_consensus.cc:2243] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.969925 11392 raft_consensus.cc:2272] T bba70b230ee84643b59da80ba7390a2a P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.971694 11392 tablet_replica.cc:333] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.972193 11392 raft_consensus.cc:2243] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.972994 11392 raft_consensus.cc:2272] T 9def37a54ca4491ba21f9e74d8ebe4ed P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.975694 11392 tablet_replica.cc:333] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.976250 11392 raft_consensus.cc:2243] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:27.976991 11392 raft_consensus.cc:2272] T 9b30962081764c9e846593f0908f6cea P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.979089 11392 tablet_replica.cc:333] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.979723 11392 raft_consensus.cc:2243] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.980157 11392 raft_consensus.cc:2272] T 143c53cb7a644bacadbdf430e0f80687 P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.981249 18991 consensus_peers.cc:597] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:27.982561 18991 consensus_peers.cc:597] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:27.982714 11392 tablet_replica.cc:333] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.983350 11392 raft_consensus.cc:2243] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.983853 11392 raft_consensus.cc:2272] T bfbd1061e0be4511b027499bf152444a P 1e1f5beea2f147c9a99d564bf624643c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.985793 11392 tablet_replica.cc:333] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.986322 11392 raft_consensus.cc:2243] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.986728 11392 raft_consensus.cc:2272] T 1923ecfa0beb4e56a72fb14eb30fd44e P 1e1f5beea2f147c9a99d564bf624643c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:27.988525 11392 tablet_replica.cc:333] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c: stopping tablet replica
I20260709 12:27:27.989064 11392 raft_consensus.cc:2243] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:27.989567 11392 raft_consensus.cc:2272] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 1e1f5beea2f147c9a99d564bf624643c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:27.992655 19065 consensus_peers.cc:597] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.004223 18991 consensus_peers.cc:597] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.024413 18991 consensus_peers.cc:597] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.034581 18991 consensus_peers.cc:597] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.168139 20027 raft_consensus.cc:493] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.168670 20027 raft_consensus.cc:515] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:28.170509 20027 leader_election.cc:290] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:28.174113 18991 leader_election.cc:336] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:28.174777 18991 leader_election.cc:336] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:28.175118 18991 leader_election.cc:304] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.175745 20027 raft_consensus.cc:2749] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:28.177596 20027 raft_consensus.cc:493] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.178046 20027 raft_consensus.cc:515] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:28.180089 20027 leader_election.cc:290] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:28.183547 18991 leader_election.cc:336] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:28.184201 18991 leader_election.cc:336] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:28.184454 18991 leader_election.cc:304] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.184926 20027 raft_consensus.cc:2749] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:28.192050 20047 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.192586 20047 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.194957 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.195515 19094 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 3.
I20260709 12:27:28.194442 20047 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.196592 18990 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.197208 20047 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:28.197525 20047 raft_consensus.cc:493] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.197845 20047 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.199016 18991 leader_election.cc:336] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.203511 20047 raft_consensus.cc:515] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.205139 20047 leader_election.cc:290] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.205734 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304e743b0b1c476ead5c8073437f5c1f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:28.206367 19094 raft_consensus.cc:3060] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.208937 18991 leader_election.cc:336] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.212524 19094 raft_consensus.cc:2468] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 4.
I20260709 12:27:28.213524 18990 leader_election.cc:304] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.214102 20047 raft_consensus.cc:2804] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:28.214483 20047 raft_consensus.cc:697] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:28.215139 20047 consensus_queue.cc:237] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.224396 18776 catalog_manager.cc:5697] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 3 to 4, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 4 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.225183 20047 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.225730 20047 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.227639 20047 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.228220 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:28.231662 18991 leader_election.cc:336] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.231995 18991 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:28.232630 20047 raft_consensus.cc:2749] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:27:28.256294 20030 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.256640 20029 raft_consensus.cc:493] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.256920 20030 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.257236 20029 raft_consensus.cc:515] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:28.259290 20029 leader_election.cc:290] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:28.260360 20030 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:28.261853 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:28.264335 20029 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
W20260709 12:27:28.264863 19065 leader_election.cc:336] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.264822 20029 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.265352 19065 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.266080 20030 raft_consensus.cc:2749] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:27:28.267453 18991 leader_election.cc:336] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:28.268302 18991 leader_election.cc:336] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:28.268735 18991 leader_election.cc:304] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.269445 20047 raft_consensus.cc:2749] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:28.271471 20047 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.271924 20047 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.273279 20030 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.273834 20030 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.274777 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.274967 20047 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.275606 20030 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.276963 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:28.277604 20030 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.278120 20030 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.279568 20030 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.280154 20029 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.280651 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.281396 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:28.282021 19021 raft_consensus.cc:2468] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
W20260709 12:27:28.282294 19065 leader_election.cc:336] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.282728 19065 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.283353 20030 raft_consensus.cc:2749] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:28.284026 19065 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.284798 20030 raft_consensus.cc:2804] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:28.285203 20030 raft_consensus.cc:493] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.285514 20030 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:28.286032 18991 leader_election.cc:336] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.286482 18991 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:28.287147 20047 raft_consensus.cc:2749] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:28.287307 18991 leader_election.cc:336] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.287779 18991 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: c6d7b700141440f8997cb5145ad80f79, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:28.288430 20047 raft_consensus.cc:2749] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:28.289685 19065 leader_election.cc:336] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:28.299557 18974 debug-util.cc:398] Leaking SignalData structure 0x7b08002212a0 after lost signal to thread 11395
W20260709 12:27:28.300664 18974 debug-util.cc:398] Leaking SignalData structure 0x7b0800369280 after lost signal to thread 18810
I20260709 12:27:28.301229 20030 raft_consensus.cc:515] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:28.303061 18974 debug-util.cc:398] Leaking SignalData structure 0x7b08002ac520 after lost signal to thread 19051
I20260709 12:27:28.303381 20030 leader_election.cc:290] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:28.304178 18974 debug-util.cc:398] Leaking SignalData structure 0x7b08000d37a0 after lost signal to thread 19125
I20260709 12:27:28.309933 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "43a5a064384d4367a357c422ea87190e" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:28.313728 19021 raft_consensus.cc:3060] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:28.320477 19021 raft_consensus.cc:2468] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 3.
W20260709 12:27:28.323115 19065 leader_election.cc:336] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.324198 19065 leader_election.cc:304] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.324905 20030 raft_consensus.cc:2804] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:28.325374 20030 raft_consensus.cc:697] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 3 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:28.326210 20030 consensus_queue.cc:237] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.329245 20047 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.329974 20047 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.332883 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.335016 19094 raft_consensus.cc:2468] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:28.336621 18990 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.337832 20037 raft_consensus.cc:2804] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:28.338231 20037 raft_consensus.cc:493] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.338593 20037 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:28.344691 20021 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.345352 20021 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.347427 20021 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:28.350493 18991 leader_election.cc:336] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.351280 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:28.351869 20047 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.349318 20037 raft_consensus.cc:515] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.358268 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a78687d4c1044976aff39a7a2fd653f1" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:28.358786 19094 raft_consensus.cc:3060] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:28.359766 19065 leader_election.cc:336] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.359642 18776 catalog_manager.cc:5697] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 2 to 3, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 3 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.360234 19065 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 31bb5a47c5b64d31ade62e132c3dda27, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.365867 19094 raft_consensus.cc:2468] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 3.
I20260709 12:27:28.366454 20037 leader_election.cc:290] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.367053 18990 leader_election.cc:304] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.367316 20030 raft_consensus.cc:2749] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:28.367892 20037 raft_consensus.cc:2804] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:28.368364 20037 raft_consensus.cc:697] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:28.369247 20037 consensus_queue.cc:237] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
W20260709 12:27:28.371071 18991 leader_election.cc:336] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.381546 18773 catalog_manager.cc:5697] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 2 to 3, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.397707 20037 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.398279 20037 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.400442 20037 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.400939 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.401784 19094 raft_consensus.cc:2468] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:28.403344 18990 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.404129 20037 raft_consensus.cc:2804] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:28.404558 20037 raft_consensus.cc:493] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
W20260709 12:27:28.404934 18991 leader_election.cc:336] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.404978 20037 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:28.410851 20037 raft_consensus.cc:515] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.412598 20037 leader_election.cc:290] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: Requested vote from peers c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.413336 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bda58a59bd074fd3bce74d63822c2671" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:28.414034 19094 raft_consensus.cc:3060] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:28.420774 18991 leader_election.cc:336] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.421873 19094 raft_consensus.cc:2468] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 3.
I20260709 12:27:28.423056 18990 leader_election.cc:304] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.426671 20037 raft_consensus.cc:2804] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:28.427181 20037 raft_consensus.cc:697] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:28.428700 20037 consensus_queue.cc:237] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.443392 19989 raft_consensus.cc:493] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.443938 19989 raft_consensus.cc:515] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:28.446290 19989 leader_election.cc:290] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:28.447865 18776 catalog_manager.cc:5697] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 2 to 3, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:28.457556 19065 leader_election.cc:336] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:28.458364 19065 leader_election.cc:336] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.458767 19065 leader_election.cc:304] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.459753 20021 raft_consensus.cc:2749] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:28.530213 19989 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.530795 19989 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.533772 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:28.534497 19021 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 3.
I20260709 12:27:28.533142 19989 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.536724 19065 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.537499 19989 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:28.537946 19989 raft_consensus.cc:493] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.538419 19989 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.539193 19065 leader_election.cc:336] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.547025 19989 raft_consensus.cc:515] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.549912 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cb73782ff8474ba5bfef53d8399b01a7" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:28.550558 19021 raft_consensus.cc:3060] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.555142 19065 leader_election.cc:336] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.549333 19989 leader_election.cc:290] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.558321 19021 raft_consensus.cc:2468] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 4.
I20260709 12:27:28.559508 19065 leader_election.cc:304] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.560320 19989 raft_consensus.cc:2804] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:28.560822 19989 raft_consensus.cc:697] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 4 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:28.562186 19989 consensus_queue.cc:237] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.574370 18776 catalog_manager.cc:5697] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 3 to 4, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 4 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.576074 20047 raft_consensus.cc:493] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.576753 20047 raft_consensus.cc:515] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:28.579015 20047 leader_election.cc:290] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:28.587165 18991 leader_election.cc:336] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:28.587821 18991 leader_election.cc:336] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:28.588201 18991 leader_election.cc:304] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.588838 20047 raft_consensus.cc:2749] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:28.608875 18991 consensus_peers.cc:597] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.726902 19094 raft_consensus.cc:1275] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:28.728271 20047 consensus_queue.cc:1048] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:28.744256 19021 raft_consensus.cc:1275] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:28.745870 20030 consensus_queue.cc:1048] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:28.775539 19065 consensus_peers.cc:597] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.803085 19094 raft_consensus.cc:1275] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:28.804375 20047 consensus_queue.cc:1048] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:28.817566 20027 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.818133 20027 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.820508 20027 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
W20260709 12:27:28.824393 18991 consensus_peers.cc:597] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:28.841621 18991 leader_election.cc:336] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.845441 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.850508 19094 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 3.
I20260709 12:27:28.855582 18990 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.856387 20027 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:27:28.856822 20027 raft_consensus.cc:493] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.857232 20027 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:28.864946 20027 raft_consensus.cc:515] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.867769 20027 leader_election.cc:290] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 election: Requested vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:28.869194 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f20c40417f904c7d97367b1ed0a0c088" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:28.869874 19094 raft_consensus.cc:3060] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:27:28.872251 18991 leader_election.cc:336] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.879709 19094 raft_consensus.cc:2468] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 4.
I20260709 12:27:28.880528 20027 raft_consensus.cc:493] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.880988 18990 leader_election.cc:304] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.881147 20027 raft_consensus.cc:515] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:28.882391 20037 raft_consensus.cc:2804] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:28.882934 20037 raft_consensus.cc:697] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:28.883502 20027 leader_election.cc:290] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:28.883836 20037 consensus_queue.cc:237] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.888595 20021 raft_consensus.cc:493] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.889123 20021 raft_consensus.cc:515] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:28.892153 20021 leader_election.cc:290] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:28.893563 18991 leader_election.cc:336] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:28.896714 19065 leader_election.cc:336] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:28.898851 19065 leader_election.cc:336] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:28.899248 19065 leader_election.cc:304] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.899842 20021 raft_consensus.cc:2749] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:28.899925 18991 leader_election.cc:336] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.900506 18991 leader_election.cc:304] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.901285 20029 raft_consensus.cc:2749] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:27:28.911026 18991 consensus_peers.cc:597] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:28.916960 18776 catalog_manager.cc:5697] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 3 to 4, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 4 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:28.938493 20021 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.939091 20021 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.939245 20037 raft_consensus.cc:493] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:28.939949 20037 raft_consensus.cc:515] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.940478 20029 raft_consensus.cc:493] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:28.941020 20029 raft_consensus.cc:515] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.942679 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:28.943050 20029 leader_election.cc:290] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:28.943349 19022 raft_consensus.cc:2468] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:28.942719 20037 leader_election.cc:290] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:28.944651 19065 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:28.945549 19989 raft_consensus.cc:2804] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:28.945788 20021 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
I20260709 12:27:28.945896 19989 raft_consensus.cc:493] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election (detected failure of leader c6d7b700141440f8997cb5145ad80f79)
I20260709 12:27:28.946525 19989 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:28.946003 19101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
W20260709 12:27:28.951238 18991 leader_election.cc:336] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:28.951787 18991 leader_election.cc:336] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:28.952150 18991 leader_election.cc:304] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:28.952837 20037 raft_consensus.cc:2749] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:28.945393 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:28.957813 18990 leader_election.cc:304] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:28.955858 19989 raft_consensus.cc:515] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.958536 20029 raft_consensus.cc:2749] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:28.959614 19989 leader_election.cc:290] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: Requested vote from peers 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785), c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929)
W20260709 12:27:28.960831 19065 leader_election.cc:336] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.961483 19022 raft_consensus.cc:1275] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:28.963075 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "195b142675bd4c3ba085b783eccf665f" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:28.963522 19022 raft_consensus.cc:3060] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:28.969003 19065 leader_election.cc:336] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:28.969182 19989 consensus_queue.cc:1048] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:28.971391 19022 raft_consensus.cc:2468] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 3.
I20260709 12:27:28.972631 19065 leader_election.cc:304] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:28.973510 19989 raft_consensus.cc:2804] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:28.977173 19989 raft_consensus.cc:697] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 3 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:28.978001 19989 consensus_queue.cc:237] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } }
I20260709 12:27:28.992235 20021 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:28.993028 20021 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:28.995416 20021 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
W20260709 12:27:29.009109 19065 consensus_peers.cc:597] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.014990 19065 leader_election.cc:336] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.015290 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:29.016803 19989 raft_consensus.cc:493] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.017243 20066 raft_consensus.cc:493] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.016940 18776 catalog_manager.cc:5697] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 2 to 3, leader changed from c6d7b700141440f8997cb5145ad80f79 (127.11.32.1) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 3 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:29.017458 19989 raft_consensus.cc:515] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:29.017833 20066 raft_consensus.cc:515] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:29.019835 19989 leader_election.cc:290] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:29.019884 20066 leader_election.cc:290] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:29.023965 19065 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, 31bb5a47c5b64d31ade62e132c3dda27
I20260709 12:27:29.024946 20066 raft_consensus.cc:2749] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:29.028812 19065 leader_election.cc:336] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.029388 19065 leader_election.cc:336] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.030072 19065 leader_election.cc:336] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.030470 19065 leader_election.cc:304] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.031208 20066 raft_consensus.cc:2749] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:29.031332 19065 leader_election.cc:336] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.031893 19065 leader_election.cc:304] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.032615 20066 raft_consensus.cc:2749] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.046253 19094 raft_consensus.cc:1275] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:29.047549 20029 consensus_queue.cc:1048] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:29.063477 11392 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 18974)
I20260709 12:27:29.087287 19989 raft_consensus.cc:493] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.087770 19989 raft_consensus.cc:515] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.089138 19989 leader_election.cc:290] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:29.090607 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:29.091305 19021 raft_consensus.cc:2468] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:29.092813 19065 leader_election.cc:304] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:29.093448 19989 raft_consensus.cc:2804] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:29.093714 19065 leader_election.cc:336] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.093775 19989 raft_consensus.cc:493] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.094378 19989 raft_consensus.cc:3060] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.097785 20066 raft_consensus.cc:493] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.098356 20066 raft_consensus.cc:515] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.099640 19989 raft_consensus.cc:515] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.100574 20066 leader_election.cc:290] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:29.101424 19989 leader_election.cc:290] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:29.102388 19021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:29.102756 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1590223762b24a92b589c7d9db79bb28" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:29.103011 19021 raft_consensus.cc:2468] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:29.103293 19022 raft_consensus.cc:3060] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.104154 19065 leader_election.cc:304] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
W20260709 12:27:29.107187 19065 leader_election.cc:336] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:29.107981 19065 leader_election.cc:336] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.111145 19022 raft_consensus.cc:2468] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:29.112469 19989 raft_consensus.cc:2804] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:29.112586 19065 leader_election.cc:304] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:29.113606 20066 raft_consensus.cc:2804] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:29.114086 20066 raft_consensus.cc:697] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:29.114925 20066 consensus_queue.cc:237] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:29.115631 18991 consensus_peers.cc:597] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.112910 19989 raft_consensus.cc:493] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.118551 19989 raft_consensus.cc:3060] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.125254 19989 raft_consensus.cc:515] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.128234 19989 leader_election.cc:290] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:29.130146 18773 catalog_manager.cc:5697] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 1 to 2, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 2 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.131613 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ce7cd3504f34236b92a9304bae7977b" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:29.132303 19022 raft_consensus.cc:3060] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:29.139053 19065 leader_election.cc:336] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.143234 19022 raft_consensus.cc:2468] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
I20260709 12:27:29.144371 19065 leader_election.cc:304] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:29.145467 19989 raft_consensus.cc:2804] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:29.145942 19989 raft_consensus.cc:697] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:29.146699 19989 consensus_queue.cc:237] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.158066 18773 catalog_manager.cc:5697] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 1 to 2, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 2 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:29.164800 19065 consensus_peers.cc:597] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.191654 19989 raft_consensus.cc:493] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.192293 19989 raft_consensus.cc:515] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:29.195200 19989 leader_election.cc:290] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:29.199781 19065 leader_election.cc:336] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.201723 19065 leader_election.cc:336] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.202056 19065 leader_election.cc:304] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.202651 19989 raft_consensus.cc:2749] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.206730 20029 raft_consensus.cc:493] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.207280 20029 raft_consensus.cc:515] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:29.209276 20029 leader_election.cc:290] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:29.213222 18991 leader_election.cc:336] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.213946 18991 leader_election.cc:336] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.214337 18991 leader_election.cc:304] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.215058 20029 raft_consensus.cc:2749] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:27:29.231942 20029 raft_consensus.cc:493] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.232402 20029 raft_consensus.cc:515] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:29.234263 20029 leader_election.cc:290] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:29.239114 19989 raft_consensus.cc:493] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.239651 19989 raft_consensus.cc:515] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
W20260709 12:27:29.240360 18991 leader_election.cc:336] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.241089 18991 leader_election.cc:336] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.241533 19989 leader_election.cc:290] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:29.241531 18991 leader_election.cc:304] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.242358 20029 raft_consensus.cc:2749] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:29.247398 19065 leader_election.cc:336] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.248091 19065 leader_election.cc:336] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.248497 19065 leader_election.cc:304] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.249240 19989 raft_consensus.cc:2749] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.255872 20029 raft_consensus.cc:493] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.256507 20029 raft_consensus.cc:515] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:29.258690 20029 leader_election.cc:290] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:29.262360 18991 leader_election.cc:336] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.263238 18991 leader_election.cc:336] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.263602 18991 leader_election.cc:304] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.264720 20029 raft_consensus.cc:2749] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:29.297039 18991 consensus_peers.cc:597] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.299849 19989 raft_consensus.cc:493] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.300385 19989 raft_consensus.cc:515] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:29.302179 19989 leader_election.cc:290] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
I20260709 12:27:29.304855 19989 raft_consensus.cc:493] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.305298 19989 raft_consensus.cc:515] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } } peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } }
I20260709 12:27:29.306953 19989 leader_election.cc:290] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:29.313632 19065 leader_election.cc:336] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.314826 19065 leader_election.cc:336] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.315254 19065 leader_election.cc:304] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.315970 19989 raft_consensus.cc:2749] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:27:29.319532 19065 leader_election.cc:336] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
W20260709 12:27:29.320361 19065 leader_election.cc:336] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.320777 19065 leader_election.cc:304] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.321516 19989 raft_consensus.cc:2749] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:29.324512 18991 consensus_peers.cc:597] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.333798 20047 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.334431 20047 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:29.335434 18991 consensus_peers.cc:597] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.337685 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:29.339350 20047 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
W20260709 12:27:29.341030 18991 leader_election.cc:336] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.341508 18991 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c7db7a43db4a4c23bcd749e49623180b
I20260709 12:27:29.342175 20047 raft_consensus.cc:2749] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.347936 20047 raft_consensus.cc:493] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.348488 20047 raft_consensus.cc:515] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:29.350744 20047 leader_election.cc:290] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:29.354434 18991 leader_election.cc:336] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:29.356438 18991 leader_election.cc:336] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:29.356771 18991 leader_election.cc:304] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.356972 20029 raft_consensus.cc:493] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.357685 19989 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.357676 20029 raft_consensus.cc:515] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c6d7b700141440f8997cb5145ad80f79" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44929 } } peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } }
I20260709 12:27:29.358285 19989 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.360077 20029 leader_election.cc:290] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929), 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853)
W20260709 12:27:29.364717 19065 leader_election.cc:336] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:29.364930 18991 leader_election.cc:336] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
W20260709 12:27:29.365609 18991 consensus_peers.cc:597] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.365926 18991 leader_election.cc:336] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111)
I20260709 12:27:29.365988 19989 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:29.366616 20047 raft_consensus.cc:2749] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.366915 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27" is_pre_election: true
I20260709 12:27:29.367556 19022 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 1.
I20260709 12:27:29.366325 18991 leader_election.cc:304] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27; no voters: 1e1f5beea2f147c9a99d564bf624643c, c6d7b700141440f8997cb5145ad80f79
I20260709 12:27:29.368533 20047 raft_consensus.cc:2749] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:29.368582 19065 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:29.369598 19989 raft_consensus.cc:2804] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:29.369879 19989 raft_consensus.cc:493] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Starting leader election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.370113 19989 raft_consensus.cc:3060] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.377523 19989 raft_consensus.cc:515] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.379282 19989 leader_election.cc:290] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785)
I20260709 12:27:29.381191 19022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "154018e97da948d78c303aec9ff51f57" candidate_uuid: "c7db7a43db4a4c23bcd749e49623180b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31bb5a47c5b64d31ade62e132c3dda27"
I20260709 12:27:29.381757 19022 raft_consensus.cc:3060] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:29.386605 19022 raft_consensus.cc:2468] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c7db7a43db4a4c23bcd749e49623180b in term 2.
W20260709 12:27:29.387403 19065 leader_election.cc:336] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.388283 19065 leader_election.cc:304] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:29.389016 19989 raft_consensus.cc:2804] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:29.390537 19989 raft_consensus.cc:697] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Becoming Leader. State: Replica: c7db7a43db4a4c23bcd749e49623180b, State: Running, Role: LEADER
I20260709 12:27:29.391158 19989 consensus_queue.cc:237] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.402643 18773 catalog_manager.cc:5697] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b reported cstate change: term changed from 1 to 2, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to c7db7a43db4a4c23bcd749e49623180b (127.11.32.4). New cstate: current_term: 2 leader_uuid: "c7db7a43db4a4c23bcd749e49623180b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.404070 20047 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.404596 20047 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.407788 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b" is_pre_election: true
I20260709 12:27:29.408370 19094 raft_consensus.cc:2468] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 2.
I20260709 12:27:29.409631 18990 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 
I20260709 12:27:29.410388 20029 raft_consensus.cc:2804] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:29.410749 20029 raft_consensus.cc:493] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 1e1f5beea2f147c9a99d564bf624643c)
I20260709 12:27:29.411127 20029 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:29.419243 20029 raft_consensus.cc:515] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
W20260709 12:27:29.419946 18991 leader_election.cc:336] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.411157 20047 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:29.422295 20029 leader_election.cc:290] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: Requested vote from peers 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853), c7db7a43db4a4c23bcd749e49623180b (127.11.32.4:34167)
I20260709 12:27:29.423290 19094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b8e124074de848de84792c3456059de8" candidate_uuid: "31bb5a47c5b64d31ade62e132c3dda27" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c7db7a43db4a4c23bcd749e49623180b"
I20260709 12:27:29.423923 19094 raft_consensus.cc:3060] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:29.425282 18991 leader_election.cc:336] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111)
I20260709 12:27:29.431165 19094 raft_consensus.cc:2468] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31bb5a47c5b64d31ade62e132c3dda27 in term 3.
I20260709 12:27:29.432271 18990 leader_election.cc:304] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31bb5a47c5b64d31ade62e132c3dda27, c7db7a43db4a4c23bcd749e49623180b; no voters: 1e1f5beea2f147c9a99d564bf624643c
I20260709 12:27:29.433046 20029 raft_consensus.cc:2804] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:29.433513 20029 raft_consensus.cc:697] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: Becoming Leader. State: Replica: 31bb5a47c5b64d31ade62e132c3dda27, State: Running, Role: LEADER
I20260709 12:27:29.434275 20029 consensus_queue.cc:237] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } }
I20260709 12:27:29.446138 18773 catalog_manager.cc:5697] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 reported cstate change: term changed from 2 to 3, leader changed from 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2) to 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "31bb5a47c5b64d31ade62e132c3dda27" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e1f5beea2f147c9a99d564bf624643c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37853 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:29.458730 19065 consensus_peers.cc:597] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.472924 19094 raft_consensus.cc:1275] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Refusing update from remote peer 31bb5a47c5b64d31ade62e132c3dda27: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:29.474089 20029 consensus_queue.cc:1048] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c7db7a43db4a4c23bcd749e49623180b" member_type: VOTER last_known_addr { host: "127.11.32.4" port: 34167 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:29.496989 19022 raft_consensus.cc:1275] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:29.502552 19022 raft_consensus.cc:1275] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:29.502599 19989 consensus_queue.cc:1048] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:29.504465 19065 consensus_peers.cc:597] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.518579 19989 consensus_queue.cc:1048] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:29.541307 19022 raft_consensus.cc:1275] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Refusing update from remote peer c7db7a43db4a4c23bcd749e49623180b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:27:29.550477 19065 consensus_peers.cc:597] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.552055 20074 consensus_queue.cc:1048] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [LEADER]: Connected to new peer: Peer: permanent_uuid: "31bb5a47c5b64d31ade62e132c3dda27" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 45785 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:29.555210 19065 consensus_peers.cc:597] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.586144 19065 consensus_peers.cc:597] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.587870 19065 consensus_peers.cc:597] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.592509 19065 consensus_peers.cc:597] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.594364 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
W20260709 12:27:29.647405 18991 consensus_peers.cc:597] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.658125 18991 consensus_peers.cc:597] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.677834 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
W20260709 12:27:29.692632 19065 consensus_peers.cc:597] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.706230 19065 consensus_peers.cc:597] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.713522 18991 consensus_peers.cc:597] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.715197 19065 consensus_peers.cc:597] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.715452 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:29.716231 11392 tablet_replica.cc:333] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.716882 11392 raft_consensus.cc:2243] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.717784 11392 raft_consensus.cc:2272] T 6a522629731a40c491e370cd123e39e6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.720389 11392 tablet_replica.cc:333] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.721130 11392 raft_consensus.cc:2243] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.721660 11392 raft_consensus.cc:2272] T 1590223762b24a92b589c7d9db79bb28 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.723840 11392 tablet_replica.cc:333] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.724408 11392 raft_consensus.cc:2243] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.724797 11392 raft_consensus.cc:2272] T d157f6240cb74405827f910790c760e7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.727049 11392 tablet_replica.cc:333] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.727897 11392 raft_consensus.cc:2243] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.728396 11392 raft_consensus.cc:2272] T bce2d9aff2e749f5b4b14a488b26a084 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:29.729236 18991 consensus_peers.cc:597] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.730707 11392 tablet_replica.cc:333] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.731544 11392 raft_consensus.cc:2243] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.732422 11392 raft_consensus.cc:2272] T 5338350bbc37481288c0046192ce133a P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.735445 11392 tablet_replica.cc:333] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.736164 11392 raft_consensus.cc:2243] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.736769 11392 raft_consensus.cc:2272] T b4b3804e576c4d499ffeed1aabe213ea P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.738674 11392 tablet_replica.cc:333] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.739274 11392 raft_consensus.cc:2243] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.739681 11392 raft_consensus.cc:2272] T 54bb9118a5c3400e9e4421d2c5f4a918 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.741616 11392 tablet_replica.cc:333] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.742141 11392 raft_consensus.cc:2243] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.742616 11392 raft_consensus.cc:2272] T 880c860fdd004c5c801a87289851b335 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.744813 11392 tablet_replica.cc:333] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.745498 11392 raft_consensus.cc:2243] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.746307 11392 raft_consensus.cc:2272] T 304e743b0b1c476ead5c8073437f5c1f P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:29.747463 19065 consensus_peers.cc:597] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.748433 11392 tablet_replica.cc:333] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.749086 11392 raft_consensus.cc:2243] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.749899 11392 raft_consensus.cc:2272] T a78687d4c1044976aff39a7a2fd653f1 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.752218 11392 tablet_replica.cc:333] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.753010 11392 raft_consensus.cc:2243] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.753723 11392 raft_consensus.cc:2272] T caee18f264a54f23a0400a742d9f7927 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.756389 11392 tablet_replica.cc:333] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.757210 11392 raft_consensus.cc:2243] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.758116 11392 raft_consensus.cc:2272] T cfe17266fa484c2ebe1f408f2348126b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:29.759045 19065 consensus_peers.cc:597] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.760215 11392 tablet_replica.cc:333] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.760916 11392 raft_consensus.cc:2243] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.761749 11392 raft_consensus.cc:2272] T 2586f1cfce5848caaa69ac93ed67b9d6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.763943 11392 tablet_replica.cc:333] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.764533 11392 raft_consensus.cc:2243] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.765290 11392 raft_consensus.cc:2272] T 40be63f36321487394bd3ee0bd3e794c P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.767926 11392 tablet_replica.cc:333] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.768702 11392 raft_consensus.cc:2243] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.769711 11392 raft_consensus.cc:2272] T 68288b50f46b45328211be0d64c50c8a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.772075 11392 tablet_replica.cc:333] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.772670 11392 raft_consensus.cc:2243] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.773152 11392 raft_consensus.cc:2272] T 52337688286f416c8736cfa551d03aea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.775221 11392 tablet_replica.cc:333] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.775802 11392 raft_consensus.cc:2243] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.776252 11392 raft_consensus.cc:2272] T 416fa299c26f44b69a5b04ef4d339514 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.778220 11392 tablet_replica.cc:333] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.778784 11392 raft_consensus.cc:2243] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.779562 11392 raft_consensus.cc:2272] T 96d263d5e9d1495c814b3ea85c3f7c3b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.781745 11392 tablet_replica.cc:333] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.782706 11392 raft_consensus.cc:2243] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.783530 11392 raft_consensus.cc:2272] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.785521 11392 tablet_replica.cc:333] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.786058 11392 raft_consensus.cc:2243] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.786615 11392 raft_consensus.cc:2272] T 5ce7cd3504f34236b92a9304bae7977b P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.789515 11392 tablet_replica.cc:333] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.790226 11392 raft_consensus.cc:2243] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.791119 11392 raft_consensus.cc:2272] T bda58a59bd074fd3bce74d63822c2671 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.793151 11392 tablet_replica.cc:333] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.793780 11392 raft_consensus.cc:2243] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.794253 11392 raft_consensus.cc:2272] T a27793117bd7440cb8d9d04abcb78f46 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.796550 11392 tablet_replica.cc:333] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.797252 11392 raft_consensus.cc:2243] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.798038 11392 raft_consensus.cc:2272] T ee3fe50916684ab8ad38a191ae892eb2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.800204 11392 tablet_replica.cc:333] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.800897 11392 raft_consensus.cc:2243] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.801364 11392 raft_consensus.cc:2272] T 154018e97da948d78c303aec9ff51f57 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.803196 11392 tablet_replica.cc:333] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.803968 11392 raft_consensus.cc:2243] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.804947 11392 raft_consensus.cc:2272] T c795e825a66b48189a7397f6c172a621 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.807416 11392 tablet_replica.cc:333] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.808115 11392 raft_consensus.cc:2243] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.808867 11392 raft_consensus.cc:2272] T 5c531f84ef5f49dca1527adcd178ed3a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.810971 11392 tablet_replica.cc:333] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.811697 11392 raft_consensus.cc:2243] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.812292 11392 pending_rounds.cc:70] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: Trying to abort 1 pending ops.
I20260709 12:27:29.812506 11392 pending_rounds.cc:77] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305625802489548800 op_type: NO_OP noop_request { }
I20260709 12:27:29.812863 11392 raft_consensus.cc:2889] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:29.813174 11392 raft_consensus.cc:2272] T b8e124074de848de84792c3456059de8 P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.815479 11392 tablet_replica.cc:333] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.816056 11392 raft_consensus.cc:2243] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.816500 11392 raft_consensus.cc:2272] T cb73782ff8474ba5bfef53d8399b01a7 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.818682 11392 tablet_replica.cc:333] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.819264 11392 raft_consensus.cc:2243] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.819681 11392 raft_consensus.cc:2272] T acf2707a8bd640fda22add252bcd5bd2 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.821452 11392 tablet_replica.cc:333] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.821940 11392 raft_consensus.cc:2243] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.822644 11392 raft_consensus.cc:2272] T 9c10ea4afc7740068972f8bc611ae37e P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.824286 11392 tablet_replica.cc:333] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.824790 11392 raft_consensus.cc:2243] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.825170 11392 raft_consensus.cc:2272] T 815dce779e1642fd862e279f79c8a118 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.827066 11392 tablet_replica.cc:333] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.827605 11392 raft_consensus.cc:2243] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.828402 11392 raft_consensus.cc:2272] T 556d72ded831470a830cb0f4451a480b P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.830852 11392 tablet_replica.cc:333] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.831408 11392 raft_consensus.cc:2243] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.831826 11392 raft_consensus.cc:2272] T 9b30962081764c9e846593f0908f6cea P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:29.833271 19065 consensus_peers.cc:597] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:29.834034 11392 tablet_replica.cc:333] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.834638 11392 raft_consensus.cc:2243] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.835041 11392 raft_consensus.cc:2272] T 143c53cb7a644bacadbdf430e0f80687 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.836926 11392 tablet_replica.cc:333] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.837482 11392 raft_consensus.cc:2243] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.837859 11392 raft_consensus.cc:2272] T 78854dfb3b15485bb2c2f3f6cc5b294d P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.839589 11392 tablet_replica.cc:333] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.840091 11392 raft_consensus.cc:2243] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.840487 11392 raft_consensus.cc:2272] T 43a5a064384d4367a357c422ea87190e P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.842239 11392 tablet_replica.cc:333] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.842820 11392 raft_consensus.cc:2243] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.843235 11392 raft_consensus.cc:2272] T 195b142675bd4c3ba085b783eccf665f P 31bb5a47c5b64d31ade62e132c3dda27 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.845530 11392 tablet_replica.cc:333] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.846078 11392 raft_consensus.cc:2243] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.846907 11392 raft_consensus.cc:2272] T b50d7fdee8a244cfa677109bb9ca854a P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.848601 11392 tablet_replica.cc:333] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.849081 11392 raft_consensus.cc:2243] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.849509 11392 raft_consensus.cc:2272] T f56e2ce743e6479589da5d8a3788ebb6 P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.851235 11392 tablet_replica.cc:333] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.851719 11392 raft_consensus.cc:2243] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.852459 11392 raft_consensus.cc:2272] T f20c40417f904c7d97367b1ed0a0c088 P 31bb5a47c5b64d31ade62e132c3dda27 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.854628 11392 tablet_replica.cc:333] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.855139 11392 raft_consensus.cc:2243] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.855484 11392 raft_consensus.cc:2272] T f5c3a84e41a54b46b74cd3e02e00bbe3 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.857259 11392 tablet_replica.cc:333] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.857834 11392 raft_consensus.cc:2243] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.858193 11392 raft_consensus.cc:2272] T 1923ecfa0beb4e56a72fb14eb30fd44e P 31bb5a47c5b64d31ade62e132c3dda27 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.859946 11392 tablet_replica.cc:333] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.860394 11392 raft_consensus.cc:2243] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:29.861089 11392 raft_consensus.cc:2272] T dd349f9d1efe4b17a329506502573552 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:29.862946 11392 tablet_replica.cc:333] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27: stopping tablet replica
I20260709 12:27:29.863379 11392 raft_consensus.cc:2243] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:29.863830 11392 raft_consensus.cc:2272] T 1234203a94d043c99f919323ab576971 P 31bb5a47c5b64d31ade62e132c3dda27 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:29.873955 19065 consensus_peers.cc:597] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.876302 19065 consensus_peers.cc:597] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.891330 19065 consensus_peers.cc:597] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b -> Peer c6d7b700141440f8997cb5145ad80f79 (127.11.32.1:44929): Couldn't send request to peer c6d7b700141440f8997cb5145ad80f79. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44929: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:29.905970 19065 consensus_peers.cc:597] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b -> Peer 1e1f5beea2f147c9a99d564bf624643c (127.11.32.2:37853): Couldn't send request to peer 1e1f5beea2f147c9a99d564bf624643c. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:37853: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.917301 18992 connection.cc:466] server connection from 127.0.0.1:43930 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43930 (request call id 754) could send its response
W20260709 12:27:29.918184 19065 consensus_peers.cc:597] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: recv got EOF from 127.11.32.3:45785 (error 108). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:29.933657 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
W20260709 12:27:29.958860 19065 consensus_peers.cc:597] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.968770 19065 consensus_peers.cc:597] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:29.990918 19065 consensus_peers.cc:597] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:30.004462 19065 consensus_peers.cc:597] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:30.004928 19065 consensus_peers.cc:597] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:30.025137 11392 tablet_server.cc:179] TabletServer@127.11.32.4:0 shutting down...
W20260709 12:27:30.039608 19065 consensus_peers.cc:597] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:30.061669 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:30.062917 11392 tablet_replica.cc:333] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
W20260709 12:27:30.063923 19065 consensus_peers.cc:597] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b -> Peer 31bb5a47c5b64d31ade62e132c3dda27 (127.11.32.3:45785): Couldn't send request to peer 31bb5a47c5b64d31ade62e132c3dda27. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.3:45785: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:30.063921 11392 raft_consensus.cc:2243] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.065058 11392 raft_consensus.cc:2272] T 1590223762b24a92b589c7d9db79bb28 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.067364 11392 tablet_replica.cc:333] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.067981 11392 raft_consensus.cc:2243] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.068895 11392 raft_consensus.cc:2272] T dacdbc9e2aed4919814e17b608ac4e19 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.071390 11392 tablet_replica.cc:333] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.072288 11392 raft_consensus.cc:2243] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.072796 11392 raft_consensus.cc:2272] T 819615c6672d40979e8058dd998c1dff P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.075706 11392 tablet_replica.cc:333] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.076386 11392 raft_consensus.cc:2243] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.077178 11392 raft_consensus.cc:2272] T cb73782ff8474ba5bfef53d8399b01a7 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.079108 11392 tablet_replica.cc:333] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.079710 11392 raft_consensus.cc:2243] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.080121 11392 raft_consensus.cc:2272] T 4d55ad11d73d42569f54ef540ebedcc9 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.082417 11392 tablet_replica.cc:333] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.083021 11392 raft_consensus.cc:2243] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.083791 11392 raft_consensus.cc:2272] T bce2d9aff2e749f5b4b14a488b26a084 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.085856 11392 tablet_replica.cc:333] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.086603 11392 raft_consensus.cc:2243] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.087169 11392 raft_consensus.cc:2272] T 6a522629731a40c491e370cd123e39e6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.089699 11392 tablet_replica.cc:333] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.090382 11392 raft_consensus.cc:2243] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.091305 11392 raft_consensus.cc:2272] T 184620f70ba844b09efb04461363f9b7 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.093189 11392 tablet_replica.cc:333] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.093793 11392 raft_consensus.cc:2243] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.094545 11392 raft_consensus.cc:2272] T 880c860fdd004c5c801a87289851b335 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.096354 11392 tablet_replica.cc:333] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.096921 11392 raft_consensus.cc:2243] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.097332 11392 raft_consensus.cc:2272] T 304e743b0b1c476ead5c8073437f5c1f P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.099159 11392 tablet_replica.cc:333] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.099707 11392 raft_consensus.cc:2243] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.100122 11392 raft_consensus.cc:2272] T a78687d4c1044976aff39a7a2fd653f1 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.102072 11392 tablet_replica.cc:333] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.102607 11392 raft_consensus.cc:2243] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.103323 11392 raft_consensus.cc:2272] T 54bb9118a5c3400e9e4421d2c5f4a918 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.105209 11392 tablet_replica.cc:333] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.105836 11392 raft_consensus.cc:2243] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.106554 11392 raft_consensus.cc:2272] T 30bc1c45f11a44f79c80125131564f4a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.108328 11392 tablet_replica.cc:333] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.108875 11392 raft_consensus.cc:2243] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.109277 11392 raft_consensus.cc:2272] T 68288b50f46b45328211be0d64c50c8a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.111119 11392 tablet_replica.cc:333] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.111640 11392 raft_consensus.cc:2243] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.112064 11392 raft_consensus.cc:2272] T 2586f1cfce5848caaa69ac93ed67b9d6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.113848 11392 tablet_replica.cc:333] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.114485 11392 raft_consensus.cc:2243] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.115255 11392 raft_consensus.cc:2272] T 78854dfb3b15485bb2c2f3f6cc5b294d P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.117096 11392 tablet_replica.cc:333] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.117686 11392 raft_consensus.cc:2243] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.118410 11392 raft_consensus.cc:2272] T a6baecd84a26405bb8e40a75edcabb9d P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.120193 11392 tablet_replica.cc:333] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.120718 11392 raft_consensus.cc:2243] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.121116 11392 raft_consensus.cc:2272] T b50d7fdee8a244cfa677109bb9ca854a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.122937 11392 tablet_replica.cc:333] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.123461 11392 raft_consensus.cc:2243] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.124238 11392 raft_consensus.cc:2272] T 195b142675bd4c3ba085b783eccf665f P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.126253 11392 tablet_replica.cc:333] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.126827 11392 raft_consensus.cc:2243] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.127570 11392 raft_consensus.cc:2272] T 43a5a064384d4367a357c422ea87190e P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.129263 11392 tablet_replica.cc:333] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.129807 11392 raft_consensus.cc:2243] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.130262 11392 raft_consensus.cc:2272] T 238ed3f1ff024aaeaf72c97d614e3c01 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.131995 11392 tablet_replica.cc:333] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.132524 11392 raft_consensus.cc:2243] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.132922 11392 raft_consensus.cc:2272] T dd349f9d1efe4b17a329506502573552 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.134688 11392 tablet_replica.cc:333] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.135215 11392 raft_consensus.cc:2243] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.135675 11392 raft_consensus.cc:2272] T 96d263d5e9d1495c814b3ea85c3f7c3b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.137842 11392 tablet_replica.cc:333] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.138371 11392 raft_consensus.cc:2243] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.138775 11392 raft_consensus.cc:2272] T e5af4e1d5b3e4e3f81b1e55817e8ef53 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.140534 11392 tablet_replica.cc:333] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.141086 11392 raft_consensus.cc:2243] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.141898 11392 raft_consensus.cc:2272] T 5ce7cd3504f34236b92a9304bae7977b P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.144034 11392 tablet_replica.cc:333] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.144632 11392 raft_consensus.cc:2243] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.145130 11392 raft_consensus.cc:2272] T bda58a59bd074fd3bce74d63822c2671 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.147039 11392 tablet_replica.cc:333] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.147743 11392 raft_consensus.cc:2243] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.148169 11392 raft_consensus.cc:2272] T c795e825a66b48189a7397f6c172a621 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.150036 11392 tablet_replica.cc:333] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.150563 11392 raft_consensus.cc:2243] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.151312 11392 raft_consensus.cc:2272] T 54cf4aa1eaae45588f5272617a664b12 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.153342 11392 tablet_replica.cc:333] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.153955 11392 raft_consensus.cc:2243] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.154364 11392 raft_consensus.cc:2272] T 5c531f84ef5f49dca1527adcd178ed3a P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.156107 11392 tablet_replica.cc:333] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.156637 11392 raft_consensus.cc:2243] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.157027 11392 raft_consensus.cc:2272] T b8e124074de848de84792c3456059de8 P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.158912 11392 tablet_replica.cc:333] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.159461 11392 raft_consensus.cc:2243] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.159843 11392 raft_consensus.cc:2272] T 59bfebe89eac4fb0a7733f516b04b007 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.161702 11392 tablet_replica.cc:333] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.162218 11392 raft_consensus.cc:2243] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.162907 11392 pending_rounds.cc:70] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: Trying to abort 1 pending ops.
I20260709 12:27:30.163117 11392 pending_rounds.cc:77] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625802313265152 op_type: NO_OP noop_request { }
I20260709 12:27:30.163429 11392 raft_consensus.cc:2889] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:30.163717 11392 raft_consensus.cc:2272] T 154018e97da948d78c303aec9ff51f57 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.166306 11392 tablet_replica.cc:333] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.166874 11392 raft_consensus.cc:2243] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.167241 11392 raft_consensus.cc:2272] T ee3fe50916684ab8ad38a191ae892eb2 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.168951 11392 tablet_replica.cc:333] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.169473 11392 raft_consensus.cc:2243] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.169881 11392 raft_consensus.cc:2272] T 402a280e12134198878e344533753066 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.171546 11392 tablet_replica.cc:333] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.172006 11392 raft_consensus.cc:2243] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.172343 11392 raft_consensus.cc:2272] T 1b4107fcf756467ab86dd05df9d8a366 P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.174027 11392 tablet_replica.cc:333] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.174484 11392 raft_consensus.cc:2243] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.174831 11392 raft_consensus.cc:2272] T bba70b230ee84643b59da80ba7390a2a P c7db7a43db4a4c23bcd749e49623180b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.176622 11392 tablet_replica.cc:333] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.177083 11392 raft_consensus.cc:2243] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.177827 11392 raft_consensus.cc:2272] T e029f7a7f4cc40c0adcc3767c9c581df P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.179634 11392 tablet_replica.cc:333] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.180215 11392 raft_consensus.cc:2243] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.181182 11392 raft_consensus.cc:2272] T 815dce779e1642fd862e279f79c8a118 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.183792 11392 tablet_replica.cc:333] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.184267 11392 raft_consensus.cc:2243] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.184942 11392 raft_consensus.cc:2272] T f56e2ce743e6479589da5d8a3788ebb6 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.186906 11392 tablet_replica.cc:333] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.187373 11392 raft_consensus.cc:2243] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.187745 11392 raft_consensus.cc:2272] T f20c40417f904c7d97367b1ed0a0c088 P c7db7a43db4a4c23bcd749e49623180b [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.189900 11392 tablet_replica.cc:333] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.190371 11392 raft_consensus.cc:2243] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.190752 11392 raft_consensus.cc:2272] T 9def37a54ca4491ba21f9e74d8ebe4ed P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.192631 11392 tablet_replica.cc:333] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.193060 11392 raft_consensus.cc:2243] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.193831 11392 raft_consensus.cc:2272] T 143c53cb7a644bacadbdf430e0f80687 P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.195547 11392 tablet_replica.cc:333] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.195947 11392 raft_consensus.cc:2243] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.196646 11392 raft_consensus.cc:2272] T bfbd1061e0be4511b027499bf152444a P c7db7a43db4a4c23bcd749e49623180b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.198488 11392 tablet_replica.cc:333] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b: stopping tablet replica
I20260709 12:27:30.198884 11392 raft_consensus.cc:2243] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.199555 11392 raft_consensus.cc:2272] T 1923ecfa0beb4e56a72fb14eb30fd44e P c7db7a43db4a4c23bcd749e49623180b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.267350 11392 tablet_server.cc:196] TabletServer@127.11.32.4:0 shutdown complete.
I20260709 12:27:30.325958 11392 master.cc:562] Master@127.11.32.62:37705 shutting down...
I20260709 12:27:30.352149 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:30.352718 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.353049 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1fffedc497074f4a97e3d5e6c101d663: stopping tablet replica
I20260709 12:27:30.375756 11392 master.cc:584] Master@127.11.32.62:37705 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (33850 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:27:30.462316 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:38315
I20260709 12:27:30.463479 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:30.469763 20079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.469810 20078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.470649 20081 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:30.471031 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:30.472195 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:30.472441 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:30.472609 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600050472579 us; error 0 us; skew 500 ppm
I20260709 12:27:30.473155 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:30.475513 11392 webserver.cc:533] Webserver started at http://127.11.32.62:33409/ using document root <none> and password file <none>
I20260709 12:27:30.476017 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:30.476234 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:30.476503 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:30.477716 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "29c403ec09374085971329d90c378b5e"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.481889 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:27:30.485086 20086 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.485857 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:30.486164 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "29c403ec09374085971329d90c378b5e"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.486424 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:30.498967 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:30.500152 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:30.538367 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:38315
I20260709 12:27:30.538471 20137 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:38315 every 8 connection(s)
I20260709 12:27:30.542212 20138 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:30.552306 20138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e: Bootstrap starting.
I20260709 12:27:30.556946 20138 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:30.560971 20138 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e: No bootstrap required, opened a new log
I20260709 12:27:30.563042 20138 raft_consensus.cc:359] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c403ec09374085971329d90c378b5e" member_type: VOTER }
I20260709 12:27:30.563411 20138 raft_consensus.cc:385] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:30.563586 20138 raft_consensus.cc:740] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 29c403ec09374085971329d90c378b5e, State: Initialized, Role: FOLLOWER
I20260709 12:27:30.564076 20138 consensus_queue.cc:260] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c403ec09374085971329d90c378b5e" member_type: VOTER }
I20260709 12:27:30.564469 20138 raft_consensus.cc:399] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:30.564656 20138 raft_consensus.cc:493] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:30.564857 20138 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:30.569165 20138 raft_consensus.cc:515] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c403ec09374085971329d90c378b5e" member_type: VOTER }
I20260709 12:27:30.569629 20138 leader_election.cc:304] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 29c403ec09374085971329d90c378b5e; no voters: 
I20260709 12:27:30.570643 20138 leader_election.cc:290] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:30.571043 20141 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:30.572357 20141 raft_consensus.cc:697] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 1 LEADER]: Becoming Leader. State: Replica: 29c403ec09374085971329d90c378b5e, State: Running, Role: LEADER
I20260709 12:27:30.573012 20141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c403ec09374085971329d90c378b5e" member_type: VOTER }
I20260709 12:27:30.573603 20138 sys_catalog.cc:565] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:30.577275 20142 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "29c403ec09374085971329d90c378b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c403ec09374085971329d90c378b5e" member_type: VOTER } }
I20260709 12:27:30.578009 20142 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:30.577905 20143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 29c403ec09374085971329d90c378b5e. Latest consensus state: current_term: 1 leader_uuid: "29c403ec09374085971329d90c378b5e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "29c403ec09374085971329d90c378b5e" member_type: VOTER } }
I20260709 12:27:30.578536 20143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:30.580353 20148 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:30.586786 20148 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:30.587975 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:30.594986 20148 catalog_manager.cc:1383] Generated new cluster ID: d8823814cdb04dd19143762e77a1ef9b
I20260709 12:27:30.595279 20148 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:30.608518 20148 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:30.609839 20148 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:30.621502 20148 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e: Generated new TSK 0
I20260709 12:27:30.622123 20148 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:30.654314 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:30.660040 20159 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.661118 20160 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.662766 20162 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:30.663228 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:30.664177 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:30.664361 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:30.664477 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600050664467 us; error 0 us; skew 500 ppm
I20260709 12:27:30.664932 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:30.667215 11392 webserver.cc:533] Webserver started at http://127.11.32.1:35915/ using document root <none> and password file <none>
I20260709 12:27:30.667965 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:30.668162 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:30.668378 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:30.669389 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "cfc074dfd8724e20b4199aabd22c1da7"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.673861 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.002s
I20260709 12:27:30.677006 20167 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.677783 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:30.678074 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "cfc074dfd8724e20b4199aabd22c1da7"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.678382 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:30.690258 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:30.691459 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:30.692919 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:30.695225 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:30.695446 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.695693 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:30.695875 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.735496 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:46079
I20260709 12:27:30.735597 20229 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:46079 every 8 connection(s)
I20260709 12:27:30.740605 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:30.747648 20234 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.749548 20235 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.751325 20237 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:30.752278 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:30.753471 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:30.753832 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:30.754083 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600050754042 us; error 0 us; skew 500 ppm
I20260709 12:27:30.754690 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:30.758095 11392 webserver.cc:533] Webserver started at http://127.11.32.2:36069/ using document root <none> and password file <none>
I20260709 12:27:30.758833 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:30.759126 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:30.759480 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:30.759539 20230 heartbeater.cc:344] Connected to a master server at 127.11.32.62:38315
I20260709 12:27:30.760075 20230 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:30.761014 20230 heartbeater.cc:507] Master 127.11.32.62:38315 requested a full tablet report, sending...
I20260709 12:27:30.761111 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.763180 20103 ts_manager.cc:194] Registered new tserver with Master: cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079)
I20260709 12:27:30.764932 20103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44160
I20260709 12:27:30.767000 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:30.770736 20242 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.771553 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:27:30.771904 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.772257 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:30.792889 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:30.794286 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:30.795840 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:30.798250 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:30.798491 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.798760 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:30.798961 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.841696 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:37133
I20260709 12:27:30.841801 20304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:37133 every 8 connection(s)
I20260709 12:27:30.846874 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:30.854991 20308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:30.856045 20309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:30.859807 11392 server_base.cc:1061] running on GCE node
W20260709 12:27:30.859910 20311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:30.860875 20305 heartbeater.cc:344] Connected to a master server at 127.11.32.62:38315
I20260709 12:27:30.861209 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:30.861286 20305 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:30.861586 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:30.861809 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600050861793 us; error 0 us; skew 500 ppm
I20260709 12:27:30.862272 20305 heartbeater.cc:507] Master 127.11.32.62:38315 requested a full tablet report, sending...
I20260709 12:27:30.862401 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:30.864802 20103 ts_manager.cc:194] Registered new tserver with Master: 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:30.865041 11392 webserver.cc:533] Webserver started at http://127.11.32.3:41425/ using document root <none> and password file <none>
I20260709 12:27:30.865697 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:30.865914 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:30.866201 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:30.866670 20103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44168
I20260709 12:27:30.867444 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "3bea6aa9be084b209331d1e1df73f50a"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.871943 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:27:30.875288 20316 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.876086 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.001s
I20260709 12:27:30.876392 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "3bea6aa9be084b209331d1e1df73f50a"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:30.876667 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:30.899247 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:30.900458 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:30.901937 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:30.904167 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:30.904403 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.904652 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:30.904829 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:30.945186 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:43919
I20260709 12:27:30.945286 20378 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:43919 every 8 connection(s)
I20260709 12:27:30.959458 20379 heartbeater.cc:344] Connected to a master server at 127.11.32.62:38315
I20260709 12:27:30.959865 20379 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:30.960631 20379 heartbeater.cc:507] Master 127.11.32.62:38315 requested a full tablet report, sending...
I20260709 12:27:30.962628 20103 ts_manager.cc:194] Registered new tserver with Master: 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:30.963032 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014678784s
I20260709 12:27:30.964331 20103 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44182
I20260709 12:27:30.988299 20103 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44192:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:30.991266 20103 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:31.065672 20195 tablet_service.cc:1511] Processing CreateTablet for tablet b6430b1520934bdb9c54df1c16537e5a (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:31.067541 20195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6430b1520934bdb9c54df1c16537e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.075173 20194 tablet_service.cc:1511] Processing CreateTablet for tablet 466cc6ced51e432c8c046d431c45caaa (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:31.076891 20194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466cc6ced51e432c8c046d431c45caaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.085628 20193 tablet_service.cc:1511] Processing CreateTablet for tablet 87a08e565f9749fd955647ad42f3fb70 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:31.087105 20193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a08e565f9749fd955647ad42f3fb70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.087836 20344 tablet_service.cc:1511] Processing CreateTablet for tablet b6430b1520934bdb9c54df1c16537e5a (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:31.089293 20270 tablet_service.cc:1511] Processing CreateTablet for tablet b6430b1520934bdb9c54df1c16537e5a (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:27:31.090592 20270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6430b1520934bdb9c54df1c16537e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.090811 20269 tablet_service.cc:1511] Processing CreateTablet for tablet 466cc6ced51e432c8c046d431c45caaa (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:31.092226 20269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466cc6ced51e432c8c046d431c45caaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.095678 20192 tablet_service.cc:1511] Processing CreateTablet for tablet 304aba70cb844550ad7863632af7e862 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:31.097111 20192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304aba70cb844550ad7863632af7e862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.098605 20190 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3dfc6d8f134bed9745a3d19a6393f2 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:31.100697 20191 tablet_service.cc:1511] Processing CreateTablet for tablet 390c5ec062384ca2aab6116008621490 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:31.103327 20344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6430b1520934bdb9c54df1c16537e5a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.104122 20189 tablet_service.cc:1511] Processing CreateTablet for tablet 002242eb48944ce88b8ec4d41d6bfe32 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:31.106825 20189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002242eb48944ce88b8ec4d41d6bfe32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.108283 20190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3dfc6d8f134bed9745a3d19a6393f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.118613 20268 tablet_service.cc:1511] Processing CreateTablet for tablet 87a08e565f9749fd955647ad42f3fb70 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:31.120131 20268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a08e565f9749fd955647ad42f3fb70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.126318 20191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c5ec062384ca2aab6116008621490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.129621 20264 tablet_service.cc:1511] Processing CreateTablet for tablet 002242eb48944ce88b8ec4d41d6bfe32 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:31.132494 20265 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3dfc6d8f134bed9745a3d19a6393f2 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:31.133504 20267 tablet_service.cc:1511] Processing CreateTablet for tablet 304aba70cb844550ad7863632af7e862 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:31.134573 20342 tablet_service.cc:1511] Processing CreateTablet for tablet 87a08e565f9749fd955647ad42f3fb70 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:27:31.134744 20343 tablet_service.cc:1511] Processing CreateTablet for tablet 466cc6ced51e432c8c046d431c45caaa (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:27:31.135242 20266 tablet_service.cc:1511] Processing CreateTablet for tablet 390c5ec062384ca2aab6116008621490 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:31.141286 20342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87a08e565f9749fd955647ad42f3fb70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.142200 20343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 466cc6ced51e432c8c046d431c45caaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.144037 20263 tablet_service.cc:1511] Processing CreateTablet for tablet 9d73675e6a604e12aab58bcde7af807a (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:31.147394 20263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d73675e6a604e12aab58bcde7af807a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.147742 20341 tablet_service.cc:1511] Processing CreateTablet for tablet 304aba70cb844550ad7863632af7e862 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:27:31.148304 20194 tablet_service.cc:1511] Processing CreateTablet for tablet 9d73675e6a604e12aab58bcde7af807a (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:31.149261 20341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304aba70cb844550ad7863632af7e862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.149624 20194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d73675e6a604e12aab58bcde7af807a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.150727 20338 tablet_service.cc:1511] Processing CreateTablet for tablet 002242eb48944ce88b8ec4d41d6bfe32 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:27:31.152211 20338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002242eb48944ce88b8ec4d41d6bfe32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.154665 20340 tablet_service.cc:1511] Processing CreateTablet for tablet 390c5ec062384ca2aab6116008621490 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:27:31.156088 20340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c5ec062384ca2aab6116008621490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.158671 20339 tablet_service.cc:1511] Processing CreateTablet for tablet 0e3dfc6d8f134bed9745a3d19a6393f2 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:27:31.160063 20339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3dfc6d8f134bed9745a3d19a6393f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.160277 20188 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5518058cf4f9fb2e620900b82ca09 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:31.162580 20337 tablet_service.cc:1511] Processing CreateTablet for tablet 9d73675e6a604e12aab58bcde7af807a (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:27:31.163897 20337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9d73675e6a604e12aab58bcde7af807a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.165730 20188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5518058cf4f9fb2e620900b82ca09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.189566 20264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 002242eb48944ce88b8ec4d41d6bfe32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.190351 20267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 304aba70cb844550ad7863632af7e862. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.195744 20265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e3dfc6d8f134bed9745a3d19a6393f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.201776 20266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 390c5ec062384ca2aab6116008621490. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.215721 20394 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.223690 20262 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5518058cf4f9fb2e620900b82ca09 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:31.225214 20262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5518058cf4f9fb2e620900b82ca09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.237000 20336 tablet_service.cc:1511] Processing CreateTablet for tablet 46c5518058cf4f9fb2e620900b82ca09 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:27:31.238736 20336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46c5518058cf4f9fb2e620900b82ca09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.239802 20395 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.246340 20395 tablet_bootstrap.cc:654] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.251366 20394 tablet_bootstrap.cc:654] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.268812 20268 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2af93ab404919a703bcd89e3ab576 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:31.269150 20195 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2af93ab404919a703bcd89e3ab576 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:31.270773 20195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2af93ab404919a703bcd89e3ab576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.270844 20342 tablet_service.cc:1511] Processing CreateTablet for tablet 3be2af93ab404919a703bcd89e3ab576 (DEFAULT_TABLE table=test-workload [id=83196654ee2c47cc9af734b9dcb93167]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:27:31.272127 20342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2af93ab404919a703bcd89e3ab576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.285748 20268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3be2af93ab404919a703bcd89e3ab576. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:31.298314 20396 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.306607 20394 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.307188 20394 ts_tablet_manager.cc:1403] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.092s	user 0.027s	sys 0.009s
I20260709 12:27:31.307484 20395 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.307999 20395 ts_tablet_manager.cc:1403] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.068s	user 0.006s	sys 0.038s
I20260709 12:27:31.310189 20394 raft_consensus.cc:359] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.310945 20394 raft_consensus.cc:385] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.311251 20394 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.316118 20395 raft_consensus.cc:359] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.316926 20395 raft_consensus.cc:385] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.317217 20395 raft_consensus.cc:740] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.325224 20394 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.326138 20395 consensus_queue.cc:260] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.324262 20396 tablet_bootstrap.cc:654] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.334676 20394 ts_tablet_manager.cc:1434] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.027s	user 0.009s	sys 0.000s
I20260709 12:27:31.337237 20396 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.337831 20396 ts_tablet_manager.cc:1403] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.004s
I20260709 12:27:31.339291 20230 heartbeater.cc:499] Master 127.11.32.62:38315 was elected leader, sending a full tablet report...
I20260709 12:27:31.343796 20394 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.355898 20396 raft_consensus.cc:359] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.356712 20396 raft_consensus.cc:385] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.357044 20396 raft_consensus.cc:740] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.357837 20305 heartbeater.cc:499] Master 127.11.32.62:38315 was elected leader, sending a full tablet report...
I20260709 12:27:31.359119 20394 tablet_bootstrap.cc:654] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.359946 20395 ts_tablet_manager.cc:1434] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.052s	user 0.026s	sys 0.013s
I20260709 12:27:31.364465 20395 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.367336 20396 consensus_queue.cc:260] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.371152 20395 tablet_bootstrap.cc:654] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.371583 20394 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.372156 20394 ts_tablet_manager.cc:1403] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.029s	user 0.010s	sys 0.000s
I20260709 12:27:31.374768 20379 heartbeater.cc:499] Master 127.11.32.62:38315 was elected leader, sending a full tablet report...
I20260709 12:27:31.376502 20396 ts_tablet_manager.cc:1434] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 12:27:31.377868 20396 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.383697 20394 raft_consensus.cc:359] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.384727 20394 raft_consensus.cc:385] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.385200 20394 raft_consensus.cc:740] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.386482 20394 consensus_queue.cc:260] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.388134 20395 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.388595 20396 tablet_bootstrap.cc:654] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.388676 20395 ts_tablet_manager.cc:1403] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 12:27:31.388916 20394 ts_tablet_manager.cc:1434] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.005s
I20260709 12:27:31.390108 20394 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.392119 20395 raft_consensus.cc:359] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.393079 20395 raft_consensus.cc:385] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.393491 20395 raft_consensus.cc:740] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.394667 20395 consensus_queue.cc:260] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.396746 20394 tablet_bootstrap.cc:654] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.400022 20396 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.400496 20396 ts_tablet_manager.cc:1403] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 12:27:31.401314 20395 ts_tablet_manager.cc:1434] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.001s
I20260709 12:27:31.402438 20395 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.403388 20396 raft_consensus.cc:359] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.404145 20396 raft_consensus.cc:385] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.404451 20396 raft_consensus.cc:740] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.405247 20399 raft_consensus.cc:493] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.405532 20396 consensus_queue.cc:260] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.406210 20399 raft_consensus.cc:515] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.407980 20396 ts_tablet_manager.cc:1434] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:31.409000 20396 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.409276 20395 tablet_bootstrap.cc:654] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.416349 20399 leader_election.cc:290] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.418345 20396 tablet_bootstrap.cc:654] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.429728 20395 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.430415 20395 ts_tablet_manager.cc:1403] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.012s
I20260709 12:27:31.433662 20396 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.433540 20395 raft_consensus.cc:359] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.434267 20396 ts_tablet_manager.cc:1403] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:27:31.434310 20395 raft_consensus.cc:385] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.434742 20395 raft_consensus.cc:740] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.435676 20395 consensus_queue.cc:260] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.437335 20396 raft_consensus.cc:359] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.438122 20396 raft_consensus.cc:385] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.438422 20396 raft_consensus.cc:740] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.439397 20396 consensus_queue.cc:260] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.441855 20396 ts_tablet_manager.cc:1434] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:27:31.442584 20395 ts_tablet_manager.cc:1434] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.005s
I20260709 12:27:31.442864 20396 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.443598 20395 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
W20260709 12:27:31.449308 20380 tablet.cc:2406] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:31.449958 20396 tablet_bootstrap.cc:654] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.450376 20395 tablet_bootstrap.cc:654] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.483472 20400 raft_consensus.cc:493] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.484203 20400 raft_consensus.cc:515] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.495009 20396 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.500597 20400 leader_election.cc:290] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.498977 20396 ts_tablet_manager.cc:1403] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.056s	user 0.021s	sys 0.031s
I20260709 12:27:31.505939 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:31.507004 20354 raft_consensus.cc:2468] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:31.509434 20169 leader_election.cc:304] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.510689 20399 raft_consensus.cc:2804] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.511185 20399 raft_consensus.cc:493] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.511612 20399 raft_consensus.cc:3060] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.524720 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:31.525558 20280 raft_consensus.cc:2468] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:31.526413 20395 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.526968 20395 ts_tablet_manager.cc:1403] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.084s	user 0.041s	sys 0.031s
I20260709 12:27:31.526675 20399 raft_consensus.cc:515] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.527870 20394 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.528394 20394 ts_tablet_manager.cc:1403] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.139s	user 0.036s	sys 0.070s
I20260709 12:27:31.529516 20396 raft_consensus.cc:359] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.529814 20395 raft_consensus.cc:359] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.530279 20396 raft_consensus.cc:385] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.530370 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:31.530552 20395 raft_consensus.cc:385] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.530942 20395 raft_consensus.cc:740] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.531005 20354 raft_consensus.cc:3060] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.531291 20394 raft_consensus.cc:359] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.531993 20394 raft_consensus.cc:385] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.531898 20395 consensus_queue.cc:260] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.533836 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:31.534281 20395 ts_tablet_manager.cc:1434] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:31.534415 20280 raft_consensus.cc:3060] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.535313 20395 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.532415 20394 raft_consensus.cc:740] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.537318 20396 raft_consensus.cc:740] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.543190 20354 raft_consensus.cc:2468] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:31.538955 20399 leader_election.cc:290] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Requested vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.544471 20169 leader_election.cc:304] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.539510 20396 consensus_queue.cc:260] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.538002 20394 consensus_queue.cc:260] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.544904 20395 tablet_bootstrap.cc:654] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.546428 20399 raft_consensus.cc:2804] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.550518 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a08e565f9749fd955647ad42f3fb70" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
W20260709 12:27:31.557909 20244 leader_election.cc:343] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.560750 20396 ts_tablet_manager.cc:1434] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:27:31.561648 20280 raft_consensus.cc:2468] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:31.564240 20396 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.567585 20399 raft_consensus.cc:697] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Becoming Leader. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Running, Role: LEADER
I20260709 12:27:31.567981 20418 raft_consensus.cc:493] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.568470 20418 raft_consensus.cc:515] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.568744 20399 consensus_queue.cc:237] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.571483 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a08e565f9749fd955647ad42f3fb70" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:31.572417 20354 raft_consensus.cc:2468] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 0.
I20260709 12:27:31.574158 20244 leader_election.cc:304] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:31.575276 20400 raft_consensus.cc:2804] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.575799 20400 raft_consensus.cc:493] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.576167 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:31.576239 20400 raft_consensus.cc:3060] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.578800 20394 ts_tablet_manager.cc:1434] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.050s	user 0.010s	sys 0.002s
I20260709 12:27:31.579977 20394 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.583386 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
W20260709 12:27:31.583750 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:31.583988 20418 leader_election.cc:290] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.586946 20400 raft_consensus.cc:515] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.584896 20280 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:31.584123 20354 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:31.587745 20394 tablet_bootstrap.cc:654] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.590029 20396 tablet_bootstrap.cc:654] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.590742 20395 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.590750 20169 leader_election.cc:304] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.591548 20395 ts_tablet_manager.cc:1403] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.056s	user 0.011s	sys 0.038s
I20260709 12:27:31.591801 20418 raft_consensus.cc:2804] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.592217 20418 raft_consensus.cc:493] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.592658 20418 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.595729 20395 raft_consensus.cc:359] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.596746 20395 raft_consensus.cc:385] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.597069 20395 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.598074 20395 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.601215 20101 catalog_manager.cc:5697] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "cfc074dfd8724e20b4199aabd22c1da7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.602473 20418 raft_consensus.cc:515] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.605086 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a08e565f9749fd955647ad42f3fb70" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:31.605891 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
W20260709 12:27:31.608029 20244 leader_election.cc:343] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.609133 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a08e565f9749fd955647ad42f3fb70" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:31.609958 20354 raft_consensus.cc:3060] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.611280 20395 ts_tablet_manager.cc:1434] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.019s	user 0.013s	sys 0.003s
I20260709 12:27:31.613531 20400 leader_election.cc:290] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.617731 20395 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.621671 20354 raft_consensus.cc:2468] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:31.624285 20418 leader_election.cc:290] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Requested vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.625231 20244 leader_election.cc:304] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:31.625823 20353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:31.626627 20353 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.627753 20422 raft_consensus.cc:2804] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.628306 20422 raft_consensus.cc:697] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:31.629156 20422 consensus_queue.cc:237] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.630807 20395 tablet_bootstrap.cc:654] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.638743 20394 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.639397 20394 ts_tablet_manager.cc:1403] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.060s	user 0.006s	sys 0.008s
I20260709 12:27:31.639838 20396 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.639775 20353 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:31.640856 20396 ts_tablet_manager.cc:1403] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.077s	user 0.030s	sys 0.013s
I20260709 12:27:31.641350 20169 leader_election.cc:304] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:31.642630 20418 raft_consensus.cc:2804] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.642310 20394 raft_consensus.cc:359] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.643108 20394 raft_consensus.cc:385] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.643121 20418 raft_consensus.cc:697] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Becoming Leader. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Running, Role: LEADER
I20260709 12:27:31.643448 20394 raft_consensus.cc:740] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.644220 20418 consensus_queue.cc:237] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.649338 20403 raft_consensus.cc:493] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.649906 20403 raft_consensus.cc:515] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.652225 20396 raft_consensus.cc:359] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.653348 20396 raft_consensus.cc:385] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.655694 20396 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.656797 20396 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.655054 20403 leader_election.cc:290] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:31.684245 20394 consensus_queue.cc:260] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.690716 20399 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.691377 20394 ts_tablet_manager.cc:1434] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.000s
I20260709 12:27:31.692840 20394 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.691256 20399 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.695631 20399 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.697211 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:31.697968 20280 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:31.699815 20171 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.701388 20101 catalog_manager.cc:5697] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "cfc074dfd8724e20b4199aabd22c1da7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.702090 20103 catalog_manager.cc:5697] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.705118 20395 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.703896 20353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:31.705677 20395 ts_tablet_manager.cc:1403] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.088s	user 0.038s	sys 0.023s
I20260709 12:27:31.706096 20353 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:31.707139 20399 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.707566 20399 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.707906 20399 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.709383 20395 raft_consensus.cc:359] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.710196 20395 raft_consensus.cc:385] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.710621 20395 raft_consensus.cc:740] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.711205 20396 ts_tablet_manager.cc:1434] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.069s	user 0.012s	sys 0.004s
I20260709 12:27:31.711678 20395 consensus_queue.cc:260] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.715653 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:31.716719 20394 tablet_bootstrap.cc:654] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.717149 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
I20260709 12:27:31.715651 20396 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
W20260709 12:27:31.718983 20318 leader_election.cc:343] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:31.719674 20320 leader_election.cc:343] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.720124 20320 leader_election.cc:304] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a; no voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:31.723372 20395 ts_tablet_manager.cc:1434] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260709 12:27:31.723829 20431 raft_consensus.cc:2749] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:31.724519 20399 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.725512 20395 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.727811 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:31.728416 20280 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.732326 20395 tablet_bootstrap.cc:654] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.736784 20280 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:31.739439 20399 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Requested vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.739853 20353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:31.740828 20171 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.740561 20396 tablet_bootstrap.cc:654] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.742118 20418 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.742801 20418 raft_consensus.cc:697] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Becoming Leader. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Running, Role: LEADER
I20260709 12:27:31.743891 20418 consensus_queue.cc:237] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.741042 20353 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.749878 20394 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.751868 20353 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:31.753738 20394 ts_tablet_manager.cc:1403] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.000s
I20260709 12:27:31.754890 20396 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.755350 20396 ts_tablet_manager.cc:1403] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.040s	user 0.011s	sys 0.001s
I20260709 12:27:31.756382 20394 raft_consensus.cc:359] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.757019 20394 raft_consensus.cc:385] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.757264 20394 raft_consensus.cc:740] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.758035 20394 consensus_queue.cc:260] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.759268 20395 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.758754 20396 raft_consensus.cc:359] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.759950 20395 ts_tablet_manager.cc:1403] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.013s
I20260709 12:27:31.759886 20396 raft_consensus.cc:385] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.760586 20394 ts_tablet_manager.cc:1434] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:31.760583 20396 raft_consensus.cc:740] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.761818 20394 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.762495 20396 consensus_queue.cc:260] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.763367 20395 raft_consensus.cc:359] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.764189 20395 raft_consensus.cc:385] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.764500 20395 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.765290 20395 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.766108 20396 ts_tablet_manager.cc:1434] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260709 12:27:31.767204 20396 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.767997 20395 ts_tablet_manager.cc:1434] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:31.768890 20394 tablet_bootstrap.cc:654] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.769035 20395 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.773654 20396 tablet_bootstrap.cc:654] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.773900 20422 raft_consensus.cc:493] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.774410 20422 raft_consensus.cc:515] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.776682 20422 leader_election.cc:290] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.777184 20395 tablet_bootstrap.cc:654] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.779420 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
I20260709 12:27:31.780857 20394 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.781564 20394 ts_tablet_manager.cc:1403] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
W20260709 12:27:31.782474 20244 leader_election.cc:343] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.789935 20394 raft_consensus.cc:359] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.791040 20394 raft_consensus.cc:385] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.791438 20394 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.792577 20394 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.796168 20394 ts_tablet_manager.cc:1434] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:27:31.797513 20394 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.802757 20395 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.803383 20395 ts_tablet_manager.cc:1403] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.035s	user 0.021s	sys 0.012s
I20260709 12:27:31.805882 20394 tablet_bootstrap.cc:654] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.807746 20395 raft_consensus.cc:359] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.808548 20395 raft_consensus.cc:385] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.808863 20395 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.809960 20395 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.810436 20353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:31.811391 20353 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 0.
I20260709 12:27:31.812988 20244 leader_election.cc:304] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:31.813280 20395 ts_tablet_manager.cc:1434] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:27:31.814792 20395 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.814751 20422 raft_consensus.cc:2804] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.815498 20422 raft_consensus.cc:493] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.815886 20422 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.818030 20394 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.818570 20394 ts_tablet_manager.cc:1403] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260709 12:27:31.821475 20394 raft_consensus.cc:359] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.822203 20394 raft_consensus.cc:385] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.822520 20394 raft_consensus.cc:740] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.823287 20394 consensus_queue.cc:260] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.825161 20422 raft_consensus.cc:515] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.827909 20422 leader_election.cc:290] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.825992 20394 ts_tablet_manager.cc:1434] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:27:31.829242 20394 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.829615 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:31.830178 20395 tablet_bootstrap.cc:654] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.830626 20205 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.834350 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:31.835040 20354 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.836697 20394 tablet_bootstrap.cc:654] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.842703 20205 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:31.843976 20354 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:31.844156 20244 leader_election.cc:304] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.845710 20422 raft_consensus.cc:2804] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.846218 20422 raft_consensus.cc:697] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:31.847169 20422 consensus_queue.cc:237] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.852847 20394 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.853385 20394 ts_tablet_manager.cc:1403] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.000s
I20260709 12:27:31.854719 20399 raft_consensus.cc:493] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.855425 20399 raft_consensus.cc:515] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.856324 20394 raft_consensus.cc:359] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.857252 20394 raft_consensus.cc:385] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.857648 20394 raft_consensus.cc:740] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.858402 20399 leader_election.cc:290] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.858441 20394 consensus_queue.cc:260] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.860381 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a08e565f9749fd955647ad42f3fb70" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:31.861503 20354 raft_consensus.cc:2393] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cfc074dfd8724e20b4199aabd22c1da7 in current term 1: Already voted for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in this term.
I20260709 12:27:31.861579 20394 ts_tablet_manager.cc:1434] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 12:27:31.862802 20394 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.862965 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87a08e565f9749fd955647ad42f3fb70" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:31.866318 20171 leader_election.cc:304] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cfc074dfd8724e20b4199aabd22c1da7; no voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:31.867892 20399 raft_consensus.cc:3060] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.868575 20394 tablet_bootstrap.cc:654] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.869709 20102 catalog_manager.cc:5697] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.879618 20399 raft_consensus.cc:2749] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:31.885609 20394 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.886201 20394 ts_tablet_manager.cc:1403] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.024s	user 0.003s	sys 0.016s
I20260709 12:27:31.887234 20101 catalog_manager.cc:5697] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "cfc074dfd8724e20b4199aabd22c1da7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.894711 20396 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.895318 20396 ts_tablet_manager.cc:1403] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.128s	user 0.056s	sys 0.053s
I20260709 12:27:31.893507 20394 raft_consensus.cc:359] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.895628 20422 raft_consensus.cc:493] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.895737 20394 raft_consensus.cc:385] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.898092 20395 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.898756 20395 ts_tablet_manager.cc:1403] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.036s
I20260709 12:27:31.898344 20394 raft_consensus.cc:740] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.898315 20396 raft_consensus.cc:359] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.899919 20396 raft_consensus.cc:385] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.898353 20422 raft_consensus.cc:515] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.899879 20394 consensus_queue.cc:260] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.900377 20396 raft_consensus.cc:740] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.902381 20394 ts_tablet_manager.cc:1434] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.004s
I20260709 12:27:31.903326 20394 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:31.903003 20395 raft_consensus.cc:359] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.903721 20395 raft_consensus.cc:385] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.903764 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:31.904055 20395 raft_consensus.cc:740] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.904764 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
I20260709 12:27:31.905468 20205 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 0.
W20260709 12:27:31.905364 20244 leader_election.cc:343] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.905054 20396 consensus_queue.cc:260] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.906642 20244 leader_election.cc:304] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:31.907645 20400 raft_consensus.cc:2804] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.908022 20400 raft_consensus.cc:493] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.908092 20396 ts_tablet_manager.cc:1434] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:27:31.908371 20400 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.909260 20396 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.909665 20394 tablet_bootstrap.cc:654] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.916067 20396 tablet_bootstrap.cc:654] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.921392 20394 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: No bootstrap required, opened a new log
I20260709 12:27:31.921137 20400 raft_consensus.cc:515] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.921957 20394 ts_tablet_manager.cc:1403] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 12:27:31.923749 20400 leader_election.cc:290] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.924254 20422 leader_election.cc:290] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:31.924729 20394 raft_consensus.cc:359] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.904800 20395 consensus_queue.cc:260] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.925433 20396 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.925465 20394 raft_consensus.cc:385] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.925998 20396 ts_tablet_manager.cc:1403] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 12:27:31.926013 20394 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.926152 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:31.927099 20395 ts_tablet_manager.cc:1434] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 12:27:31.927127 20394 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
W20260709 12:27:31.927958 20244 leader_election.cc:343] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:31.929616 20396 raft_consensus.cc:359] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.930389 20396 raft_consensus.cc:385] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.930697 20396 raft_consensus.cc:740] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.929868 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:31.931558 20205 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.928319 20395 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Bootstrap starting.
I20260709 12:27:31.932420 20394 ts_tablet_manager.cc:1434] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:27:31.938618 20395 tablet_bootstrap.cc:654] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.939953 20205 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:31.941219 20244 leader_election.cc:304] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:31.941144 20396 consensus_queue.cc:260] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.942301 20422 raft_consensus.cc:2804] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:31.942850 20422 raft_consensus.cc:697] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:31.943756 20422 consensus_queue.cc:237] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.946385 20396 ts_tablet_manager.cc:1434] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:27:31.947644 20396 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.950245 20395 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c: No bootstrap required, opened a new log
I20260709 12:27:31.950837 20395 ts_tablet_manager.cc:1403] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.001s
I20260709 12:27:31.953840 20395 raft_consensus.cc:359] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.954602 20395 raft_consensus.cc:385] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.954898 20395 raft_consensus.cc:740] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.955705 20395 consensus_queue.cc:260] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.956621 20396 tablet_bootstrap.cc:654] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.958308 20395 ts_tablet_manager.cc:1434] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:27:31.963477 20102 catalog_manager.cc:5697] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.965667 20396 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.966233 20396 ts_tablet_manager.cc:1403] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.002s
I20260709 12:27:31.968967 20396 raft_consensus.cc:359] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.969655 20396 raft_consensus.cc:385] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.969945 20396 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.970553 20396 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.972693 20396 ts_tablet_manager.cc:1434] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:31.973703 20396 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: Bootstrap starting.
I20260709 12:27:31.979619 20396 tablet_bootstrap.cc:654] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:31.982918 20431 raft_consensus.cc:493] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:31.983533 20431 raft_consensus.cc:515] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.984738 20396 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: No bootstrap required, opened a new log
I20260709 12:27:31.985263 20396 ts_tablet_manager.cc:1403] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:27:31.985563 20431 leader_election.cc:290] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:31.986418 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c5ec062384ca2aab6116008621490" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
I20260709 12:27:31.987126 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c5ec062384ca2aab6116008621490" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:31.987181 20205 raft_consensus.cc:2468] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 0.
I20260709 12:27:31.987808 20280 raft_consensus.cc:2468] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 0.
I20260709 12:27:31.988097 20396 raft_consensus.cc:359] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.988452 20318 leader_election.cc:304] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:31.988878 20396 raft_consensus.cc:385] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:31.989207 20396 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Initialized, Role: FOLLOWER
I20260709 12:27:31.989449 20431 raft_consensus.cc:2804] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:31.989884 20431 raft_consensus.cc:493] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:31.990199 20431 raft_consensus.cc:3060] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:31.989921 20396 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.991940 20396 ts_tablet_manager.cc:1434] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:27:31.996795 20431 raft_consensus.cc:515] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:31.998687 20431 leader_election.cc:290] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:31.999632 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c5ec062384ca2aab6116008621490" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:31.999804 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "390c5ec062384ca2aab6116008621490" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:32.000278 20205 raft_consensus.cc:3060] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.000458 20280 raft_consensus.cc:3060] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.007090 20205 raft_consensus.cc:2468] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 1.
I20260709 12:27:32.008093 20318 leader_election.cc:304] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:32.008774 20431 raft_consensus.cc:2804] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.009250 20431 raft_consensus.cc:697] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 1 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:32.009632 20280 raft_consensus.cc:2468] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 1.
I20260709 12:27:32.009994 20431 consensus_queue.cc:237] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.017102 20103 catalog_manager.cc:5697] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 0 to 1, leader changed from <none> to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 1 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:32.026647 20418 raft_consensus.cc:493] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.027143 20418 raft_consensus.cc:515] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.028774 20418 leader_election.cc:290] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:32.029549 20422 raft_consensus.cc:493] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.029903 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:32.030133 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:32.030086 20422 raft_consensus.cc:515] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.030607 20354 raft_consensus.cc:2468] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:32.031103 20280 raft_consensus.cc:2468] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:32.031698 20169 leader_election.cc:304] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:32.031739 20400 consensus_queue.cc:1048] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.032827 20418 raft_consensus.cc:2804] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.033217 20418 raft_consensus.cc:493] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.033309 20422 leader_election.cc:290] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:32.033658 20418 raft_consensus.cc:3060] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.033353 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
I20260709 12:27:32.034415 20205 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 0.
I20260709 12:27:32.035099 20353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:32.035329 20244 leader_election.cc:304] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:32.035737 20353 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 0.
I20260709 12:27:32.036180 20422 raft_consensus.cc:2804] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.036597 20422 raft_consensus.cc:493] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.036924 20422 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.041991 20399 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.042534 20399 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.042930 20422 raft_consensus.cc:515] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.044131 20400 consensus_queue.cc:1048] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.044793 20399 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:32.045137 20422 leader_election.cc:290] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:32.046288 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:32.043017 20418 raft_consensus.cc:515] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.051965 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:32.057668 20280 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:32.057802 20354 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.048282 20204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:32.058874 20204 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.059119 20418 leader_election.cc:290] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Requested vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:32.059342 20171 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:32.060489 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:32.062000 20399 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:32.062211 20279 raft_consensus.cc:3060] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.062412 20399 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:32.062877 20399 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.060540 20351 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:32.065750 20351 raft_consensus.cc:3060] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.067561 20354 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:32.070096 20399 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.073187 20399 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Requested vote from peers 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:32.046733 20353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:32.073392 20279 raft_consensus.cc:2468] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:32.074030 20353 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 0.
I20260709 12:27:32.075788 20171 leader_election.cc:304] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:32.077057 20418 raft_consensus.cc:2804] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.078240 20418 raft_consensus.cc:697] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Becoming Leader. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Running, Role: LEADER
I20260709 12:27:32.073992 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:32.079509 20354 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.079456 20418 consensus_queue.cc:237] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.074424 20244 leader_election.cc:304] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 
I20260709 12:27:32.081292 20422 raft_consensus.cc:2804] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.081938 20422 raft_consensus.cc:697] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:32.082818 20204 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:32.082973 20422 consensus_queue.cc:237] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.083694 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "cfc074dfd8724e20b4199aabd22c1da7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:32.087375 20280 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.074949 20351 raft_consensus.cc:2468] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:32.096100 20354 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:32.097960 20169 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:32.099598 20399 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:32.109334 20102 catalog_manager.cc:5697] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 0 to 1, leader changed from <none> to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 1 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.111794 20280 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cfc074dfd8724e20b4199aabd22c1da7 in term 1.
I20260709 12:27:32.114728 20399 raft_consensus.cc:697] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Becoming Leader. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Running, Role: LEADER
I20260709 12:27:32.116055 20399 consensus_queue.cc:237] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.132509 20399 consensus_queue.cc:1048] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.133930 20103 catalog_manager.cc:5697] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "cfc074dfd8724e20b4199aabd22c1da7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.135406 20103 catalog_manager.cc:5697] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 reported cstate change: term changed from 0 to 1, leader changed from <none> to cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "cfc074dfd8724e20b4199aabd22c1da7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:32.143652 20418 consensus_queue.cc:1048] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.155721 20459 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.165627 20280 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.168519 20459 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.180043 20431 raft_consensus.cc:493] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:32.180495 20431 raft_consensus.cc:515] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:32.182329 20431 leader_election.cc:290] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:32.183090 20205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7" is_pre_election: true
I20260709 12:27:32.183454 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:32.183949 20205 raft_consensus.cc:2393] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 3bea6aa9be084b209331d1e1df73f50a in current term 1: Already voted for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in this term.
I20260709 12:27:32.185267 20318 leader_election.cc:304] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a; no voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:32.185336 11392 ts_manager.cc:295] Set tserver state for cfc074dfd8724e20b4199aabd22c1da7 to MAINTENANCE_MODE
I20260709 12:27:32.185647 20418 consensus_queue.cc:1048] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:32.186275 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
I20260709 12:27:32.191469 20431 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:32.191543 20418 consensus_queue.cc:1048] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:32.203759 20431 raft_consensus.cc:2749] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:32.241084 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:32.242213 11392 tablet_replica.cc:333] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.243036 11392 raft_consensus.cc:2243] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.243510 11392 raft_consensus.cc:2272] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.245841 11392 tablet_replica.cc:333] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.246529 11392 raft_consensus.cc:2243] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.247361 11392 raft_consensus.cc:2272] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.249895 11392 tablet_replica.cc:333] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.250880 11392 raft_consensus.cc:2243] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.251796 11392 pending_rounds.cc:70] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Trying to abort 1 pending ops.
I20260709 12:27:32.252094 11392 pending_rounds.cc:77] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625813329776640 op_type: NO_OP noop_request { }
I20260709 12:27:32.252556 11392 raft_consensus.cc:2889] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:32.252966 11392 raft_consensus.cc:2272] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.256676 11392 tablet_replica.cc:333] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.257501 11392 raft_consensus.cc:2243] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.258016 11392 raft_consensus.cc:2272] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.259940 20422 consensus_queue.cc:1048] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.261346 11392 tablet_replica.cc:333] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.262326 11392 raft_consensus.cc:2243] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.263453 11392 raft_consensus.cc:2272] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.266445 11392 tablet_replica.cc:333] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.267256 11392 raft_consensus.cc:2243] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.267812 11392 raft_consensus.cc:2272] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.270349 11392 tablet_replica.cc:333] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
W20260709 12:27:32.271309 20244 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 351 similar messages]
I20260709 12:27:32.271309 11392 raft_consensus.cc:2243] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.273360 11392 pending_rounds.cc:70] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Trying to abort 1 pending ops.
I20260709 12:27:32.273739 11392 pending_rounds.cc:77] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305625813478653952 op_type: NO_OP noop_request { }
I20260709 12:27:32.274358 11392 raft_consensus.cc:2889] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:32.274827 11392 raft_consensus.cc:2272] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.280012 11392 tablet_replica.cc:333] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.280674 11392 raft_consensus.cc:2243] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.281147 11392 raft_consensus.cc:2272] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.284535 11392 tablet_replica.cc:333] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.285315 11392 raft_consensus.cc:2243] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:32.285347 20244 consensus_peers.cc:597] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.285939 11392 raft_consensus.cc:2272] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.288228 11392 tablet_replica.cc:333] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: stopping tablet replica
I20260709 12:27:32.288782 11392 raft_consensus.cc:2243] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.289700 11392 raft_consensus.cc:2272] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.308756 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
W20260709 12:27:32.473181 20244 consensus_peers.cc:597] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.476261 20453 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:32.489144 20244 consensus_peers.cc:597] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.551851 20244 consensus_peers.cc:597] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.563935 20318 consensus_peers.cc:597] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.584825 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:32.604944 20403 consensus_queue.cc:1048] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:32.710789 20400 consensus_queue.cc:1048] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:33.585961 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:33.643590 20431 raft_consensus.cc:493] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.644207 20431 raft_consensus.cc:515] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.646234 20431 leader_election.cc:290] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.647384 20400 raft_consensus.cc:493] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.647544 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:33.647976 20400 raft_consensus.cc:515] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.648919 20280 raft_consensus.cc:2468] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 1.
I20260709 12:27:33.650244 20400 leader_election.cc:290] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:33.650352 20320 leader_election.cc:304] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 
I20260709 12:27:33.651723 20431 raft_consensus.cc:2804] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:33.651782 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:33.652179 20431 raft_consensus.cc:493] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
W20260709 12:27:33.652312 20318 leader_election.cc:336] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.652583 20431 raft_consensus.cc:3060] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.653393 20483 raft_consensus.cc:493] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.653996 20483 raft_consensus.cc:515] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
W20260709 12:27:33.655236 20244 leader_election.cc:336] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.656045 20483 leader_election.cc:290] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.657238 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:33.657912 20280 raft_consensus.cc:2468] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 1.
I20260709 12:27:33.659205 20320 leader_election.cc:304] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 
W20260709 12:27:33.659777 20318 leader_election.cc:336] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.659998 20483 raft_consensus.cc:2804] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:33.660090 20431 raft_consensus.cc:515] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.660420 20483 raft_consensus.cc:493] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.660928 20483 raft_consensus.cc:3060] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.661290 20354 raft_consensus.cc:2393] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in current term 2: Already voted for candidate 3bea6aa9be084b209331d1e1df73f50a in this term.
I20260709 12:27:33.663302 20280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "466cc6ced51e432c8c046d431c45caaa" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:33.663888 20280 raft_consensus.cc:3060] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.664472 20244 leader_election.cc:304] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7
W20260709 12:27:33.667771 20318 leader_election.cc:336] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.668139 20483 raft_consensus.cc:515] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.669555 20431 leader_election.cc:290] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.669936 20483 leader_election.cc:290] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.671381 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e3dfc6d8f134bed9745a3d19a6393f2" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:33.672008 20279 raft_consensus.cc:3060] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:33.674592 20318 leader_election.cc:336] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.675679 20483 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.676285 20483 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.678035 20280 raft_consensus.cc:2468] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:33.677871 20484 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.678858 20400 raft_consensus.cc:2749] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:27:33.679024 20484 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.680020 20279 raft_consensus.cc:2468] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:33.680953 20483 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.682235 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:33.682898 20278 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 1.
I20260709 12:27:33.683466 20484 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
W20260709 12:27:33.682726 20318 leader_election.cc:336] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.684026 20320 leader_election.cc:304] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.684906 20483 raft_consensus.cc:2804] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:33.684891 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:33.685410 20320 leader_election.cc:304] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.685716 20483 raft_consensus.cc:697] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:33.685791 20354 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:33.686728 20483 consensus_queue.cc:237] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.688583 20244 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 
I20260709 12:27:33.689474 20484 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:27:33.689543 20244 leader_election.cc:336] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.690011 20484 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.686825 20431 raft_consensus.cc:2804] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:33.690469 20484 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.691059 20431 raft_consensus.cc:697] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:33.691933 20431 consensus_queue.cc:237] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.696277 20320 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.698135 20485 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:33.698645 20485 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.699018 20485 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.699644 20484 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.701372 20484 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:33.704380 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:33.705384 20483 raft_consensus.cc:493] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.706029 20483 raft_consensus.cc:515] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.707273 20485 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
W20260709 12:27:33.707687 20244 leader_election.cc:336] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.708244 20483 leader_election.cc:290] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.708927 20354 raft_consensus.cc:2393] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in current term 2: Already voted for candidate 3bea6aa9be084b209331d1e1df73f50a in this term.
I20260709 12:27:33.708777 20102 catalog_manager.cc:5697] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 1 to 2, leader changed from cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 2 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:33.710270 20485 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:33.710345 20244 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.711285 20484 raft_consensus.cc:2749] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:33.713805 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:33.714098 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:33.715757 20279 raft_consensus.cc:2393] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 3bea6aa9be084b209331d1e1df73f50a in current term 2: Already voted for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in this term.
W20260709 12:27:33.717234 20318 leader_election.cc:336] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.717751 20318 leader_election.cc:304] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a; no voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.718487 20485 raft_consensus.cc:2749] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:33.718706 20318 leader_election.cc:336] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.719527 20318 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a; no voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.720503 20485 raft_consensus.cc:2749] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:27:33.724804 20484 raft_consensus.cc:493] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.725353 20484 raft_consensus.cc:515] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.727411 20484 leader_election.cc:290] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:33.729700 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:33.730365 20354 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:33.731276 20102 catalog_manager.cc:5697] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 1 to 2, leader changed from cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 2 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:33.732296 20244 leader_election.cc:336] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.733820 20244 leader_election.cc:304] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.734504 20484 raft_consensus.cc:2804] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:33.734860 20484 raft_consensus.cc:493] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election (detected failure of leader cfc074dfd8724e20b4199aabd22c1da7)
I20260709 12:27:33.735208 20484 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.741294 20484 raft_consensus.cc:515] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.742807 20484 leader_election.cc:290] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:33.744251 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:33.744902 20354 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:33.746371 20244 leader_election.cc:336] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.750217 20354 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 2.
I20260709 12:27:33.751276 20244 leader_election.cc:304] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.751945 20484 raft_consensus.cc:2804] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:33.752329 20484 raft_consensus.cc:697] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:33.753089 20484 consensus_queue.cc:237] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.760481 20102 catalog_manager.cc:5697] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 1 to 2, leader changed from cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.871941 20484 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:33.872524 20484 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.874264 20484 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:33.875926 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a" is_pre_election: true
I20260709 12:27:33.876638 20354 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 1.
I20260709 12:27:33.877609 20244 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 
W20260709 12:27:33.878418 20244 leader_election.cc:336] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.878432 20484 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:33.879082 20484 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:33.879411 20484 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:33.885097 20484 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.886610 20484 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:33.888085 20354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:33.888747 20354 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:27:33.890216 20244 leader_election.cc:336] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:33.893602 20354 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 2.
I20260709 12:27:33.894732 20244 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:33.895411 20484 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:33.895874 20484 raft_consensus.cc:697] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:33.896517 20484 consensus_queue.cc:237] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:33.903508 20102 catalog_manager.cc:5697] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 1 to 2, leader changed from cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 2 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:34.073387 20318 consensus_peers.cc:597] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:34.212360 20318 consensus_peers.cc:597] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.236645 20279 raft_consensus.cc:1275] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:34.238430 20483 consensus_queue.cc:1048] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:34.262197 20279 raft_consensus.cc:1275] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:34.264068 20483 consensus_queue.cc:1048] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:34.281724 20244 consensus_peers.cc:597] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.332093 20354 raft_consensus.cc:1275] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:34.333467 20400 consensus_queue.cc:1048] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:34.365716 20244 consensus_peers.cc:597] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.514389 20354 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:34.515607 20400 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:34.587067 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:34.821965 20244 consensus_peers.cc:597] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.017073 20244 consensus_peers.cc:597] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.053025 20244 consensus_peers.cc:597] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.070528 20318 consensus_peers.cc:597] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.152611 20244 consensus_peers.cc:597] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.588097 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:35.588078 20485 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:35.588946 20485 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:35.591055 20485 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:35.592410 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" is_pre_election: true
I20260709 12:27:35.593344 20279 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:35.594717 20320 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: 
W20260709 12:27:35.595278 20318 leader_election.cc:336] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:35.595536 20485 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:27:35.596014 20485 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:35.596437 20485 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:35.604759 20485 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:35.606544 20485 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:35.607730 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:35.608359 20279 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:27:35.609905 20318 leader_election.cc:336] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111)
I20260709 12:27:35.616958 20279 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 3.
I20260709 12:27:35.618278 20320 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, 7f81bbfc9cac48a5b6d2a408ef1a135c; no voters: cfc074dfd8724e20b4199aabd22c1da7
I20260709 12:27:35.618980 20485 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:35.619357 20485 raft_consensus.cc:697] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:35.620488 20485 consensus_queue.cc:237] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:35.627815 20101 catalog_manager.cc:5697] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 1 to 3, leader changed from cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:36.128356 20279 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:36.129657 20485 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:27:36.146708 20318 consensus_peers.cc:597] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:36.589162 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:27:36.740000 20318 consensus_peers.cc:597] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:36.762118 20318 consensus_peers.cc:597] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:36.880296 20244 consensus_peers.cc:597] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:36.942397 20244 consensus_peers.cc:597] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.258150 20244 consensus_peers.cc:597] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:37.326390 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:37.334357 20515 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.337210 20516 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:37.337258 20518 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:37.339440 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:37.340569 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:37.340806 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:37.341003 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600057340985 us; error 0 us; skew 500 ppm
I20260709 12:27:37.341641 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:37.344249 11392 webserver.cc:533] Webserver started at http://127.11.32.1:35915/ using document root <none> and password file <none>
I20260709 12:27:37.344764 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:37.344981 11392 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:27:37.349056 11392 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:27:37.353191 20523 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:37.353943 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:37.354245 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "cfc074dfd8724e20b4199aabd22c1da7"
format_stamp: "Formatted at 2026-07-09 12:27:30 on dist-test-slave-sckv"
I20260709 12:27:37.354636 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20260709 12:27:37.369632 20244 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111) [suppressed 94 similar messages]
I20260709 12:27:37.372962 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:37.374419 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:37.376065 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:37.379743 20530 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:27:37.426606 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:27:37.426913 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.048s	user 0.002s	sys 0.000s
I20260709 12:27:37.427233 11392 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:27:37.432304 20530 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
W20260709 12:27:37.438946 20244 consensus_peers.cc:597] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:37.448697 20530 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:27:37.449821 20530 tablet_bootstrap.cc:492] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.450495 20530 ts_tablet_manager.cc:1403] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.004s
I20260709 12:27:37.453351 20530 raft_consensus.cc:359] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.454205 20530 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.454942 20530 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.457674 20530 ts_tablet_manager.cc:1434] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:27:37.458508 20530 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.474686 20530 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.475680 20530 tablet_bootstrap.cc:492] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.476356 20530 ts_tablet_manager.cc:1403] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.018s	user 0.017s	sys 0.000s
I20260709 12:27:37.479023 20530 raft_consensus.cc:359] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.479683 20530 raft_consensus.cc:740] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.480337 20530 consensus_queue.cc:260] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.482317 20530 ts_tablet_manager.cc:1434] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:37.483109 20530 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.485860 11392 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:27:37.486277 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.059s	user 0.059s	sys 0.000s
I20260709 12:27:37.498530 20530 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.499621 20530 tablet_bootstrap.cc:492] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.500460 20530 ts_tablet_manager.cc:1403] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.004s
I20260709 12:27:37.503870 20530 raft_consensus.cc:359] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.504750 20530 raft_consensus.cc:740] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.505686 20530 consensus_queue.cc:260] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.508317 20530 ts_tablet_manager.cc:1434] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:37.509308 20530 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.525143 20530 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.525852 20530 tablet_bootstrap.cc:492] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.526484 20530 ts_tablet_manager.cc:1403] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.004s
I20260709 12:27:37.528275 20530 raft_consensus.cc:359] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.528903 20530 raft_consensus.cc:740] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.529564 20530 consensus_queue.cc:260] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.531248 20530 ts_tablet_manager.cc:1434] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:37.532060 20530 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.545877 20530 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.546653 20530 tablet_bootstrap.cc:492] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.547168 20530 ts_tablet_manager.cc:1403] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.015s	user 0.005s	sys 0.008s
I20260709 12:27:37.549263 20530 raft_consensus.cc:359] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.549845 20530 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.550496 20530 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.551297 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:46079
I20260709 12:27:37.551424 20592 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:46079 every 8 connection(s)
I20260709 12:27:37.552126 20530 ts_tablet_manager.cc:1434] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:37.552850 20530 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.558614 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:37.579198 20244 consensus_peers.cc:597] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:37.584245 20530 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.585687 20530 tablet_bootstrap.cc:492] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.586277 20530 ts_tablet_manager.cc:1403] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.004s
I20260709 12:27:37.589001 20593 heartbeater.cc:344] Connected to a master server at 127.11.32.62:38315
I20260709 12:27:37.588958 20530 raft_consensus.cc:359] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.589526 20593 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:37.590034 20530 raft_consensus.cc:740] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
W20260709 12:27:37.590270 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:37.590873 20593 heartbeater.cc:507] Master 127.11.32.62:38315 requested a full tablet report, sending...
I20260709 12:27:37.590798 20530 consensus_queue.cc:260] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.593086 20530 ts_tablet_manager.cc:1434] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:27:37.593922 20530 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.594305 20279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:37.595058 20279 raft_consensus.cc:606] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:37.597815 20279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:37.597995 20102 ts_manager.cc:194] Re-registered known tserver with Master: cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079)
I20260709 12:27:37.598407 20279 raft_consensus.cc:606] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:37.599537 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:37.600216 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:37.600984 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:37.606626 20102 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45354
I20260709 12:27:37.607038 20530 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.607884 20530 tablet_bootstrap.cc:492] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.608533 20530 ts_tablet_manager.cc:1403] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.001s
I20260709 12:27:37.609792 20593 heartbeater.cc:499] Master 127.11.32.62:38315 was elected leader, sending a full tablet report...
I20260709 12:27:37.610988 20530 raft_consensus.cc:359] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.611466 20530 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.612069 20530 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.613662 20530 ts_tablet_manager.cc:1434] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:37.614315 20530 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.624679 20530 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:27:37.625387 20530 tablet_bootstrap.cc:492] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.625955 20530 ts_tablet_manager.cc:1403] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.012s	user 0.004s	sys 0.006s
I20260709 12:27:37.627842 20530 raft_consensus.cc:359] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.628456 20530 raft_consensus.cc:740] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.629070 20530 consensus_queue.cc:260] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.630849 20530 ts_tablet_manager.cc:1434] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:37.631474 20530 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.642293 20530 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.642976 20530 tablet_bootstrap.cc:492] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.643464 20530 ts_tablet_manager.cc:1403] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.012s	user 0.005s	sys 0.004s
I20260709 12:27:37.645103 20530 raft_consensus.cc:359] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.645614 20530 raft_consensus.cc:740] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.646064 20530 consensus_queue.cc:260] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.647512 20530 ts_tablet_manager.cc:1434] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:37.648121 20530 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap starting.
I20260709 12:27:37.661206 20530 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:37.662129 20530 tablet_bootstrap.cc:492] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Bootstrap complete.
I20260709 12:27:37.662758 20530 ts_tablet_manager.cc:1403] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Time spent bootstrapping tablet: real 0.015s	user 0.014s	sys 0.000s
I20260709 12:27:37.664063 20566 raft_consensus.cc:3060] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.664609 20530 raft_consensus.cc:359] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.665162 20530 raft_consensus.cc:740] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: cfc074dfd8724e20b4199aabd22c1da7, State: Initialized, Role: FOLLOWER
I20260709 12:27:37.665751 20530 consensus_queue.cc:260] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.667300 20530 ts_tablet_manager.cc:1434] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:37.688395 20565 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:37.704666 20565 raft_consensus.cc:3060] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.709829 20565 pending_rounds.cc:85] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Aborting all ops after (but not including) 0
I20260709 12:27:37.710095 20565 pending_rounds.cc:107] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:27:37.710341 20565 raft_consensus.cc:2889] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:37.749492 20400 raft_consensus.cc:993] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:37.750038 20611 raft_consensus.cc:1081] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:37.751525 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:37.752012 20352 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:37.752307 20352 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:37.758050 20352 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.759610 20352 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:37.760677 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:37.760702 20565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:37.761296 20279 raft_consensus.cc:3055] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:37.761400 20565 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:27:37.761688 20279 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:37.762629 20279 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.763628 20279 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:37.766673 20565 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 3.
I20260709 12:27:37.767868 20318 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:37.768723 20509 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:37.769129 20509 raft_consensus.cc:697] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:37.769434 20279 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 3.
I20260709 12:27:37.770068 20509 consensus_queue.cc:237] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.777194 20102 catalog_manager.cc:5697] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 2 to 3, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:37.965834 20400 raft_consensus.cc:993] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:37.966282 20611 raft_consensus.cc:1081] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:37.967692 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:37.968163 20352 raft_consensus.cc:493] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:37.968417 20352 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.973212 20352 raft_consensus.cc:515] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.974960 20352 leader_election.cc:290] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:37.975625 20565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:37.975925 20279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:37.976297 20565 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.976553 20279 raft_consensus.cc:3055] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:37.976886 20279 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:37.977752 20279 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.979053 20279 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:37.983326 20565 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:37.984457 20318 leader_election.cc:304] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:37.985177 20509 raft_consensus.cc:2804] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:37.985577 20509 raft_consensus.cc:697] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:37.985723 20279 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:37.986462 20509 consensus_queue.cc:237] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:37.993542 20102 catalog_manager.cc:5697] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 1 to 2, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 2 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:38.111699 20565 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.228948 20565 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:38.230180 20509 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:38.230679 20509 consensus_queue.cc:1243] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Peer cfc074dfd8724e20b4199aabd22c1da7 log is divergent from this leader: its last log entry 1.1 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 0
I20260709 12:27:38.232556 20565 pending_rounds.cc:85] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Aborting all ops after (but not including) 0
I20260709 12:27:38.232811 20565 pending_rounds.cc:107] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:27:38.233026 20565 raft_consensus.cc:2889] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:38.241466 20279 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:38.242944 20509 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:38.495677 20279 raft_consensus.cc:1275] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:38.496969 20609 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:38.500260 20566 raft_consensus.cc:1275] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:38.501986 20509 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:27:38.591280 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:38.611331 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:38.618724 20279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304aba70cb844550ad7863632af7e862"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:38.619340 20279 raft_consensus.cc:606] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:38.631982 20352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
mode: GRACEFUL
new_leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:47140
I20260709 12:27:38.632467 20352 raft_consensus.cc:606] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Received request to transfer leadership to TS 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:38.635195 20352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
mode: GRACEFUL
new_leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:47140
I20260709 12:27:38.635622 20352 raft_consensus.cc:606] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Received request to transfer leadership to TS 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:38.636560 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:38.636991 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:38.637575 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:38.659350 20619 raft_consensus.cc:993] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: : Instructing follower 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:38.660001 20609 raft_consensus.cc:1081] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Signalling peer 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:38.661563 20278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:42672
I20260709 12:27:38.662119 20278 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:38.662437 20278 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:38.668272 20278 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:38.669981 20278 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 4 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:38.670670 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:38.670950 20352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:38.671344 20566 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:38.671576 20352 raft_consensus.cc:3055] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:38.671937 20352 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:38.672637 20352 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:38.673645 20352 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:38.677244 20566 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 4.
I20260709 12:27:38.678567 20244 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:38.679226 20400 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:38.679395 20352 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 4.
I20260709 12:27:38.679637 20400 raft_consensus.cc:697] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:38.680565 20400 consensus_queue.cc:237] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:38.686312 20102 catalog_manager.cc:5697] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 3 to 4, leader changed from 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 4 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:38.739745 20611 raft_consensus.cc:993] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:38.740206 20400 raft_consensus.cc:1081] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:38.741602 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304aba70cb844550ad7863632af7e862"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:38.742079 20352 raft_consensus.cc:493] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:38.742383 20352 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.747318 20352 raft_consensus.cc:515] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:38.748871 20352 leader_election.cc:290] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:38.749863 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:38.750066 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:38.750432 20566 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.750659 20278 raft_consensus.cc:3055] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:38.751017 20278 raft_consensus.cc:740] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:38.751698 20278 consensus_queue.cc:260] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:38.752955 20278 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:38.756558 20566 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:38.757737 20318 leader_election.cc:304] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:38.758591 20609 raft_consensus.cc:2804] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:38.758656 20278 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:38.759068 20609 raft_consensus.cc:697] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:38.760120 20609 consensus_queue.cc:237] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:38.766601 20102 catalog_manager.cc:5697] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 1 to 2, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 2 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:39.145033 20509 raft_consensus.cc:993] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: : Instructing follower 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:39.145560 20609 raft_consensus.cc:1081] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Signalling peer 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:39.146919 20278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:42672
I20260709 12:27:39.147406 20278 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:39.147709 20278 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:39.152909 20278 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:39.154454 20278 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 4 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:39.155165 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:39.155498 20352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:39.156142 20566 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:39.156265 20352 raft_consensus.cc:3055] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:39.156666 20352 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:39.157559 20352 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:39.158471 20352 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:39.161304 20566 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 4.
I20260709 12:27:39.162488 20244 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:39.163183 20400 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:39.163604 20400 raft_consensus.cc:697] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:39.163734 20352 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 4.
I20260709 12:27:39.164512 20400 consensus_queue.cc:237] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:39.166002 20566 raft_consensus.cc:1275] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.167182 20609 consensus_queue.cc:1048] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:39.171928 20278 raft_consensus.cc:1275] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:39.172436 20102 catalog_manager.cc:5697] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 3 to 4, leader changed from 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 4 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:39.173625 20609 consensus_queue.cc:1048] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:39.249752 20352 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:39.251359 20400 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:39.252008 20566 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:39.253484 20400 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:39.563832 20352 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:39.565104 20644 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:39.571731 20566 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:27:39.575409 20611 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:39.592144 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:39.643749 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:39.650894 20352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
mode: GRACEFUL
new_leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:47140
I20260709 12:27:39.651502 20352 raft_consensus.cc:606] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Received request to transfer leadership to TS 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:39.654181 20278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:39.654681 20278 raft_consensus.cc:606] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:39.656944 20278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:39.657397 20278 raft_consensus.cc:606] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:39.658450 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:39.658932 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:39.659530 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:39.889678 20400 raft_consensus.cc:993] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:39.890167 20611 raft_consensus.cc:1081] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:39.891487 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:39.891976 20352 raft_consensus.cc:493] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:39.892275 20352 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.897432 20352 raft_consensus.cc:515] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:39.899066 20352 leader_election.cc:290] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:39.899832 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:39.900100 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9d73675e6a604e12aab58bcde7af807a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:39.900514 20566 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.900712 20278 raft_consensus.cc:3055] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:39.901081 20278 raft_consensus.cc:740] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:39.901886 20278 consensus_queue.cc:260] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:39.902839 20278 raft_consensus.cc:3060] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:39.905656 20566 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 3.
I20260709 12:27:39.907033 20318 leader_election.cc:304] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:39.907907 20509 raft_consensus.cc:2804] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:39.908313 20509 raft_consensus.cc:697] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:39.908630 20278 raft_consensus.cc:2468] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 3.
I20260709 12:27:39.909140 20509 consensus_queue.cc:237] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:39.915851 20102 catalog_manager.cc:5697] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 2 to 3, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 3 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.013080 20400 raft_consensus.cc:993] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:40.013576 20611 raft_consensus.cc:1081] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:40.015000 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:40.015429 20352 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:40.015681 20352 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:40.020628 20352 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.022179 20352 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 5 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:40.022940 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:40.023164 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:40.023579 20566 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:40.023741 20278 raft_consensus.cc:3055] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:40.024137 20278 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:40.024770 20278 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.025758 20278 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:40.028774 20566 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 5.
I20260709 12:27:40.029853 20318 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:40.030614 20509 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:40.030879 20278 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 5.
I20260709 12:27:40.031010 20509 raft_consensus.cc:697] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:40.032013 20509 consensus_queue.cc:237] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.037856 20102 catalog_manager.cc:5697] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 4 to 5, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 5 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.214857 20609 raft_consensus.cc:993] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: : Instructing follower 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:40.215348 20509 raft_consensus.cc:1081] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Signalling peer 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:40.217011 20278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:42672
I20260709 12:27:40.217654 20278 raft_consensus.cc:493] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:40.218084 20278 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.223949 20278 raft_consensus.cc:515] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.225759 20278 leader_election.cc:290] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 3 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:40.226434 20565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:40.226823 20352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:40.227140 20565 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.227525 20352 raft_consensus.cc:3055] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:40.227855 20352 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:40.228657 20352 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.230082 20352 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.233227 20565 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 3.
I20260709 12:27:40.234465 20244 leader_election.cc:304] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:40.235249 20611 raft_consensus.cc:2804] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:40.235647 20611 raft_consensus.cc:697] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:40.236485 20352 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 3.
I20260709 12:27:40.236388 20611 consensus_queue.cc:237] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.243507 20102 catalog_manager.cc:5697] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 2 to 3, leader changed from 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 3 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:40.333344 20565 raft_consensus.cc:1275] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:40.334649 20509 consensus_queue.cc:1048] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:40.347299 20278 raft_consensus.cc:1275] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:40.350112 20655 consensus_queue.cc:1048] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:40.447767 20278 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:40.448992 20609 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:40.456640 20565 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:40.458851 20509 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:40.593101 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:40.643380 20565 raft_consensus.cc:1275] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:40.644598 20400 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:40.654589 20352 raft_consensus.cc:1275] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:40.656160 20660 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:27:40.665690 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:40.674502 20278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:40.675030 20278 raft_consensus.cc:606] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:40.677301 20352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "304aba70cb844550ad7863632af7e862"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
mode: GRACEFUL
new_leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:47140
I20260709 12:27:40.677762 20352 raft_consensus.cc:606] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Received request to transfer leadership to TS 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:40.679940 20352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
mode: GRACEFUL
new_leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:47140
I20260709 12:27:40.680383 20352 raft_consensus.cc:606] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Received request to transfer leadership to TS 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:40.681324 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:40.681861 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:40.682430 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:40.824667 20611 raft_consensus.cc:993] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:40.825215 20660 raft_consensus.cc:1081] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:40.826632 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:40.827127 20352 raft_consensus.cc:493] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:40.827419 20352 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.832437 20352 raft_consensus.cc:515] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.834146 20352 leader_election.cc:290] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:40.835008 20565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:40.835237 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:40.835575 20565 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.835844 20278 raft_consensus.cc:3055] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:40.836158 20278 raft_consensus.cc:740] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:40.836879 20278 consensus_queue.cc:260] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.838121 20278 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:40.841884 20565 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:40.842909 20318 leader_election.cc:304] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:40.843549 20609 raft_consensus.cc:2804] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:40.844054 20609 raft_consensus.cc:697] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:40.844046 20278 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 2.
I20260709 12:27:40.845247 20609 consensus_queue.cc:237] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.852787 20102 catalog_manager.cc:5697] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 1 to 2, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 2 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:40.979581 20509 raft_consensus.cc:993] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: : Instructing follower 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:40.980041 20609 raft_consensus.cc:1081] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Signalling peer 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:40.981909 20278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "304aba70cb844550ad7863632af7e862"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:42672
I20260709 12:27:40.982483 20278 raft_consensus.cc:493] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:40.982785 20278 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.987900 20278 raft_consensus.cc:515] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.989607 20278 leader_election.cc:290] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 3 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:40.990386 20565 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:40.990566 20352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "304aba70cb844550ad7863632af7e862" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:40.991104 20565 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.991108 20352 raft_consensus.cc:3055] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:40.991722 20352 raft_consensus.cc:740] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:40.992493 20352 consensus_queue.cc:260] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:40.993682 20352 raft_consensus.cc:3060] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:40.998458 20565 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 3.
I20260709 12:27:40.999884 20244 leader_election.cc:304] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:41.000480 20352 raft_consensus.cc:2468] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 3.
I20260709 12:27:41.000842 20660 raft_consensus.cc:2804] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:41.001353 20660 raft_consensus.cc:697] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:41.002125 20660 consensus_queue.cc:237] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.009050 20102 catalog_manager.cc:5697] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 2 to 3, leader changed from 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 3 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.039853 20655 raft_consensus.cc:993] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: : Instructing follower 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:41.040337 20609 raft_consensus.cc:1081] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Signalling peer 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:41.041843 20278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:42672
I20260709 12:27:41.042340 20278 raft_consensus.cc:493] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.042654 20278 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.047904 20278 raft_consensus.cc:515] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.049885 20278 leader_election.cc:290] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 6 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:41.050457 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:41.050787 20352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6430b1520934bdb9c54df1c16537e5a" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: true dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:41.051079 20566 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.051410 20352 raft_consensus.cc:3055] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:27:41.051685 20352 raft_consensus.cc:740] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:41.052306 20352 consensus_queue.cc:260] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.053145 20352 raft_consensus.cc:3060] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:27:41.056376 20566 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 6.
I20260709 12:27:41.057628 20244 leader_election.cc:304] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:41.058326 20660 raft_consensus.cc:2804] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:27:41.058467 20352 raft_consensus.cc:2468] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 6.
I20260709 12:27:41.058843 20660 raft_consensus.cc:697] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 6 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:41.059676 20660 consensus_queue.cc:237] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.065099 20102 catalog_manager.cc:5697] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 5 to 6, leader changed from 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 6 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.390645 20566 raft_consensus.cc:1275] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:41.391919 20609 consensus_queue.cc:1048] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:41.401718 20278 raft_consensus.cc:1275] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:41.403219 20655 consensus_queue.cc:1048] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:41.459379 20352 raft_consensus.cc:1275] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:41.460548 20400 consensus_queue.cc:1048] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:41.468930 20566 raft_consensus.cc:1275] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:41.470661 20400 consensus_queue.cc:1048] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:27:41.594231 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:41.615213 20566 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 6 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:41.616396 20400 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:41.621218 20352 raft_consensus.cc:1275] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 6 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:27:41.622996 20400 consensus_queue.cc:1048] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:27:41.688476 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:41.695708 20352 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
mode: GRACEFUL
new_leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:47140
I20260709 12:27:41.696251 20352 raft_consensus.cc:606] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Received request to transfer leadership to TS 7f81bbfc9cac48a5b6d2a408ef1a135c
I20260709 12:27:41.698709 20278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:41.699244 20278 raft_consensus.cc:606] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:41.701972 20278 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
mode: GRACEFUL
new_leader_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:59702
I20260709 12:27:41.702425 20278 raft_consensus.cc:606] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Received request to transfer leadership to TS 3bea6aa9be084b209331d1e1df73f50a
I20260709 12:27:41.703518 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:41.704054 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:41.704691 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:41.791632 20609 raft_consensus.cc:993] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: : Instructing follower 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:41.792207 20655 raft_consensus.cc:1081] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Signalling peer 7f81bbfc9cac48a5b6d2a408ef1a135c to start an election
I20260709 12:27:41.793898 20278 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32"
dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
 from {username='slave'} at 127.0.0.1:42672
I20260709 12:27:41.794368 20278 raft_consensus.cc:493] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.794606 20278 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.799502 20278 raft_consensus.cc:515] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.800812 20278 leader_election.cc:290] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 3 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3:43919)
I20260709 12:27:41.801995 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:41.802187 20352 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "002242eb48944ce88b8ec4d41d6bfe32" candidate_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
I20260709 12:27:41.802922 20566 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.803040 20352 raft_consensus.cc:3055] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:41.803550 20352 raft_consensus.cc:740] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:41.804360 20352 consensus_queue.cc:260] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.805320 20352 raft_consensus.cc:3060] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:41.808419 20566 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 3.
I20260709 12:27:41.809566 20244 leader_election.cc:304] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7f81bbfc9cac48a5b6d2a408ef1a135c, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:41.809999 20352 raft_consensus.cc:2468] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7f81bbfc9cac48a5b6d2a408ef1a135c in term 3.
I20260709 12:27:41.810231 20660 raft_consensus.cc:2804] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:41.810755 20660 raft_consensus.cc:697] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Becoming Leader. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:41.811519 20660 consensus_queue.cc:237] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.817047 20102 catalog_manager.cc:5697] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c reported cstate change: term changed from 2 to 3, leader changed from 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3) to 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2). New cstate: current_term: 3 leader_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:41.878739 20400 raft_consensus.cc:993] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:41.879297 20660 raft_consensus.cc:1081] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:41.880791 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:41.881230 20352 raft_consensus.cc:493] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.881505 20352 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.886339 20352 raft_consensus.cc:515] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.887776 20352 leader_election.cc:290] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 5 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:41.888626 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:41.889032 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3be2af93ab404919a703bcd89e3ab576" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:41.889253 20566 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.889647 20278 raft_consensus.cc:3055] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:27:41.889966 20278 raft_consensus.cc:740] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:41.890651 20278 consensus_queue.cc:260] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.891587 20278 raft_consensus.cc:3060] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:27:41.894734 20566 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 5.
I20260709 12:27:41.896001 20318 leader_election.cc:304] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:41.896809 20655 raft_consensus.cc:2804] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:27:41.897241 20655 raft_consensus.cc:697] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:41.897759 20278 raft_consensus.cc:2468] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 5.
I20260709 12:27:41.897985 20655 consensus_queue.cc:237] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.905145 20102 catalog_manager.cc:5697] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 4 to 5, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 5 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:41.925027 20400 raft_consensus.cc:993] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: : Instructing follower 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:41.925571 20660 raft_consensus.cc:1081] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Signalling peer 3bea6aa9be084b209331d1e1df73f50a to start an election
I20260709 12:27:41.926926 20352 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09"
dest_uuid: "3bea6aa9be084b209331d1e1df73f50a"
 from {username='slave'} at 127.0.0.1:52306
I20260709 12:27:41.927345 20352 raft_consensus.cc:493] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:41.927590 20352 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:41.932370 20352 raft_consensus.cc:515] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.934010 20352 leader_election.cc:290] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 4 election: Requested vote from peers cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079), 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133)
I20260709 12:27:41.934823 20566 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "cfc074dfd8724e20b4199aabd22c1da7"
I20260709 12:27:41.935138 20278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46c5518058cf4f9fb2e620900b82ca09" candidate_uuid: "3bea6aa9be084b209331d1e1df73f50a" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c"
I20260709 12:27:41.935353 20566 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:41.935725 20278 raft_consensus.cc:3055] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:27:41.936043 20278 raft_consensus.cc:740] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 7f81bbfc9cac48a5b6d2a408ef1a135c, State: Running, Role: LEADER
I20260709 12:27:41.936698 20278 consensus_queue.cc:260] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.937687 20278 raft_consensus.cc:3060] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:27:41.940165 20566 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 4.
I20260709 12:27:41.941184 20318 leader_election.cc:304] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3bea6aa9be084b209331d1e1df73f50a, cfc074dfd8724e20b4199aabd22c1da7; no voters: 
I20260709 12:27:41.941905 20655 raft_consensus.cc:2804] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:27:41.942256 20278 raft_consensus.cc:2468] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3bea6aa9be084b209331d1e1df73f50a in term 4.
I20260709 12:27:41.942456 20655 raft_consensus.cc:697] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 4 LEADER]: Becoming Leader. State: Replica: 3bea6aa9be084b209331d1e1df73f50a, State: Running, Role: LEADER
I20260709 12:27:41.943334 20655 consensus_queue.cc:237] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } }
I20260709 12:27:41.950069 20102 catalog_manager.cc:5697] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a reported cstate change: term changed from 3 to 4, leader changed from 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2) to 3bea6aa9be084b209331d1e1df73f50a (127.11.32.3). New cstate: current_term: 4 leader_uuid: "3bea6aa9be084b209331d1e1df73f50a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:42.261113 20566 raft_consensus.cc:1275] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:42.262607 20676 consensus_queue.cc:1048] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:42.274290 20354 raft_consensus.cc:1275] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Refusing update from remote peer 7f81bbfc9cac48a5b6d2a408ef1a135c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:42.276075 20660 consensus_queue.cc:1048] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [LEADER]: Connected to new peer: Peer: permanent_uuid: "3bea6aa9be084b209331d1e1df73f50a" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43919 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:42.384166 20566 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:42.385550 20655 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:42.386356 20278 raft_consensus.cc:1275] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:42.387713 20655 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:42.398377 20278 raft_consensus.cc:1275] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:27:42.400537 20566 raft_consensus.cc:1275] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Refusing update from remote peer 3bea6aa9be084b209331d1e1df73f50a: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:27:42.401103 20655 consensus_queue.cc:1048] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "7f81bbfc9cac48a5b6d2a408ef1a135c" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 37133 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:42.401837 20609 consensus_queue.cc:1048] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cfc074dfd8724e20b4199aabd22c1da7" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 46079 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 12:27:42.595155 20151 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:27:42.710754 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:42.742666 11392 tablet_server.cc:179] TabletServer@127.11.32.1:46079 shutting down...
I20260709 12:27:42.763983 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:42.764693 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.765329 11392 raft_consensus.cc:2243] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.765934 11392 raft_consensus.cc:2272] T 002242eb48944ce88b8ec4d41d6bfe32 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.768409 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.768993 11392 raft_consensus.cc:2243] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.769482 11392 raft_consensus.cc:2272] T 9d73675e6a604e12aab58bcde7af807a P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.771277 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.771812 11392 raft_consensus.cc:2243] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.772214 11392 raft_consensus.cc:2272] T 390c5ec062384ca2aab6116008621490 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.774761 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.775499 11392 raft_consensus.cc:2243] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.775918 11392 raft_consensus.cc:2272] T b6430b1520934bdb9c54df1c16537e5a P cfc074dfd8724e20b4199aabd22c1da7 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.777704 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.778198 11392 raft_consensus.cc:2243] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.778589 11392 raft_consensus.cc:2272] T 304aba70cb844550ad7863632af7e862 P cfc074dfd8724e20b4199aabd22c1da7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.780333 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.780799 11392 raft_consensus.cc:2243] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.781191 11392 raft_consensus.cc:2272] T 0e3dfc6d8f134bed9745a3d19a6393f2 P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.782907 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.783478 11392 raft_consensus.cc:2243] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.783910 11392 raft_consensus.cc:2272] T 46c5518058cf4f9fb2e620900b82ca09 P cfc074dfd8724e20b4199aabd22c1da7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.786247 11392 tablet_replica.cc:333] stopping tablet replica
W20260709 12:27:42.786348 20318 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
I20260709 12:27:42.786952 11392 raft_consensus.cc:2243] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.787976 11392 raft_consensus.cc:2272] T 466cc6ced51e432c8c046d431c45caaa P cfc074dfd8724e20b4199aabd22c1da7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.790442 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.791232 11392 raft_consensus.cc:2243] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:42.791345 20318 consensus_peers.cc:597] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.791916 11392 raft_consensus.cc:2272] T 87a08e565f9749fd955647ad42f3fb70 P cfc074dfd8724e20b4199aabd22c1da7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.794888 11392 tablet_replica.cc:333] stopping tablet replica
I20260709 12:27:42.795544 11392 raft_consensus.cc:2243] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.796077 11392 raft_consensus.cc:2272] T 3be2af93ab404919a703bcd89e3ab576 P cfc074dfd8724e20b4199aabd22c1da7 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.817857 20244 consensus_peers.cc:597] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.827886 11392 tablet_server.cc:196] TabletServer@127.11.32.1:46079 shutdown complete.
I20260709 12:27:42.849336 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
W20260709 12:27:42.855989 20318 consensus_peers.cc:597] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.877981 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:42.878840 11392 tablet_replica.cc:333] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.879642 11392 raft_consensus.cc:2243] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.880498 11392 raft_consensus.cc:2272] T 002242eb48944ce88b8ec4d41d6bfe32 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.883574 11392 tablet_replica.cc:333] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.884197 11392 raft_consensus.cc:2243] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.884697 11392 raft_consensus.cc:2272] T 9d73675e6a604e12aab58bcde7af807a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.887329 11392 tablet_replica.cc:333] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
W20260709 12:27:42.887908 20318 consensus_peers.cc:597] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.888101 11392 raft_consensus.cc:2243] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.889020 11392 raft_consensus.cc:2272] T 304aba70cb844550ad7863632af7e862 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.891069 11392 tablet_replica.cc:333] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.891674 11392 raft_consensus.cc:2243] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.892134 11392 raft_consensus.cc:2272] T 390c5ec062384ca2aab6116008621490 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.894127 11392 tablet_replica.cc:333] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.894805 11392 raft_consensus.cc:2243] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 6 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.895550 11392 raft_consensus.cc:2272] T b6430b1520934bdb9c54df1c16537e5a P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.897681 11392 tablet_replica.cc:333] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.898479 11392 raft_consensus.cc:2243] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.898996 11392 raft_consensus.cc:2272] T 3be2af93ab404919a703bcd89e3ab576 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.902489 20320 consensus_peers.cc:597] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a -> Peer 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133): Couldn't send request to peer 7f81bbfc9cac48a5b6d2a408ef1a135c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.902908 11392 tablet_replica.cc:333] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.903779 11392 raft_consensus.cc:2243] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.904820 11392 raft_consensus.cc:2272] T 87a08e565f9749fd955647ad42f3fb70 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.907061 11392 tablet_replica.cc:333] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.907601 11392 raft_consensus.cc:2243] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.908017 11392 raft_consensus.cc:2272] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.910095 11392 tablet_replica.cc:333] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.910605 11392 raft_consensus.cc:2243] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.911011 11392 raft_consensus.cc:2272] T 46c5518058cf4f9fb2e620900b82ca09 P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.913357 11392 tablet_replica.cc:333] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c: stopping tablet replica
I20260709 12:27:42.914115 11392 raft_consensus.cc:2243] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.914654 11392 raft_consensus.cc:2272] T 466cc6ced51e432c8c046d431c45caaa P 7f81bbfc9cac48a5b6d2a408ef1a135c [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.920580 20318 consensus_peers.cc:597] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.947073 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
W20260709 12:27:42.949080 20318 consensus_peers.cc:597] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.971029 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
W20260709 12:27:42.992604 20320 consensus_peers.cc:597] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a -> Peer 7f81bbfc9cac48a5b6d2a408ef1a135c (127.11.32.2:37133): Couldn't send request to peer 7f81bbfc9cac48a5b6d2a408ef1a135c. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:37133: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.995823 20318 consensus_peers.cc:597] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a -> Peer cfc074dfd8724e20b4199aabd22c1da7 (127.11.32.1:46079): Couldn't send request to peer cfc074dfd8724e20b4199aabd22c1da7. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:46079: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:43.001961 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:43.002861 11392 tablet_replica.cc:333] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.003890 11392 raft_consensus.cc:2243] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.004515 11392 raft_consensus.cc:2272] T 002242eb48944ce88b8ec4d41d6bfe32 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.007179 11392 tablet_replica.cc:333] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.007746 11392 raft_consensus.cc:2243] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.008134 11392 raft_consensus.cc:2272] T 304aba70cb844550ad7863632af7e862 P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.010151 11392 tablet_replica.cc:333] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.010632 11392 raft_consensus.cc:2243] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.011353 11392 raft_consensus.cc:2272] T 9d73675e6a604e12aab58bcde7af807a P 3bea6aa9be084b209331d1e1df73f50a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.013372 11392 tablet_replica.cc:333] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.013979 11392 raft_consensus.cc:2243] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.014680 11392 raft_consensus.cc:2272] T 46c5518058cf4f9fb2e620900b82ca09 P 3bea6aa9be084b209331d1e1df73f50a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.016935 11392 tablet_replica.cc:333] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.017501 11392 raft_consensus.cc:2243] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.018183 11392 raft_consensus.cc:2272] T 0e3dfc6d8f134bed9745a3d19a6393f2 P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.020107 11392 tablet_replica.cc:333] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.020577 11392 raft_consensus.cc:2243] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.021287 11392 raft_consensus.cc:2272] T 466cc6ced51e432c8c046d431c45caaa P 3bea6aa9be084b209331d1e1df73f50a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.023326 11392 tablet_replica.cc:333] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.023805 11392 raft_consensus.cc:2243] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.024510 11392 raft_consensus.cc:2272] T 390c5ec062384ca2aab6116008621490 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.026487 11392 tablet_replica.cc:333] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.026954 11392 raft_consensus.cc:2243] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.027325 11392 raft_consensus.cc:2272] T b6430b1520934bdb9c54df1c16537e5a P 3bea6aa9be084b209331d1e1df73f50a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.029153 11392 tablet_replica.cc:333] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.029699 11392 raft_consensus.cc:2243] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.030431 11392 raft_consensus.cc:2272] T 3be2af93ab404919a703bcd89e3ab576 P 3bea6aa9be084b209331d1e1df73f50a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.032596 11392 tablet_replica.cc:333] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a: stopping tablet replica
I20260709 12:27:43.033053 11392 raft_consensus.cc:2243] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.033471 11392 raft_consensus.cc:2272] T 87a08e565f9749fd955647ad42f3fb70 P 3bea6aa9be084b209331d1e1df73f50a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.064072 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
I20260709 12:27:43.088840 11392 master.cc:562] Master@127.11.32.62:38315 shutting down...
I20260709 12:27:43.114203 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.114816 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.115183 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 29c403ec09374085971329d90c378b5e: stopping tablet replica
I20260709 12:27:43.135399 11392 master.cc:584] Master@127.11.32.62:38315 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12716 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:27:43.179175 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:40305
I20260709 12:27:43.180327 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:43.186060 20702 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.186159 20703 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.187135 20705 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:43.187939 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:43.188942 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:43.189150 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:43.189335 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600063189319 us; error 0 us; skew 500 ppm
I20260709 12:27:43.190240 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:43.192471 11392 webserver.cc:533] Webserver started at http://127.11.32.62:36471/ using document root <none> and password file <none>
I20260709 12:27:43.192957 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:43.193166 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:43.193492 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:43.194588 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "f66468ec18804b8c832121eaffde9ce9"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.198935 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:43.202235 20710 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.203135 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:43.203382 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "f66468ec18804b8c832121eaffde9ce9"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.203689 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:43.226665 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:43.227887 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:43.265316 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:40305
I20260709 12:27:43.265465 20761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:40305 every 8 connection(s)
I20260709 12:27:43.269191 20762 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.280706 20762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9: Bootstrap starting.
I20260709 12:27:43.285537 20762 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.289765 20762 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9: No bootstrap required, opened a new log
I20260709 12:27:43.291950 20762 raft_consensus.cc:359] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66468ec18804b8c832121eaffde9ce9" member_type: VOTER }
I20260709 12:27:43.292343 20762 raft_consensus.cc:385] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.292634 20762 raft_consensus.cc:740] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f66468ec18804b8c832121eaffde9ce9, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.293216 20762 consensus_queue.cc:260] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66468ec18804b8c832121eaffde9ce9" member_type: VOTER }
I20260709 12:27:43.293715 20762 raft_consensus.cc:399] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:43.293941 20762 raft_consensus.cc:493] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:43.294224 20762 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:43.298928 20762 raft_consensus.cc:515] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66468ec18804b8c832121eaffde9ce9" member_type: VOTER }
I20260709 12:27:43.299439 20762 leader_election.cc:304] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f66468ec18804b8c832121eaffde9ce9; no voters: 
I20260709 12:27:43.300573 20762 leader_election.cc:290] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:43.301101 20765 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:43.302652 20765 raft_consensus.cc:697] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 1 LEADER]: Becoming Leader. State: Replica: f66468ec18804b8c832121eaffde9ce9, State: Running, Role: LEADER
I20260709 12:27:43.303351 20765 consensus_queue.cc:237] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66468ec18804b8c832121eaffde9ce9" member_type: VOTER }
I20260709 12:27:43.303659 20762 sys_catalog.cc:565] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:43.306769 20766 sys_catalog.cc:455] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f66468ec18804b8c832121eaffde9ce9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66468ec18804b8c832121eaffde9ce9" member_type: VOTER } }
I20260709 12:27:43.306893 20767 sys_catalog.cc:455] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f66468ec18804b8c832121eaffde9ce9. Latest consensus state: current_term: 1 leader_uuid: "f66468ec18804b8c832121eaffde9ce9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f66468ec18804b8c832121eaffde9ce9" member_type: VOTER } }
I20260709 12:27:43.307528 20766 sys_catalog.cc:458] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:43.307633 20767 sys_catalog.cc:458] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:43.311721 20770 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:43.317541 20770 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:43.320504 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:43.327297 20770 catalog_manager.cc:1383] Generated new cluster ID: a27c09de9c2347f78f956ccba06d44c9
I20260709 12:27:43.327625 20770 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:43.360720 20770 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:43.362119 20770 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:43.378942 20770 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9: Generated new TSK 0
I20260709 12:27:43.379601 20770 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:43.387180 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:43.393262 20783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.394742 20784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.395768 20786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:43.396328 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:43.397326 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:43.397662 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:43.397852 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600063397833 us; error 0 us; skew 500 ppm
I20260709 12:27:43.398454 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:43.400729 11392 webserver.cc:533] Webserver started at http://127.11.32.1:43509/ using document root <none> and password file <none>
I20260709 12:27:43.401229 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:43.401459 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:43.401736 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:43.402813 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "6b2248c950284f1797be32cdcedccf97"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.407666 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:27:43.411109 20791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.411896 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:43.412253 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "6b2248c950284f1797be32cdcedccf97"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.412643 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:43.424060 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:43.425361 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:43.427037 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:43.429565 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:43.429804 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.430085 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:43.430287 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.475790 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:39289
I20260709 12:27:43.475865 20853 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:39289 every 8 connection(s)
I20260709 12:27:43.481731 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:43.488765 20858 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.489615 20859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:43.492028 11392 server_base.cc:1061] running on GCE node
W20260709 12:27:43.493330 20861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:43.494503 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:43.494767 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:43.494973 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600063494954 us; error 0 us; skew 500 ppm
I20260709 12:27:43.495406 20854 heartbeater.cc:344] Connected to a master server at 127.11.32.62:40305
I20260709 12:27:43.495621 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:43.495813 20854 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:43.496837 20854 heartbeater.cc:507] Master 127.11.32.62:40305 requested a full tablet report, sending...
I20260709 12:27:43.498739 11392 webserver.cc:533] Webserver started at http://127.11.32.2:36837/ using document root <none> and password file <none>
I20260709 12:27:43.499292 20727 ts_manager.cc:194] Registered new tserver with Master: 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289)
I20260709 12:27:43.499493 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:43.499800 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:43.500118 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:43.501621 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "c3782703d8ee49dd94a9e22ad963ccef"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.501914 20727 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57168
I20260709 12:27:43.506835 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:27:43.510569 20866 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.511407 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260709 12:27:43.511719 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "c3782703d8ee49dd94a9e22ad963ccef"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.511988 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:43.545158 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:43.546437 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:43.547976 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:43.550272 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:43.550503 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.550743 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:43.550912 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.590380 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:33097
I20260709 12:27:43.590502 20928 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:33097 every 8 connection(s)
I20260709 12:27:43.595239 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:43.603448 20933 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.604562 20932 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:43.607223 20935 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:43.609036 20929 heartbeater.cc:344] Connected to a master server at 127.11.32.62:40305
I20260709 12:27:43.609532 20929 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:43.610010 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:43.611198 20929 heartbeater.cc:507] Master 127.11.32.62:40305 requested a full tablet report, sending...
I20260709 12:27:43.611447 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:43.611738 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:43.611920 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600063611899 us; error 0 us; skew 500 ppm
I20260709 12:27:43.612515 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:43.613463 20727 ts_manager.cc:194] Registered new tserver with Master: c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097)
I20260709 12:27:43.615434 11392 webserver.cc:533] Webserver started at http://127.11.32.3:35357/ using document root <none> and password file <none>
I20260709 12:27:43.615590 20727 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57178
I20260709 12:27:43.616142 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:43.616402 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:43.616715 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:43.618216 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.622639 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:27:43.625892 20940 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.626744 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:27:43.627048 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
format_stamp: "Formatted at 2026-07-09 12:27:43 on dist-test-slave-sckv"
I20260709 12:27:43.627306 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:43.644667 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:43.645955 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:43.647483 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:43.649662 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:43.649883 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.650120 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:43.650296 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:43.690829 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:43917
I20260709 12:27:43.690927 21002 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:43917 every 8 connection(s)
I20260709 12:27:43.706039 21003 heartbeater.cc:344] Connected to a master server at 127.11.32.62:40305
I20260709 12:27:43.706516 21003 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:43.707195 21003 heartbeater.cc:507] Master 127.11.32.62:40305 requested a full tablet report, sending...
I20260709 12:27:43.709064 20727 ts_manager.cc:194] Registered new tserver with Master: 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:43.709915 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015740711s
I20260709 12:27:43.710538 20727 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57188
I20260709 12:27:43.735847 20727 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57192:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:43.737990 20727 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:43.783695 20894 tablet_service.cc:1511] Processing CreateTablet for tablet 875d5d6080ff4eecb4341aa6aca0d85f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd2e2957dfd0457d85224a2d7e05bb6c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:43.783896 20893 tablet_service.cc:1511] Processing CreateTablet for tablet d97c846b9c2340e69181bce38112ede3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd2e2957dfd0457d85224a2d7e05bb6c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:43.785213 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875d5d6080ff4eecb4341aa6aca0d85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.785909 20893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c846b9c2340e69181bce38112ede3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.791222 20968 tablet_service.cc:1511] Processing CreateTablet for tablet 875d5d6080ff4eecb4341aa6aca0d85f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd2e2957dfd0457d85224a2d7e05bb6c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:43.792693 20968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875d5d6080ff4eecb4341aa6aca0d85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.792439 20967 tablet_service.cc:1511] Processing CreateTablet for tablet d97c846b9c2340e69181bce38112ede3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd2e2957dfd0457d85224a2d7e05bb6c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:43.793810 20967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c846b9c2340e69181bce38112ede3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.794920 20819 tablet_service.cc:1511] Processing CreateTablet for tablet 875d5d6080ff4eecb4341aa6aca0d85f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd2e2957dfd0457d85224a2d7e05bb6c]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:43.796249 20819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 875d5d6080ff4eecb4341aa6aca0d85f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.798127 20818 tablet_service.cc:1511] Processing CreateTablet for tablet d97c846b9c2340e69181bce38112ede3 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=fd2e2957dfd0457d85224a2d7e05bb6c]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:43.799422 20818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d97c846b9c2340e69181bce38112ede3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:43.815145 21018 tablet_bootstrap.cc:492] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef: Bootstrap starting.
I20260709 12:27:43.816138 21019 tablet_bootstrap.cc:492] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e: Bootstrap starting.
I20260709 12:27:43.823318 21018 tablet_bootstrap.cc:654] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.829527 21019 tablet_bootstrap.cc:654] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.839006 21019 tablet_bootstrap.cc:492] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e: No bootstrap required, opened a new log
I20260709 12:27:43.839669 21019 ts_tablet_manager.cc:1403] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.002s
I20260709 12:27:43.840171 21021 tablet_bootstrap.cc:492] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: Bootstrap starting.
I20260709 12:27:43.843465 21018 tablet_bootstrap.cc:492] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef: No bootstrap required, opened a new log
I20260709 12:27:43.843045 21019 raft_consensus.cc:359] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:43.844019 21019 raft_consensus.cc:385] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.844112 21018 ts_tablet_manager.cc:1403] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef: Time spent bootstrapping tablet: real 0.031s	user 0.016s	sys 0.008s
I20260709 12:27:43.844355 21019 raft_consensus.cc:740] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffe8df78eef4f6db209f91a3d09c84e, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.845211 21019 consensus_queue.cc:260] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:43.847635 21003 heartbeater.cc:499] Master 127.11.32.62:40305 was elected leader, sending a full tablet report...
I20260709 12:27:43.847411 21018 raft_consensus.cc:359] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:43.848162 21019 ts_tablet_manager.cc:1434] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:27:43.848222 21018 raft_consensus.cc:385] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.848704 21018 raft_consensus.cc:740] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.849476 21019 tablet_bootstrap.cc:492] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e: Bootstrap starting.
I20260709 12:27:43.849509 21018 consensus_queue.cc:260] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:43.851801 21021 tablet_bootstrap.cc:654] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.857808 21019 tablet_bootstrap.cc:654] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.862635 21018 ts_tablet_manager.cc:1434] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.004s
I20260709 12:27:43.863771 20929 heartbeater.cc:499] Master 127.11.32.62:40305 was elected leader, sending a full tablet report...
I20260709 12:27:43.864198 21021 tablet_bootstrap.cc:492] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: No bootstrap required, opened a new log
I20260709 12:27:43.864712 21021 ts_tablet_manager.cc:1403] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.007s
I20260709 12:27:43.864810 21018 tablet_bootstrap.cc:492] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef: Bootstrap starting.
I20260709 12:27:43.868372 21019 tablet_bootstrap.cc:492] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e: No bootstrap required, opened a new log
I20260709 12:27:43.867924 21021 raft_consensus.cc:359] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:43.868983 21021 raft_consensus.cc:385] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.869055 21019 ts_tablet_manager.cc:1403] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.007s
I20260709 12:27:43.869400 21021 raft_consensus.cc:740] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.870362 21021 consensus_queue.cc:260] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:43.871610 21018 tablet_bootstrap.cc:654] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.872654 21019 raft_consensus.cc:359] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.873644 21019 raft_consensus.cc:385] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.874068 21019 raft_consensus.cc:740] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffe8df78eef4f6db209f91a3d09c84e, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.875449 21019 consensus_queue.cc:260] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.881102 21019 ts_tablet_manager.cc:1434] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:27:43.887633 20854 heartbeater.cc:499] Master 127.11.32.62:40305 was elected leader, sending a full tablet report...
I20260709 12:27:43.888243 21021 ts_tablet_manager.cc:1434] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.012s
I20260709 12:27:43.889307 21018 tablet_bootstrap.cc:492] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef: No bootstrap required, opened a new log
I20260709 12:27:43.890089 21018 ts_tablet_manager.cc:1403] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.007s
I20260709 12:27:43.890154 21021 tablet_bootstrap.cc:492] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97: Bootstrap starting.
I20260709 12:27:43.893122 21018 raft_consensus.cc:359] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.893817 21018 raft_consensus.cc:385] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.894079 21018 raft_consensus.cc:740] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.894737 21018 consensus_queue.cc:260] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.897622 21018 ts_tablet_manager.cc:1434] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:27:43.899643 21021 tablet_bootstrap.cc:654] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:43.905114 21021 tablet_bootstrap.cc:492] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97: No bootstrap required, opened a new log
I20260709 12:27:43.905627 21021 ts_tablet_manager.cc:1403] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97: Time spent bootstrapping tablet: real 0.016s	user 0.006s	sys 0.007s
I20260709 12:27:43.907768 21021 raft_consensus.cc:359] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.908311 21021 raft_consensus.cc:385] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:43.908550 21021 raft_consensus.cc:740] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Initialized, Role: FOLLOWER
I20260709 12:27:43.909207 21021 consensus_queue.cc:260] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.910513 21027 raft_consensus.cc:493] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.910897 21027 raft_consensus.cc:515] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.911147 21021 ts_tablet_manager.cc:1434] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:43.912897 21027 leader_election.cc:290] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:43.916363 21023 raft_consensus.cc:493] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:43.916949 21023 raft_consensus.cc:515] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.924401 21023 leader_election.cc:290] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289)
I20260709 12:27:43.928020 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" is_pre_election: true
I20260709 12:27:43.929008 20978 raft_consensus.cc:2468] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 0.
I20260709 12:27:43.925773 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef" is_pre_election: true
I20260709 12:27:43.930294 20904 raft_consensus.cc:2468] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 0.
I20260709 12:27:43.931255 20794 leader_election.cc:304] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, 6b2248c950284f1797be32cdcedccf97; no voters: 
I20260709 12:27:43.932201 21027 raft_consensus.cc:2804] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:43.932544 21027 raft_consensus.cc:493] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.932847 21027 raft_consensus.cc:3060] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:43.937484 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2248c950284f1797be32cdcedccf97" is_pre_election: true
I20260709 12:27:43.938714 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef" is_pre_election: true
I20260709 12:27:43.939359 20904 raft_consensus.cc:2468] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4ffe8df78eef4f6db209f91a3d09c84e in term 0.
I20260709 12:27:43.940409 20941 leader_election.cc:304] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, c3782703d8ee49dd94a9e22ad963ccef; no voters: 
I20260709 12:27:43.940672 21027 raft_consensus.cc:515] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.941169 21023 raft_consensus.cc:2804] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:43.941684 21023 raft_consensus.cc:493] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:43.941918 20829 raft_consensus.cc:2393] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4ffe8df78eef4f6db209f91a3d09c84e in current term 1: Already voted for candidate 6b2248c950284f1797be32cdcedccf97 in this term.
I20260709 12:27:43.942034 21023 raft_consensus.cc:3060] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:43.942997 21027 leader_election.cc:290] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 election: Requested vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:43.943909 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
I20260709 12:27:43.944550 20904 raft_consensus.cc:3060] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:43.950570 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
I20260709 12:27:43.950274 21023 raft_consensus.cc:515] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.951602 20978 raft_consensus.cc:2393] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6b2248c950284f1797be32cdcedccf97 in current term 1: Already voted for candidate 4ffe8df78eef4f6db209f91a3d09c84e in this term.
I20260709 12:27:43.951987 20904 raft_consensus.cc:2468] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 1.
I20260709 12:27:43.952572 21023 leader_election.cc:290] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [CANDIDATE]: Term 1 election: Requested vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289)
I20260709 12:27:43.953624 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
I20260709 12:27:43.953581 20792 leader_election.cc:304] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6b2248c950284f1797be32cdcedccf97, c3782703d8ee49dd94a9e22ad963ccef; no voters: 4ffe8df78eef4f6db209f91a3d09c84e
I20260709 12:27:43.954613 20904 raft_consensus.cc:2393] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4ffe8df78eef4f6db209f91a3d09c84e in current term 1: Already voted for candidate 6b2248c950284f1797be32cdcedccf97 in this term.
I20260709 12:27:43.954736 21027 raft_consensus.cc:2804] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:43.955519 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "875d5d6080ff4eecb4341aa6aca0d85f" candidate_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2248c950284f1797be32cdcedccf97"
I20260709 12:27:43.956175 21027 raft_consensus.cc:697] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Becoming Leader. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Running, Role: LEADER
I20260709 12:27:43.957091 21027 consensus_queue.cc:237] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } }
I20260709 12:27:43.962034 20941 leader_election.cc:304] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e; no voters: 6b2248c950284f1797be32cdcedccf97, c3782703d8ee49dd94a9e22ad963ccef
I20260709 12:27:43.962899 21023 raft_consensus.cc:2749] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:43.964582 20726 catalog_manager.cc:5697] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b2248c950284f1797be32cdcedccf97 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "6b2248c950284f1797be32cdcedccf97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.185001 21027 raft_consensus.cc:493] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.186630 21027 raft_consensus.cc:515] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.190313 21027 leader_election.cc:290] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:44.192119 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef" is_pre_election: true
I20260709 12:27:44.192349 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" is_pre_election: true
I20260709 12:27:44.193276 20978 raft_consensus.cc:2468] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 0.
I20260709 12:27:44.193276 20904 raft_consensus.cc:2468] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 0.
I20260709 12:27:44.195181 20794 leader_election.cc:304] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, 6b2248c950284f1797be32cdcedccf97; no voters: 
I20260709 12:27:44.196486 21027 raft_consensus.cc:2804] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:44.197031 21027 raft_consensus.cc:493] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.197625 21027 raft_consensus.cc:3060] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.209163 21027 raft_consensus.cc:515] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.211201 21027 leader_election.cc:290] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 election: Requested vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:44.212110 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
I20260709 12:27:44.212404 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
I20260709 12:27:44.212796 20904 raft_consensus.cc:3060] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.213002 20978 raft_consensus.cc:3060] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.224274 20904 raft_consensus.cc:2468] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 1.
I20260709 12:27:44.224274 20978 raft_consensus.cc:2468] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 1.
I20260709 12:27:44.225894 20794 leader_election.cc:304] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, 6b2248c950284f1797be32cdcedccf97; no voters: 
I20260709 12:27:44.226606 21027 raft_consensus.cc:2804] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:44.227056 21027 raft_consensus.cc:697] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Becoming Leader. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Running, Role: LEADER
I20260709 12:27:44.229125 21027 consensus_queue.cc:237] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.238296 20726 catalog_manager.cc:5697] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b2248c950284f1797be32cdcedccf97 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "6b2248c950284f1797be32cdcedccf97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.309581 20726 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57196:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:44.311786 20726 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:44.336931 20819 tablet_service.cc:1511] Processing CreateTablet for tablet f5560fd736c0476c81ed78f08425bb4b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aa57b70a735446fe8755ff91dfdf4e67]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:44.338340 20893 tablet_service.cc:1511] Processing CreateTablet for tablet f5560fd736c0476c81ed78f08425bb4b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aa57b70a735446fe8755ff91dfdf4e67]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:44.338971 20819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5560fd736c0476c81ed78f08425bb4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.340062 20968 tablet_service.cc:1511] Processing CreateTablet for tablet f5560fd736c0476c81ed78f08425bb4b (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aa57b70a735446fe8755ff91dfdf4e67]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:27:44.341627 20968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5560fd736c0476c81ed78f08425bb4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.340076 20893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5560fd736c0476c81ed78f08425bb4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.344756 20967 tablet_service.cc:1511] Processing CreateTablet for tablet d9115fe6338a4f03a054360f153106bd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aa57b70a735446fe8755ff91dfdf4e67]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:44.346467 20967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9115fe6338a4f03a054360f153106bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.350773 20894 tablet_service.cc:1511] Processing CreateTablet for tablet d9115fe6338a4f03a054360f153106bd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aa57b70a735446fe8755ff91dfdf4e67]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:44.352250 20894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9115fe6338a4f03a054360f153106bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.348996 20818 tablet_service.cc:1511] Processing CreateTablet for tablet d9115fe6338a4f03a054360f153106bd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=aa57b70a735446fe8755ff91dfdf4e67]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:27:44.358508 20818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9115fe6338a4f03a054360f153106bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:44.368207 21019 tablet_bootstrap.cc:492] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e: Bootstrap starting.
I20260709 12:27:44.376817 21019 tablet_bootstrap.cc:654] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.379779 21021 tablet_bootstrap.cc:492] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97: Bootstrap starting.
I20260709 12:27:44.380251 21018 tablet_bootstrap.cc:492] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: Bootstrap starting.
I20260709 12:27:44.388108 21021 tablet_bootstrap.cc:654] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.388195 21018 tablet_bootstrap.cc:654] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.390985 21019 tablet_bootstrap.cc:492] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e: No bootstrap required, opened a new log
I20260709 12:27:44.391607 21019 ts_tablet_manager.cc:1403] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.009s
I20260709 12:27:44.393205 21021 tablet_bootstrap.cc:492] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97: No bootstrap required, opened a new log
I20260709 12:27:44.393738 21021 ts_tablet_manager.cc:1403] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97: Time spent bootstrapping tablet: real 0.014s	user 0.005s	sys 0.008s
I20260709 12:27:44.396595 21019 raft_consensus.cc:359] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.397943 21019 raft_consensus.cc:385] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:44.398442 21019 raft_consensus.cc:740] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffe8df78eef4f6db209f91a3d09c84e, State: Initialized, Role: FOLLOWER
I20260709 12:27:44.399536 21027 consensus_queue.cc:1048] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:44.399644 21019 consensus_queue.cc:260] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.398814 21021 raft_consensus.cc:359] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.401116 21021 raft_consensus.cc:385] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:44.401468 21021 raft_consensus.cc:740] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Initialized, Role: FOLLOWER
I20260709 12:27:44.402369 21021 consensus_queue.cc:260] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.406948 21021 ts_tablet_manager.cc:1434] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.001s
I20260709 12:27:44.411033 21021 tablet_bootstrap.cc:492] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: Bootstrap starting.
I20260709 12:27:44.409582 21018 tablet_bootstrap.cc:492] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: No bootstrap required, opened a new log
I20260709 12:27:44.414186 21018 ts_tablet_manager.cc:1403] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.022s
I20260709 12:27:44.407641 21019 ts_tablet_manager.cc:1434] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.008s
I20260709 12:27:44.415915 21019 tablet_bootstrap.cc:492] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e: Bootstrap starting.
I20260709 12:27:44.424468 21018 raft_consensus.cc:359] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.425268 21018 raft_consensus.cc:385] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:44.425112 21019 tablet_bootstrap.cc:654] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.425905 21018 raft_consensus.cc:740] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Initialized, Role: FOLLOWER
I20260709 12:27:44.426532 21021 tablet_bootstrap.cc:654] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.428064 21018 consensus_queue.cc:260] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.431300 21018 ts_tablet_manager.cc:1434] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:27:44.433092 21018 tablet_bootstrap.cc:492] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: Bootstrap starting.
I20260709 12:27:44.441062 21021 tablet_bootstrap.cc:492] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: No bootstrap required, opened a new log
I20260709 12:27:44.441694 21021 ts_tablet_manager.cc:1403] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: Time spent bootstrapping tablet: real 0.031s	user 0.019s	sys 0.001s
I20260709 12:27:44.443082 21018 tablet_bootstrap.cc:654] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:44.444897 21021 raft_consensus.cc:359] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.445741 21021 raft_consensus.cc:385] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:44.446127 21021 raft_consensus.cc:740] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Initialized, Role: FOLLOWER
I20260709 12:27:44.447171 21021 consensus_queue.cc:260] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.448320 21019 tablet_bootstrap.cc:492] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e: No bootstrap required, opened a new log
I20260709 12:27:44.448876 21018 tablet_bootstrap.cc:492] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: No bootstrap required, opened a new log
I20260709 12:27:44.449934 21019 ts_tablet_manager.cc:1403] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.011s
I20260709 12:27:44.450093 21018 ts_tablet_manager.cc:1403] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:27:44.453598 21019 raft_consensus.cc:359] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.453823 21018 raft_consensus.cc:359] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.454543 21019 raft_consensus.cc:385] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:44.449354 21021 ts_tablet_manager.cc:1434] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:44.454974 21019 raft_consensus.cc:740] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4ffe8df78eef4f6db209f91a3d09c84e, State: Initialized, Role: FOLLOWER
I20260709 12:27:44.454588 21018 raft_consensus.cc:385] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:44.455518 21018 raft_consensus.cc:740] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Initialized, Role: FOLLOWER
I20260709 12:27:44.455933 21019 consensus_queue.cc:260] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.456557 21018 consensus_queue.cc:260] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.458971 21018 ts_tablet_manager.cc:1434] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:44.460975 21019 ts_tablet_manager.cc:1434] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:27:44.469533 21033 consensus_queue.cc:1048] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:44.585562 21033 raft_consensus.cc:493] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.586073 21033 raft_consensus.cc:515] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.588117 21033 leader_election.cc:290] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:44.589027 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef" is_pre_election: true
I20260709 12:27:44.589344 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" is_pre_election: true
I20260709 12:27:44.589735 20904 raft_consensus.cc:2468] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 0.
I20260709 12:27:44.590061 20978 raft_consensus.cc:2468] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 0.
I20260709 12:27:44.591007 20792 leader_election.cc:304] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2248c950284f1797be32cdcedccf97, c3782703d8ee49dd94a9e22ad963ccef; no voters: 
I20260709 12:27:44.591737 21033 raft_consensus.cc:2804] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:44.592110 21033 raft_consensus.cc:493] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.592381 21033 raft_consensus.cc:3060] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.598223 21033 raft_consensus.cc:515] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.600006 21033 leader_election.cc:290] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 election: Requested vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:44.600870 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
I20260709 12:27:44.601060 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
I20260709 12:27:44.601497 20904 raft_consensus.cc:3060] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.601691 20978 raft_consensus.cc:3060] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.606962 20978 raft_consensus.cc:2468] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 1.
I20260709 12:27:44.606954 20904 raft_consensus.cc:2468] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 1.
I20260709 12:27:44.608121 20794 leader_election.cc:304] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, 6b2248c950284f1797be32cdcedccf97; no voters: 
I20260709 12:27:44.608994 21033 raft_consensus.cc:2804] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:44.609473 21033 raft_consensus.cc:697] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Becoming Leader. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Running, Role: LEADER
I20260709 12:27:44.610211 21033 consensus_queue.cc:237] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.617705 20727 catalog_manager.cc:5697] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6b2248c950284f1797be32cdcedccf97 (127.11.32.1). New cstate: current_term: 1 leader_uuid: "6b2248c950284f1797be32cdcedccf97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.618541 21046 raft_consensus.cc:493] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:44.619067 21046 raft_consensus.cc:515] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.621328 21046 leader_election.cc:290] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:44.635885 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd" candidate_uuid: "c3782703d8ee49dd94a9e22ad963ccef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" is_pre_election: true
I20260709 12:27:44.636735 20978 raft_consensus.cc:2468] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3782703d8ee49dd94a9e22ad963ccef in term 0.
I20260709 12:27:44.636864 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd" candidate_uuid: "c3782703d8ee49dd94a9e22ad963ccef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2248c950284f1797be32cdcedccf97" is_pre_election: true
I20260709 12:27:44.637569 20829 raft_consensus.cc:2468] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c3782703d8ee49dd94a9e22ad963ccef in term 0.
I20260709 12:27:44.637816 20869 leader_election.cc:304] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, c3782703d8ee49dd94a9e22ad963ccef; no voters: 
I20260709 12:27:44.638710 21046 raft_consensus.cc:2804] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:44.639010 21046 raft_consensus.cc:493] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:44.639259 21046 raft_consensus.cc:3060] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.645051 21046 raft_consensus.cc:515] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.646817 21046 leader_election.cc:290] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [CANDIDATE]: Term 1 election: Requested vote from peers 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:44.647590 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd" candidate_uuid: "c3782703d8ee49dd94a9e22ad963ccef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6b2248c950284f1797be32cdcedccf97"
I20260709 12:27:44.647856 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd" candidate_uuid: "c3782703d8ee49dd94a9e22ad963ccef" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
I20260709 12:27:44.648283 20829 raft_consensus.cc:3060] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.648454 20978 raft_consensus.cc:3060] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:44.655853 20829 raft_consensus.cc:2468] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3782703d8ee49dd94a9e22ad963ccef in term 1.
I20260709 12:27:44.655853 20978 raft_consensus.cc:2468] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3782703d8ee49dd94a9e22ad963ccef in term 1.
I20260709 12:27:44.657280 20867 leader_election.cc:304] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6b2248c950284f1797be32cdcedccf97, c3782703d8ee49dd94a9e22ad963ccef; no voters: 
I20260709 12:27:44.658085 21046 raft_consensus.cc:2804] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:44.659111 21046 raft_consensus.cc:697] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 LEADER]: Becoming Leader. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Running, Role: LEADER
I20260709 12:27:44.659770 21046 consensus_queue.cc:237] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.666643 20727 catalog_manager.cc:5697] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef reported cstate change: term changed from 0 to 1, leader changed from <none> to c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2). New cstate: current_term: 1 leader_uuid: "c3782703d8ee49dd94a9e22ad963ccef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.754673 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3"
dest_uuid: "6b2248c950284f1797be32cdcedccf97"
mode: GRACEFUL
new_leader_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
 from {username='slave'} at 127.0.0.1:33240
I20260709 12:27:44.755256 20829 raft_consensus.cc:606] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Received request to transfer leadership to TS 4ffe8df78eef4f6db209f91a3d09c84e
I20260709 12:27:44.772150 20904 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd"
dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
mode: GRACEFUL
new_leader_uuid: "6b2248c950284f1797be32cdcedccf97"
 from {username='slave'} at 127.0.0.1:44736
I20260709 12:27:44.772699 20904 raft_consensus.cc:606] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 LEADER]: Received request to transfer leadership to TS 6b2248c950284f1797be32cdcedccf97
I20260709 12:27:44.837615 21033 consensus_queue.cc:1048] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:44.848538 21027 consensus_queue.cc:1048] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:44.860419 21053 raft_consensus.cc:993] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: : Instructing follower 4ffe8df78eef4f6db209f91a3d09c84e to start an election
I20260709 12:27:44.860901 21053 raft_consensus.cc:1081] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Signalling peer 4ffe8df78eef4f6db209f91a3d09c84e to start an election
I20260709 12:27:44.862581 20978 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3"
dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
 from {username='slave'} at 127.0.0.1:51346
I20260709 12:27:44.863252 20978 raft_consensus.cc:493] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:44.863648 20978 raft_consensus.cc:3060] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:44.869801 20978 raft_consensus.cc:515] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.871786 20978 leader_election.cc:290] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [CANDIDATE]: Term 2 election: Requested vote from peers 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289), c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097)
I20260709 12:27:44.872421 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3" candidate_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b2248c950284f1797be32cdcedccf97"
I20260709 12:27:44.872923 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d97c846b9c2340e69181bce38112ede3" candidate_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
I20260709 12:27:44.873097 20829 raft_consensus.cc:3055] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:44.873596 20904 raft_consensus.cc:3060] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:44.873850 20829 raft_consensus.cc:740] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Running, Role: LEADER
I20260709 12:27:44.874792 20829 consensus_queue.cc:260] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.876114 20829 raft_consensus.cc:3060] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:44.881168 20904 raft_consensus.cc:2468] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ffe8df78eef4f6db209f91a3d09c84e in term 2.
I20260709 12:27:44.882612 20941 leader_election.cc:304] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, c3782703d8ee49dd94a9e22ad963ccef; no voters: 
I20260709 12:27:44.883575 21023 raft_consensus.cc:2804] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:44.883734 20829 raft_consensus.cc:2468] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4ffe8df78eef4f6db209f91a3d09c84e in term 2.
I20260709 12:27:44.884927 21023 raft_consensus.cc:697] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 LEADER]: Becoming Leader. State: Replica: 4ffe8df78eef4f6db209f91a3d09c84e, State: Running, Role: LEADER
I20260709 12:27:44.886001 21023 consensus_queue.cc:237] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:44.893301 20727 catalog_manager.cc:5697] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e reported cstate change: term changed from 1 to 2, leader changed from 6b2248c950284f1797be32cdcedccf97 (127.11.32.1) to 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3). New cstate: current_term: 2 leader_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:45.002635 21053 consensus_queue.cc:1048] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.014110 21053 consensus_queue.cc:1048] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.167053 21046 consensus_queue.cc:1048] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.179994 21072 consensus_queue.cc:1048] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:45.187630 21071 raft_consensus.cc:993] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: : Instructing follower 6b2248c950284f1797be32cdcedccf97 to start an election
I20260709 12:27:45.188098 21072 raft_consensus.cc:1081] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 LEADER]: Signalling peer 6b2248c950284f1797be32cdcedccf97 to start an election
I20260709 12:27:45.189970 20829 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd"
dest_uuid: "6b2248c950284f1797be32cdcedccf97"
 from {username='slave'} at 127.0.0.1:33232
I20260709 12:27:45.190614 20829 raft_consensus.cc:493] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:45.191063 20829 raft_consensus.cc:3060] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:45.197012 20829 raft_consensus.cc:515] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:45.199366 20829 leader_election.cc:290] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 2 election: Requested vote from peers c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2:33097), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:45.200058 20904 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
I20260709 12:27:45.200460 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9115fe6338a4f03a054360f153106bd" candidate_uuid: "6b2248c950284f1797be32cdcedccf97" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
I20260709 12:27:45.200838 20904 raft_consensus.cc:3055] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:45.201118 20978 raft_consensus.cc:3060] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:45.201220 20904 raft_consensus.cc:740] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Running, Role: LEADER
I20260709 12:27:45.202217 20904 consensus_queue.cc:260] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:45.203538 20904 raft_consensus.cc:3060] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:45.209616 20978 raft_consensus.cc:2468] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 2.
I20260709 12:27:45.210858 20794 leader_election.cc:304] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, 6b2248c950284f1797be32cdcedccf97; no voters: 
I20260709 12:27:45.211036 20904 raft_consensus.cc:2468] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6b2248c950284f1797be32cdcedccf97 in term 2.
I20260709 12:27:45.211745 21053 raft_consensus.cc:2804] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:45.212303 21053 raft_consensus.cc:697] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 2 LEADER]: Becoming Leader. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Running, Role: LEADER
I20260709 12:27:45.213274 21053 consensus_queue.cc:237] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:45.221016 20725 catalog_manager.cc:5697] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 reported cstate change: term changed from 1 to 2, leader changed from c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2) to 6b2248c950284f1797be32cdcedccf97 (127.11.32.1). New cstate: current_term: 2 leader_uuid: "6b2248c950284f1797be32cdcedccf97" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.452018 20829 raft_consensus.cc:1275] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Refusing update from remote peer 4ffe8df78eef4f6db209f91a3d09c84e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:45.453293 21023 consensus_queue.cc:1048] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [LEADER]: Connected to new peer: Peer: permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:45.461671 20904 raft_consensus.cc:1275] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Refusing update from remote peer 4ffe8df78eef4f6db209f91a3d09c84e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:45.463747 21075 consensus_queue.cc:1048] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:45.502506 11392 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:27:45.504081 11392 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:27:45.504498 11392 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:27:45.516996 20829 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b"
dest_uuid: "6b2248c950284f1797be32cdcedccf97"
mode: GRACEFUL
new_leader_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
 from {username='slave'} at 127.0.0.1:33248
I20260709 12:27:45.517567 20829 raft_consensus.cc:606] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Received request to transfer leadership to TS c3782703d8ee49dd94a9e22ad963ccef
I20260709 12:27:45.518638 11392 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:27:45.625576 20904 raft_consensus.cc:1275] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Refusing update from remote peer 6b2248c950284f1797be32cdcedccf97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:45.626780 21053 consensus_queue.cc:1048] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:45.634286 20978 raft_consensus.cc:1275] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Refusing update from remote peer 6b2248c950284f1797be32cdcedccf97: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:45.635874 21053 consensus_queue.cc:1048] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:45.644241 21053 raft_consensus.cc:993] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: : Instructing follower c3782703d8ee49dd94a9e22ad963ccef to start an election
I20260709 12:27:45.644762 21078 raft_consensus.cc:1081] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Signalling peer c3782703d8ee49dd94a9e22ad963ccef to start an election
I20260709 12:27:45.646449 20904 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b"
dest_uuid: "c3782703d8ee49dd94a9e22ad963ccef"
 from {username='slave'} at 127.0.0.1:44706
I20260709 12:27:45.647037 20904 raft_consensus.cc:493] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:45.647389 20904 raft_consensus.cc:3060] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:45.654004 20904 raft_consensus.cc:515] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:45.656306 20904 leader_election.cc:290] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [CANDIDATE]: Term 2 election: Requested vote from peers 6b2248c950284f1797be32cdcedccf97 (127.11.32.1:39289), 4ffe8df78eef4f6db209f91a3d09c84e (127.11.32.3:43917)
I20260709 12:27:45.656459 20829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b" candidate_uuid: "c3782703d8ee49dd94a9e22ad963ccef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6b2248c950284f1797be32cdcedccf97"
I20260709 12:27:45.656917 20978 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5560fd736c0476c81ed78f08425bb4b" candidate_uuid: "c3782703d8ee49dd94a9e22ad963ccef" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4ffe8df78eef4f6db209f91a3d09c84e"
I20260709 12:27:45.657226 20829 raft_consensus.cc:3055] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:45.657559 20978 raft_consensus.cc:3060] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:45.657604 20829 raft_consensus.cc:740] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6b2248c950284f1797be32cdcedccf97, State: Running, Role: LEADER
I20260709 12:27:45.658537 20829 consensus_queue.cc:260] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:45.659777 20829 raft_consensus.cc:3060] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:45.664819 20978 raft_consensus.cc:2468] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3782703d8ee49dd94a9e22ad963ccef in term 2.
I20260709 12:27:45.666266 20869 leader_election.cc:304] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4ffe8df78eef4f6db209f91a3d09c84e, c3782703d8ee49dd94a9e22ad963ccef; no voters: 
I20260709 12:27:45.666922 20829 raft_consensus.cc:2468] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c3782703d8ee49dd94a9e22ad963ccef in term 2.
I20260709 12:27:45.667138 21072 raft_consensus.cc:2804] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:45.667721 21072 raft_consensus.cc:697] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 2 LEADER]: Becoming Leader. State: Replica: c3782703d8ee49dd94a9e22ad963ccef, State: Running, Role: LEADER
I20260709 12:27:45.668565 21072 consensus_queue.cc:237] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } }
I20260709 12:27:45.674687 20726 catalog_manager.cc:5697] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef reported cstate change: term changed from 1 to 2, leader changed from 6b2248c950284f1797be32cdcedccf97 (127.11.32.1) to c3782703d8ee49dd94a9e22ad963ccef (127.11.32.2). New cstate: current_term: 2 leader_uuid: "c3782703d8ee49dd94a9e22ad963ccef" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6b2248c950284f1797be32cdcedccf97" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 39289 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c3782703d8ee49dd94a9e22ad963ccef" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 33097 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4ffe8df78eef4f6db209f91a3d09c84e" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43917 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:45.730612 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
I20260709 12:27:45.755259 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:45.756093 11392 tablet_replica.cc:333] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97: stopping tablet replica
I20260709 12:27:45.756753 11392 raft_consensus.cc:2243] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.757688 11392 raft_consensus.cc:2272] T d9115fe6338a4f03a054360f153106bd P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.760076 11392 tablet_replica.cc:333] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97: stopping tablet replica
I20260709 12:27:45.760641 11392 raft_consensus.cc:2243] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.761047 11392 raft_consensus.cc:2272] T f5560fd736c0476c81ed78f08425bb4b P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.763230 11392 tablet_replica.cc:333] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97: stopping tablet replica
I20260709 12:27:45.763773 11392 raft_consensus.cc:2243] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.764549 11392 raft_consensus.cc:2272] T 875d5d6080ff4eecb4341aa6aca0d85f P 6b2248c950284f1797be32cdcedccf97 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.766801 11392 tablet_replica.cc:333] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97: stopping tablet replica
I20260709 12:27:45.767288 11392 raft_consensus.cc:2243] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.767709 11392 raft_consensus.cc:2272] T d97c846b9c2340e69181bce38112ede3 P 6b2248c950284f1797be32cdcedccf97 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.792695 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
I20260709 12:27:45.808151 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
I20260709 12:27:45.832201 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:45.832870 11392 tablet_replica.cc:333] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef: stopping tablet replica
I20260709 12:27:45.833362 11392 raft_consensus.cc:2243] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.833871 11392 raft_consensus.cc:2272] T d9115fe6338a4f03a054360f153106bd P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.836015 11392 tablet_replica.cc:333] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: stopping tablet replica
I20260709 12:27:45.836494 11392 raft_consensus.cc:2243] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.837040 11392 pending_rounds.cc:70] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: Trying to abort 1 pending ops.
I20260709 12:27:45.837201 11392 pending_rounds.cc:77] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305625868986363904 op_type: NO_OP noop_request { }
I20260709 12:27:45.837529 11392 raft_consensus.cc:2889] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:27:45.837795 11392 raft_consensus.cc:2272] T f5560fd736c0476c81ed78f08425bb4b P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.839890 11392 tablet_replica.cc:333] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef: stopping tablet replica
I20260709 12:27:45.840428 11392 raft_consensus.cc:2243] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.840785 11392 raft_consensus.cc:2272] T 875d5d6080ff4eecb4341aa6aca0d85f P c3782703d8ee49dd94a9e22ad963ccef [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.842892 11392 tablet_replica.cc:333] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef: stopping tablet replica
I20260709 12:27:45.843310 11392 raft_consensus.cc:2243] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.843680 11392 raft_consensus.cc:2272] T d97c846b9c2340e69181bce38112ede3 P c3782703d8ee49dd94a9e22ad963ccef [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.866986 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
I20260709 12:27:45.881906 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
I20260709 12:27:45.903743 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:45.904544 11392 tablet_replica.cc:333] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e: stopping tablet replica
I20260709 12:27:45.905177 11392 raft_consensus.cc:2243] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.905718 11392 raft_consensus.cc:2272] T d9115fe6338a4f03a054360f153106bd P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.907938 11392 tablet_replica.cc:333] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e: stopping tablet replica
I20260709 12:27:45.908404 11392 raft_consensus.cc:2243] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.908771 11392 raft_consensus.cc:2272] T f5560fd736c0476c81ed78f08425bb4b P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.910893 11392 tablet_replica.cc:333] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e: stopping tablet replica
I20260709 12:27:45.911346 11392 raft_consensus.cc:2243] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:45.911703 11392 raft_consensus.cc:2272] T 875d5d6080ff4eecb4341aa6aca0d85f P 4ffe8df78eef4f6db209f91a3d09c84e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.913565 11392 tablet_replica.cc:333] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e: stopping tablet replica
I20260709 12:27:45.913980 11392 raft_consensus.cc:2243] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.914732 11392 raft_consensus.cc:2272] T d97c846b9c2340e69181bce38112ede3 P 4ffe8df78eef4f6db209f91a3d09c84e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.939029 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
I20260709 12:27:45.954133 11392 master.cc:562] Master@127.11.32.62:40305 shutting down...
I20260709 12:27:45.971134 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:45.971660 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:45.971951 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P f66468ec18804b8c832121eaffde9ce9: stopping tablet replica
I20260709 12:27:45.991466 11392 master.cc:584] Master@127.11.32.62:40305 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2851 ms)
[----------] 6 tests from LeaderRebalancerTest (319412 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:27:46.030980 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:41291
I20260709 12:27:46.032073 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.037540 21079 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.037740 21080 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.038720 21082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.040899 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:46.041874 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.042089 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.042263 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600066042229 us; error 0 us; skew 500 ppm
I20260709 12:27:46.042868 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.045172 11392 webserver.cc:533] Webserver started at http://127.11.32.62:43827/ using document root <none> and password file <none>
I20260709 12:27:46.045866 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.046057 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.046355 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.047459 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "3cadc72b4a0a4e918ba3f631a23133d0"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.051901 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:46.055240 21087 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.055971 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:46.056260 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "3cadc72b4a0a4e918ba3f631a23133d0"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.056561 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.072001 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.073212 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.111410 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:41291
I20260709 12:27:46.111533 21138 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:41291 every 8 connection(s)
I20260709 12:27:46.115522 21139 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.128361 21139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0: Bootstrap starting.
I20260709 12:27:46.134435 21139 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.138983 21139 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0: No bootstrap required, opened a new log
I20260709 12:27:46.141144 21139 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" member_type: VOTER }
I20260709 12:27:46.141609 21139 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.141798 21139 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3cadc72b4a0a4e918ba3f631a23133d0, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.142297 21139 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" member_type: VOTER }
I20260709 12:27:46.142714 21139 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:46.142900 21139 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:46.143112 21139 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:46.148496 21139 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" member_type: VOTER }
I20260709 12:27:46.148998 21139 leader_election.cc:304] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3cadc72b4a0a4e918ba3f631a23133d0; no voters: 
I20260709 12:27:46.150166 21139 leader_election.cc:290] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:46.150527 21142 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:46.151907 21142 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 1 LEADER]: Becoming Leader. State: Replica: 3cadc72b4a0a4e918ba3f631a23133d0, State: Running, Role: LEADER
I20260709 12:27:46.152590 21142 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" member_type: VOTER }
I20260709 12:27:46.153188 21139 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:46.155347 21144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3cadc72b4a0a4e918ba3f631a23133d0. Latest consensus state: current_term: 1 leader_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" member_type: VOTER } }
I20260709 12:27:46.155316 21143 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3cadc72b4a0a4e918ba3f631a23133d0" member_type: VOTER } }
I20260709 12:27:46.156172 21144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:46.156255 21143 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:46.159746 21149 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:46.166498 21149 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:46.167513 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:46.175220 21149 catalog_manager.cc:1383] Generated new cluster ID: a0e749c2dc0a4acfa626f2afee9912a1
I20260709 12:27:46.175537 21149 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:46.201862 21149 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:46.203223 21149 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:46.221237 21149 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0: Generated new TSK 0
I20260709 12:27:46.221928 21149 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:46.234513 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.240687 21160 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.245726 11392 server_base.cc:1061] running on GCE node
W20260709 12:27:46.241761 21161 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.245597 21163 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.247525 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.247751 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.247951 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600066247931 us; error 0 us; skew 500 ppm
I20260709 12:27:46.248507 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.255028 11392 webserver.cc:533] Webserver started at http://127.11.32.1:34431/ using document root <none> and password file <none>
I20260709 12:27:46.255767 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.256074 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.256393 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.258037 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "f926f212b9ec47e1b9832c451b18793d"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.262917 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:27:46.266238 21168 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.267019 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:46.267333 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "f926f212b9ec47e1b9832c451b18793d"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.267645 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.283305 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.284547 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.286087 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:46.288419 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:46.288642 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.288883 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:46.289078 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.329703 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:33465
I20260709 12:27:46.329795 21230 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:33465 every 8 connection(s)
I20260709 12:27:46.334914 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.342614 21235 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.344595 21236 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.348001 21238 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.348634 11392 server_base.cc:1061] running on GCE node
I20260709 12:27:46.349617 21231 heartbeater.cc:344] Connected to a master server at 127.11.32.62:41291
I20260709 12:27:46.349994 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:46.350033 21231 heartbeater.cc:461] Registering TS with master...
W20260709 12:27:46.350332 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.350585 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600066350567 us; error 0 us; skew 500 ppm
I20260709 12:27:46.351081 21231 heartbeater.cc:507] Master 127.11.32.62:41291 requested a full tablet report, sending...
I20260709 12:27:46.351198 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.353391 21104 ts_manager.cc:194] Registered new tserver with Master: f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465)
I20260709 12:27:46.354033 11392 webserver.cc:533] Webserver started at http://127.11.32.2:39615/ using document root <none> and password file <none>
I20260709 12:27:46.354581 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.354784 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.355120 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.355707 21104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60120
I20260709 12:27:46.356323 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "b38373e0b7a247bbac343689aae3d117"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.360929 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 12:27:46.364234 21243 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.364990 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:46.365236 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "b38373e0b7a247bbac343689aae3d117"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.365556 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.403146 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.404297 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.405719 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:46.407928 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:46.408105 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.408401 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:46.408558 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.446898 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:46333
I20260709 12:27:46.447029 21305 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:46333 every 8 connection(s)
I20260709 12:27:46.451714 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:46.458984 21309 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:46.461192 21310 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.462177 11392 server_base.cc:1061] running on GCE node
W20260709 12:27:46.462595 21312 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:46.463815 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:46.464007 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:46.464239 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600066464218 us; error 0 us; skew 500 ppm
I20260709 12:27:46.464461 21306 heartbeater.cc:344] Connected to a master server at 127.11.32.62:41291
I20260709 12:27:46.464872 21306 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:46.464891 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:46.465765 21306 heartbeater.cc:507] Master 127.11.32.62:41291 requested a full tablet report, sending...
I20260709 12:27:46.467818 11392 webserver.cc:533] Webserver started at http://127.11.32.3:42719/ using document root <none> and password file <none>
I20260709 12:27:46.467887 21104 ts_manager.cc:194] Registered new tserver with Master: b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:46.468428 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:46.468654 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:46.468966 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:46.469596 21104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60122
I20260709 12:27:46.470342 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "a4fbf9bb745740699ee8d98aa1349677"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.474856 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:27:46.478034 21317 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.478797 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:27:46.479094 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "a4fbf9bb745740699ee8d98aa1349677"
format_stamp: "Formatted at 2026-07-09 12:27:46 on dist-test-slave-sckv"
I20260709 12:27:46.479384 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:46.492101 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:46.493153 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:46.494532 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:46.496691 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:46.496912 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.497149 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:46.497320 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:46.536089 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:41249
I20260709 12:27:46.536192 21379 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:41249 every 8 connection(s)
I20260709 12:27:46.549674 21380 heartbeater.cc:344] Connected to a master server at 127.11.32.62:41291
I20260709 12:27:46.550166 21380 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:46.550902 21380 heartbeater.cc:507] Master 127.11.32.62:41291 requested a full tablet report, sending...
I20260709 12:27:46.552742 21104 ts_manager.cc:194] Registered new tserver with Master: a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:46.552865 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013480497s
I20260709 12:27:46.554162 21104 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60124
I20260709 12:27:46.576467 21104 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60136:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:46.578996 21104 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:46.648617 21196 tablet_service.cc:1511] Processing CreateTablet for tablet 333ac402b2f248179b8da1f7d28b2918 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:46.650027 21196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333ac402b2f248179b8da1f7d28b2918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.655279 21195 tablet_service.cc:1511] Processing CreateTablet for tablet d06fddf2a255424fac4228a091089e22 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:46.656915 21195 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06fddf2a255424fac4228a091089e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.660202 21271 tablet_service.cc:1511] Processing CreateTablet for tablet 333ac402b2f248179b8da1f7d28b2918 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:46.662549 21270 tablet_service.cc:1511] Processing CreateTablet for tablet d06fddf2a255424fac4228a091089e22 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:46.664621 21269 tablet_service.cc:1511] Processing CreateTablet for tablet 46f02bd366174de8a7df40635254cbf9 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:46.667068 21268 tablet_service.cc:1511] Processing CreateTablet for tablet 92d478d0bf794326bd62100b24feafa3 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:46.675963 21271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333ac402b2f248179b8da1f7d28b2918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.676929 21194 tablet_service.cc:1511] Processing CreateTablet for tablet 46f02bd366174de8a7df40635254cbf9 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:46.678406 21194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f02bd366174de8a7df40635254cbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.682792 21270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06fddf2a255424fac4228a091089e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.683856 21269 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f02bd366174de8a7df40635254cbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.685844 21268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d478d0bf794326bd62100b24feafa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.694852 21266 tablet_service.cc:1511] Processing CreateTablet for tablet e1c59c12421342bba31c83aa6816450c (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:46.695822 21191 tablet_service.cc:1511] Processing CreateTablet for tablet e1c59c12421342bba31c83aa6816450c (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:46.697247 21191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c59c12421342bba31c83aa6816450c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.697618 21265 tablet_service.cc:1511] Processing CreateTablet for tablet 87e8e2587fb747e595f79bbb072d72ec (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:46.700279 21264 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62cce48e1a41b3ba8a28556f3edfff (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:46.701503 21189 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62cce48e1a41b3ba8a28556f3edfff (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:46.696282 21266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c59c12421342bba31c83aa6816450c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.702868 21189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62cce48e1a41b3ba8a28556f3edfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.705926 21264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62cce48e1a41b3ba8a28556f3edfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.700300 21190 tablet_service.cc:1511] Processing CreateTablet for tablet 87e8e2587fb747e595f79bbb072d72ec (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:46.709760 21265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e8e2587fb747e595f79bbb072d72ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.710640 21190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e8e2587fb747e595f79bbb072d72ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.687853 21193 tablet_service.cc:1511] Processing CreateTablet for tablet 92d478d0bf794326bd62100b24feafa3 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:46.718379 21344 tablet_service.cc:1511] Processing CreateTablet for tablet d06fddf2a255424fac4228a091089e22 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:46.719156 21193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d478d0bf794326bd62100b24feafa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.720221 21344 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d06fddf2a255424fac4228a091089e22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.693183 21267 tablet_service.cc:1511] Processing CreateTablet for tablet 8bca91b2101f49f2bf353f7748081b09 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:46.722337 21267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bca91b2101f49f2bf353f7748081b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.723371 21343 tablet_service.cc:1511] Processing CreateTablet for tablet 46f02bd366174de8a7df40635254cbf9 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:46.694054 21192 tablet_service.cc:1511] Processing CreateTablet for tablet 8bca91b2101f49f2bf353f7748081b09 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:46.727119 21192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bca91b2101f49f2bf353f7748081b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.706676 21188 tablet_service.cc:1511] Processing CreateTablet for tablet 475d307cccb94179bc03c20c30ff0fe3 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:46.730584 21188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475d307cccb94179bc03c20c30ff0fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.708283 21263 tablet_service.cc:1511] Processing CreateTablet for tablet 475d307cccb94179bc03c20c30ff0fe3 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:46.734627 21263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475d307cccb94179bc03c20c30ff0fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.715584 21345 tablet_service.cc:1511] Processing CreateTablet for tablet 333ac402b2f248179b8da1f7d28b2918 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:46.739872 21342 tablet_service.cc:1511] Processing CreateTablet for tablet 92d478d0bf794326bd62100b24feafa3 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:46.743506 21341 tablet_service.cc:1511] Processing CreateTablet for tablet 8bca91b2101f49f2bf353f7748081b09 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:46.747277 21340 tablet_service.cc:1511] Processing CreateTablet for tablet e1c59c12421342bba31c83aa6816450c (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:46.725250 21343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46f02bd366174de8a7df40635254cbf9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.753983 21345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 333ac402b2f248179b8da1f7d28b2918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.758008 21341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bca91b2101f49f2bf353f7748081b09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.762043 21342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92d478d0bf794326bd62100b24feafa3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.771106 21340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1c59c12421342bba31c83aa6816450c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.775070 21339 tablet_service.cc:1511] Processing CreateTablet for tablet 87e8e2587fb747e595f79bbb072d72ec (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:46.776655 21339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 87e8e2587fb747e595f79bbb072d72ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.776304 21338 tablet_service.cc:1511] Processing CreateTablet for tablet 1d62cce48e1a41b3ba8a28556f3edfff (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:46.777721 21395 tablet_bootstrap.cc:492] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:46.777752 21338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d62cce48e1a41b3ba8a28556f3edfff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.781041 21337 tablet_service.cc:1511] Processing CreateTablet for tablet 475d307cccb94179bc03c20c30ff0fe3 (DEFAULT_TABLE table=test-workload [id=922f6cb53229423caa1b5a0fc8cb347d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:46.782718 21337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 475d307cccb94179bc03c20c30ff0fe3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:46.787424 21396 tablet_bootstrap.cc:492] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:46.793026 21395 tablet_bootstrap.cc:654] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.819051 21395 tablet_bootstrap.cc:492] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:46.819608 21395 ts_tablet_manager.cc:1403] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.051s	user 0.011s	sys 0.000s
I20260709 12:27:46.847183 21396 tablet_bootstrap.cc:654] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.851042 21398 tablet_bootstrap.cc:492] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:46.851912 21395 raft_consensus.cc:359] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.857296 21395 raft_consensus.cc:385] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.857693 21395 raft_consensus.cc:740] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.858585 21395 consensus_queue.cc:260] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.868295 21398 tablet_bootstrap.cc:654] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.876156 21306 heartbeater.cc:499] Master 127.11.32.62:41291 was elected leader, sending a full tablet report...
I20260709 12:27:46.876979 21395 ts_tablet_manager.cc:1434] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.009s
I20260709 12:27:46.878427 21395 tablet_bootstrap.cc:492] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:46.880956 21396 tablet_bootstrap.cc:492] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:46.881841 21396 ts_tablet_manager.cc:1403] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.095s	user 0.011s	sys 0.004s
I20260709 12:27:46.888732 21395 tablet_bootstrap.cc:654] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.889954 21396 raft_consensus.cc:359] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.891139 21396 raft_consensus.cc:385] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.891515 21396 raft_consensus.cc:740] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.895784 21398 tablet_bootstrap.cc:492] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:46.896591 21398 ts_tablet_manager.cc:1403] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.005s
I20260709 12:27:46.899632 21395 tablet_bootstrap.cc:492] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:46.900249 21395 ts_tablet_manager.cc:1403] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:27:46.901777 21396 consensus_queue.cc:260] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.902755 21398 raft_consensus.cc:359] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.903687 21398 raft_consensus.cc:385] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.904115 21398 raft_consensus.cc:740] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.904592 21395 raft_consensus.cc:359] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.905392 21395 raft_consensus.cc:385] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.905743 21395 raft_consensus.cc:740] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.906579 21395 consensus_queue.cc:260] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.909051 21395 ts_tablet_manager.cc:1434] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260709 12:27:46.910162 21395 tablet_bootstrap.cc:492] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:46.905582 21398 consensus_queue.cc:260] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.917539 21395 tablet_bootstrap.cc:654] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.927383 21231 heartbeater.cc:499] Master 127.11.32.62:41291 was elected leader, sending a full tablet report...
I20260709 12:27:46.928383 21396 ts_tablet_manager.cc:1434] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.042s	user 0.015s	sys 0.016s
I20260709 12:27:46.929895 21396 tablet_bootstrap.cc:492] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:46.938757 21396 tablet_bootstrap.cc:654] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.943308 21403 raft_consensus.cc:493] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:46.945359 21403 raft_consensus.cc:515] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.946836 21380 heartbeater.cc:499] Master 127.11.32.62:41291 was elected leader, sending a full tablet report...
I20260709 12:27:46.949803 21398 ts_tablet_manager.cc:1434] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.053s	user 0.021s	sys 0.009s
I20260709 12:27:46.955482 21395 tablet_bootstrap.cc:492] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:46.955821 21398 tablet_bootstrap.cc:492] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:46.956107 21395 ts_tablet_manager.cc:1403] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.032s
I20260709 12:27:46.959769 21395 raft_consensus.cc:359] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.960944 21395 raft_consensus.cc:385] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.961447 21395 raft_consensus.cc:740] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.962951 21395 consensus_queue.cc:260] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.965672 21396 tablet_bootstrap.cc:492] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:46.966481 21396 ts_tablet_manager.cc:1403] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.037s	user 0.027s	sys 0.007s
I20260709 12:27:46.969763 21395 ts_tablet_manager.cc:1434] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.006s
I20260709 12:27:46.970978 21395 tablet_bootstrap.cc:492] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:46.970455 21396 raft_consensus.cc:359] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.971499 21396 raft_consensus.cc:385] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:46.971985 21396 raft_consensus.cc:740] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:46.973160 21396 consensus_queue.cc:260] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:46.976101 21396 ts_tablet_manager.cc:1434] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:27:46.977384 21398 tablet_bootstrap.cc:654] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.977478 21396 tablet_bootstrap.cc:492] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:46.978708 21395 tablet_bootstrap.cc:654] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:46.979218 21403 leader_election.cc:290] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:46.989701 21398 tablet_bootstrap.cc:492] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:46.992211 21398 ts_tablet_manager.cc:1403] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.000s
I20260709 12:27:47.002494 21395 tablet_bootstrap.cc:492] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:47.003201 21395 ts_tablet_manager.cc:1403] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.011s
I20260709 12:27:47.003196 21398 raft_consensus.cc:359] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.005300 21398 raft_consensus.cc:385] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.006212 21398 raft_consensus.cc:740] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.006700 21395 raft_consensus.cc:359] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.007511 21395 raft_consensus.cc:385] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.007833 21395 raft_consensus.cc:740] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.008401 21398 consensus_queue.cc:260] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.008592 21395 consensus_queue.cc:260] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.004647 21396 tablet_bootstrap.cc:654] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.012038 21395 ts_tablet_manager.cc:1434] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:27:47.013286 21395 tablet_bootstrap.cc:492] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:47.014183 21406 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.014731 21404 raft_consensus.cc:493] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.021672 21404 raft_consensus.cc:515] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.021914 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:47.023089 21398 ts_tablet_manager.cc:1434] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.030s	user 0.008s	sys 0.002s
W20260709 12:27:47.023924 21171 leader_election.cc:343] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.024430 21398 tablet_bootstrap.cc:492] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.024602 21399 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.025159 21399 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.028003 21399 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.028445 21406 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.033526 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
W20260709 12:27:47.035050 21171 leader_election.cc:343] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.037253 21395 tablet_bootstrap.cc:654] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.039387 21404 leader_election.cc:290] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.043584 21396 tablet_bootstrap.cc:492] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.044267 21396 ts_tablet_manager.cc:1403] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.067s	user 0.005s	sys 0.009s
I20260709 12:27:47.046654 21398 tablet_bootstrap.cc:654] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.053018 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.048117 21396 raft_consensus.cc:359] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.053956 21396 raft_consensus.cc:385] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:47.054904 21320 leader_election.cc:343] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.055256 21396 raft_consensus.cc:740] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.037634 21406 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.057554 21396 consensus_queue.cc:260] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.066221 21396 ts_tablet_manager.cc:1434] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.022s	user 0.011s	sys 0.001s
I20260709 12:27:47.067780 21396 tablet_bootstrap.cc:492] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:47.074836 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.075682 21281 raft_consensus.cc:2468] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 0.
I20260709 12:27:47.076745 21396 tablet_bootstrap.cc:654] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.077927 21319 leader_election.cc:304] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.078389 21399 raft_consensus.cc:493] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.078941 21399 raft_consensus.cc:515] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.080672 21404 raft_consensus.cc:2804] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.081080 21404 raft_consensus.cc:493] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.081380 21399 leader_election.cc:290] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.081435 21404 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.082067 21395 tablet_bootstrap.cc:492] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:47.082628 21395 ts_tablet_manager.cc:1403] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.008s
I20260709 12:27:47.084219 21398 tablet_bootstrap.cc:492] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.084735 21398 ts_tablet_manager.cc:1403] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.061s	user 0.011s	sys 0.001s
I20260709 12:27:47.085790 21395 raft_consensus.cc:359] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.086560 21395 raft_consensus.cc:385] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.086867 21395 raft_consensus.cc:740] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.087720 21395 consensus_queue.cc:260] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.089825 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.090642 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.091123 21395 ts_tablet_manager.cc:1434] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:47.090777 21404 raft_consensus.cc:515] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.091557 21280 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 0.
I20260709 12:27:47.092237 21395 tablet_bootstrap.cc:492] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:47.093529 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.094102 21205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:47.094256 21206 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
W20260709 12:27:47.095613 21320 leader_election.cc:343] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.095877 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.097369 21246 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.097851 21396 tablet_bootstrap.cc:492] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.098390 21396 ts_tablet_manager.cc:1403] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.000s
I20260709 12:27:47.098318 21399 raft_consensus.cc:2804] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.098937 21399 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.099267 21399 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:47.101636 21170 leader_election.cc:343] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.102175 21170 leader_election.cc:304] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117
I20260709 12:27:47.102747 21395 tablet_bootstrap.cc:654] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.103034 21406 raft_consensus.cc:2749] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.103502 21170 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:47.104411 21406 raft_consensus.cc:2804] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.104784 21406 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:47.104990 21246 leader_election.cc:343] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.105154 21406 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.111672 21398 raft_consensus.cc:359] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.112648 21398 raft_consensus.cc:385] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.113024 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:47.113034 21398 raft_consensus.cc:740] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.114805 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
W20260709 12:27:47.116182 21246 leader_election.cc:343] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.115499 21398 consensus_queue.cc:260] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.118271 21395 tablet_bootstrap.cc:492] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:47.118798 21395 ts_tablet_manager.cc:1403] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.003s
I20260709 12:27:47.118837 21398 ts_tablet_manager.cc:1434] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.034s	user 0.009s	sys 0.001s
I20260709 12:27:47.119844 21412 raft_consensus.cc:493] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.119714 21406 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.120613 21398 tablet_bootstrap.cc:492] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.120472 21412 raft_consensus.cc:515] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.122706 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.122854 21412 leader_election.cc:290] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.122545 21395 raft_consensus.cc:359] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.123486 21395 raft_consensus.cc:385] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.123805 21395 raft_consensus.cc:740] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.124850 21404 leader_election.cc:290] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.124591 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.124573 21395 consensus_queue.cc:260] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.125682 21206 raft_consensus.cc:2468] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 0.
I20260709 12:27:47.127189 21320 leader_election.cc:304] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
W20260709 12:27:47.124025 21246 leader_election.cc:343] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.128448 21246 leader_election.cc:304] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b38373e0b7a247bbac343689aae3d117; no voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.129640 21398 tablet_bootstrap.cc:654] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.131129 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
W20260709 12:27:47.132772 21171 leader_election.cc:343] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.133628 21396 raft_consensus.cc:359] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.134143 21395 ts_tablet_manager.cc:1434] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.008s
I20260709 12:27:47.134418 21396 raft_consensus.cc:385] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.134727 21396 raft_consensus.cc:740] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.135829 21396 consensus_queue.cc:260] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.136507 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.134953 21406 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.139636 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.140535 21281 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.141994 21422 raft_consensus.cc:2749] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.138139 21396 ts_tablet_manager.cc:1434] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:47.134928 21404 raft_consensus.cc:2804] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.150156 21404 raft_consensus.cc:493] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.150374 21395 tablet_bootstrap.cc:492] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:47.150723 21404 raft_consensus.cc:3060] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.150292 21396 tablet_bootstrap.cc:492] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:47.156654 21395 tablet_bootstrap.cc:654] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.114429 21399 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.158489 21280 raft_consensus.cc:2393] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f926f212b9ec47e1b9832c451b18793d in current term 1: Already voted for candidate b38373e0b7a247bbac343689aae3d117 in this term.
I20260709 12:27:47.159778 21399 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.160147 21170 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117
W20260709 12:27:47.160627 21319 leader_election.cc:343] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.162163 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:47.163054 21206 raft_consensus.cc:2393] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b38373e0b7a247bbac343689aae3d117 in current term 1: Already voted for candidate f926f212b9ec47e1b9832c451b18793d in this term.
I20260709 12:27:47.164057 21281 raft_consensus.cc:2468] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 1.
I20260709 12:27:47.163471 21396 tablet_bootstrap.cc:654] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.164572 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
W20260709 12:27:47.162964 21152 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:47.165942 21406 raft_consensus.cc:2749] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:27:47.167781 21246 leader_election.cc:343] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.168326 21246 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b38373e0b7a247bbac343689aae3d117; no voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.168558 21398 tablet_bootstrap.cc:492] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.169205 21399 raft_consensus.cc:2749] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.169816 21395 tablet_bootstrap.cc:492] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:47.170341 21395 ts_tablet_manager.cc:1403] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.004s
I20260709 12:27:47.170333 21319 leader_election.cc:304] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.171428 21412 raft_consensus.cc:2804] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.173988 21395 raft_consensus.cc:359] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.174431 21404 raft_consensus.cc:515] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.169843 21398 ts_tablet_manager.cc:1403] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.026s
I20260709 12:27:47.177386 21404 leader_election.cc:290] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.178162 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:47.175079 21395 raft_consensus.cc:385] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.178809 21206 raft_consensus.cc:3060] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.179029 21398 raft_consensus.cc:359] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.179000 21395 raft_consensus.cc:740] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.179973 21398 raft_consensus.cc:385] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.180505 21398 raft_consensus.cc:740] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.181073 21395 consensus_queue.cc:260] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.181547 21398 consensus_queue.cc:260] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.182799 21396 tablet_bootstrap.cc:492] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.183383 21396 ts_tablet_manager.cc:1403] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.008s
I20260709 12:27:47.185046 21398 ts_tablet_manager.cc:1434] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:47.185369 21395 ts_tablet_manager.cc:1434] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.015s	user 0.010s	sys 0.000s
I20260709 12:27:47.186188 21398 tablet_bootstrap.cc:492] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.186506 21395 tablet_bootstrap.cc:492] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:47.186908 21396 raft_consensus.cc:359] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.187767 21396 raft_consensus.cc:385] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.188086 21396 raft_consensus.cc:740] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.189061 21396 consensus_queue.cc:260] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.193547 21398 tablet_bootstrap.cc:654] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.194463 21395 tablet_bootstrap.cc:654] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.197688 21396 ts_tablet_manager.cc:1434] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.000s
I20260709 12:27:47.199261 21396 tablet_bootstrap.cc:492] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:47.207825 21396 tablet_bootstrap.cc:654] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.208242 21412 raft_consensus.cc:697] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:47.209673 21412 consensus_queue.cc:237] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.210508 21395 tablet_bootstrap.cc:492] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:47.211288 21395 ts_tablet_manager.cc:1403] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.007s
I20260709 12:27:47.215487 21395 raft_consensus.cc:359] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.216589 21395 raft_consensus.cc:385] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.216995 21395 raft_consensus.cc:740] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.216120 21206 raft_consensus.cc:2468] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 1.
I20260709 12:27:47.218259 21395 consensus_queue.cc:260] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.219178 21320 leader_election.cc:304] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.221941 21395 ts_tablet_manager.cc:1434] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.000s
I20260709 12:27:47.223333 21395 tablet_bootstrap.cc:492] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:47.232326 21396 tablet_bootstrap.cc:492] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.232612 21395 tablet_bootstrap.cc:654] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.232978 21396 ts_tablet_manager.cc:1403] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.034s	user 0.029s	sys 0.003s
I20260709 12:27:47.233783 21426 raft_consensus.cc:2804] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.234349 21426 raft_consensus.cc:697] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:47.235195 21426 consensus_queue.cc:237] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.236925 21396 raft_consensus.cc:359] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.237670 21404 raft_consensus.cc:493] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.238353 21404 raft_consensus.cc:515] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
W20260709 12:27:47.216866 21319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.2:46333, user_credentials={real_user=slave}} blocked reactor thread for 46617.5us
I20260709 12:27:47.241495 21404 leader_election.cc:290] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.242403 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.243218 21281 raft_consensus.cc:3060] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.243443 21396 raft_consensus.cc:385] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.244031 21396 raft_consensus.cc:740] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.245271 21396 consensus_queue.cc:260] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.250316 21406 raft_consensus.cc:493] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.251065 21406 raft_consensus.cc:515] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.256884 21403 raft_consensus.cc:493] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.257823 21403 raft_consensus.cc:515] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.262367 21279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.263228 21279 raft_consensus.cc:2468] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 0.
I20260709 12:27:47.264902 21170 leader_election.cc:304] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.260895 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.267506 21280 raft_consensus.cc:2468] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 0.
I20260709 12:27:47.271481 21319 leader_election.cc:304] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:47.272238 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
W20260709 12:27:47.274760 21320 leader_election.cc:343] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.266969 21281 raft_consensus.cc:2468] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 1.
I20260709 12:27:47.276643 21404 raft_consensus.cc:2804] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.277209 21404 raft_consensus.cc:493] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.277631 21404 raft_consensus.cc:3060] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.290795 21433 raft_consensus.cc:2804] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.291311 21433 raft_consensus.cc:493] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.291630 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
W20260709 12:27:47.293648 21171 leader_election.cc:343] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.294416 21406 leader_election.cc:290] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.295104 21406 raft_consensus.cc:493] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.295631 21406 raft_consensus.cc:515] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.303499 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ac402b2f248179b8da1f7d28b2918" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:47.303181 21104 catalog_manager.cc:5697] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:47.305531 21171 leader_election.cc:343] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.306216 21104 catalog_manager.cc:5697] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.312132 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:47.315379 21396 ts_tablet_manager.cc:1434] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.082s	user 0.011s	sys 0.000s
I20260709 12:27:47.307020 21403 leader_election.cc:290] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.314158 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
W20260709 12:27:47.316871 21171 leader_election.cc:343] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.317432 21280 raft_consensus.cc:2468] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 0.
I20260709 12:27:47.316847 21406 leader_election.cc:290] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.309326 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ac402b2f248179b8da1f7d28b2918" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.318853 21170 leader_election.cc:304] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:47.291646 21433 raft_consensus.cc:3060] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.320807 21281 raft_consensus.cc:2468] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 0.
I20260709 12:27:47.326524 21170 leader_election.cc:304] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:47.328178 21403 raft_consensus.cc:2804] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.328785 21403 raft_consensus.cc:493] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.329272 21403 raft_consensus.cc:3060] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.331566 21398 tablet_bootstrap.cc:492] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.332187 21398 ts_tablet_manager.cc:1403] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.146s	user 0.041s	sys 0.047s
I20260709 12:27:47.333716 21406 raft_consensus.cc:2804] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.334319 21404 raft_consensus.cc:515] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.335496 21398 raft_consensus.cc:359] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.337549 21398 raft_consensus.cc:385] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.337349 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
W20260709 12:27:47.338852 21320 leader_election.cc:343] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.339551 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.339581 21398 raft_consensus.cc:740] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.340195 21281 raft_consensus.cc:3060] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.345377 21396 tablet_bootstrap.cc:492] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:47.346066 21426 raft_consensus.cc:493] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.346601 21426 raft_consensus.cc:515] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.348752 21426 leader_election.cc:290] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.334380 21406 raft_consensus.cc:493] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.350003 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.350242 21406 raft_consensus.cc:3060] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:47.351570 21319 leader_election.cc:343] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.351953 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.348403 21281 raft_consensus.cc:2468] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 1.
I20260709 12:27:47.353323 21319 leader_election.cc:304] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: f926f212b9ec47e1b9832c451b18793d
W20260709 12:27:47.353328 21320 leader_election.cc:343] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.354902 21320 leader_election.cc:304] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.356531 21412 raft_consensus.cc:2804] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.357800 21426 raft_consensus.cc:2749] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.358773 21395 tablet_bootstrap.cc:492] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:47.359349 21395 ts_tablet_manager.cc:1403] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.136s	user 0.052s	sys 0.064s
I20260709 12:27:47.357299 21398 consensus_queue.cc:260] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.352115 21404 leader_election.cc:290] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.362493 21395 raft_consensus.cc:359] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.363243 21395 raft_consensus.cc:385] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.363575 21395 raft_consensus.cc:740] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.364418 21395 consensus_queue.cc:260] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.366676 21395 ts_tablet_manager.cc:1434] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:27:47.366838 21412 raft_consensus.cc:697] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:47.368227 21398 ts_tablet_manager.cc:1434] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.036s	user 0.008s	sys 0.000s
I20260709 12:27:47.368050 21412 consensus_queue.cc:237] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.369766 21398 tablet_bootstrap.cc:492] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.376669 21398 tablet_bootstrap.cc:654] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.378106 21403 raft_consensus.cc:515] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.381276 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
W20260709 12:27:47.382850 21171 leader_election.cc:343] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.383639 21403 leader_election.cc:290] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.383765 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.377159 21433 raft_consensus.cc:515] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.384613 21281 raft_consensus.cc:3060] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.387549 21104 catalog_manager.cc:5697] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:47.388404 21398 tablet_bootstrap.cc:492] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.389041 21398 ts_tablet_manager.cc:1403] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 12:27:47.391319 21406 raft_consensus.cc:515] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.393496 21406 leader_election.cc:290] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.393525 21281 raft_consensus.cc:2468] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:47.394678 21399 raft_consensus.cc:493] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.395157 21399 raft_consensus.cc:515] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.396028 21396 tablet_bootstrap.cc:654] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.397595 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.398253 21398 raft_consensus.cc:359] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.408068 21280 raft_consensus.cc:3060] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.408304 21398 raft_consensus.cc:385] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.408830 21398 raft_consensus.cc:740] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.409861 21398 consensus_queue.cc:260] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.413246 21398 ts_tablet_manager.cc:1434] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.003s
I20260709 12:27:47.414264 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ac402b2f248179b8da1f7d28b2918" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:47.414578 21398 tablet_bootstrap.cc:492] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.417061 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e8e2587fb747e595f79bbb072d72ec" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.417825 21206 raft_consensus.cc:2468] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:47.406713 21399 leader_election.cc:290] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.419126 21170 leader_election.cc:304] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:47.420248 21406 raft_consensus.cc:2804] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:27:47.420347 21171 leader_election.cc:343] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.420809 21406 raft_consensus.cc:697] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:47.421737 21406 consensus_queue.cc:237] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.422626 21398 tablet_bootstrap.cc:654] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.423399 21246 leader_election.cc:304] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.423813 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e8e2587fb747e595f79bbb072d72ec" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:47.424372 21399 raft_consensus.cc:2804] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.424750 21399 raft_consensus.cc:493] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.425148 21399 raft_consensus.cc:3060] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:47.425518 21246 leader_election.cc:343] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.429788 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ac402b2f248179b8da1f7d28b2918" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:47.430456 21281 raft_consensus.cc:3060] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.440634 21280 raft_consensus.cc:2468] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:47.443073 21433 leader_election.cc:290] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.443416 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:47.444278 21355 raft_consensus.cc:3060] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.436997 21399 raft_consensus.cc:515] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.447355 21399 leader_election.cc:290] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.448593 21170 leader_election.cc:304] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.448812 21354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e8e2587fb747e595f79bbb072d72ec" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:47.449611 21433 raft_consensus.cc:2804] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.450205 21433 raft_consensus.cc:697] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:47.450416 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e8e2587fb747e595f79bbb072d72ec" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:47.451049 21206 raft_consensus.cc:3060] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.451167 21433 consensus_queue.cc:237] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.455533 21398 tablet_bootstrap.cc:492] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.456279 21398 ts_tablet_manager.cc:1403] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.042s	user 0.009s	sys 0.019s
W20260709 12:27:47.458290 21246 leader_election.cc:343] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:47.460413 21206 raft_consensus.cc:2468] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:47.463148 21246 leader_election.cc:304] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:47.464612 21281 raft_consensus.cc:2468] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:47.464995 21399 raft_consensus.cc:2804] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.465804 21399 raft_consensus.cc:697] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:47.466050 21170 leader_election.cc:304] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:47.461022 21104 catalog_manager.cc:5697] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 0 to 1, leader changed from <none> to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 1 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.461035 21355 raft_consensus.cc:2468] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:47.467036 21406 raft_consensus.cc:2804] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.467526 21406 raft_consensus.cc:697] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:47.465399 21398 raft_consensus.cc:359] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.468385 21406 consensus_queue.cc:237] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.469292 21398 raft_consensus.cc:385] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.469722 21398 raft_consensus.cc:740] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.470716 21398 consensus_queue.cc:260] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.468246 21399 consensus_queue.cc:237] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.474164 21398 ts_tablet_manager.cc:1434] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.003s
I20260709 12:27:47.475621 21398 tablet_bootstrap.cc:492] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.485448 21398 tablet_bootstrap.cc:654] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.495795 21396 tablet_bootstrap.cc:492] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.496546 21396 ts_tablet_manager.cc:1403] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.152s	user 0.013s	sys 0.049s
I20260709 12:27:47.498307 21398 tablet_bootstrap.cc:492] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.498998 21398 ts_tablet_manager.cc:1403] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:27:47.501573 21396 raft_consensus.cc:359] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.502789 21398 raft_consensus.cc:359] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.503769 21398 raft_consensus.cc:385] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.504099 21398 raft_consensus.cc:740] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.502784 21396 raft_consensus.cc:385] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.505159 21396 raft_consensus.cc:740] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.506024 21396 consensus_queue.cc:260] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.507432 21398 consensus_queue.cc:260] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.507985 21412 raft_consensus.cc:493] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.508565 21412 raft_consensus.cc:515] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.509552 21398 ts_tablet_manager.cc:1434] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:27:47.510541 21398 tablet_bootstrap.cc:492] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:47.510948 21412 leader_election.cc:290] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.510833 21104 catalog_manager.cc:5697] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 0 to 1, leader changed from <none> to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 1 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.511844 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.513109 21104 catalog_manager.cc:5697] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 0 to 1, leader changed from <none> to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 1 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.516475 21398 tablet_bootstrap.cc:654] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.517244 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.518165 21281 raft_consensus.cc:2393] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate f926f212b9ec47e1b9832c451b18793d in this term.
I20260709 12:27:47.518592 21412 raft_consensus.cc:493] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.519078 21412 raft_consensus.cc:515] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.519629 21396 ts_tablet_manager.cc:1434] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.004s
I20260709 12:27:47.520962 21396 tablet_bootstrap.cc:492] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:47.519963 21101 catalog_manager.cc:5697] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.523234 21319 leader_election.cc:304] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.524999 21437 raft_consensus.cc:3060] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.528803 21396 tablet_bootstrap.cc:654] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.529889 21426 raft_consensus.cc:493] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.530711 21426 raft_consensus.cc:515] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.535459 21426 leader_election.cc:290] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.538836 21205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ac402b2f248179b8da1f7d28b2918" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.541090 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e8e2587fb747e595f79bbb072d72ec" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.542228 21206 raft_consensus.cc:2393] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate b38373e0b7a247bbac343689aae3d117 in this term.
I20260709 12:27:47.547961 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "333ac402b2f248179b8da1f7d28b2918" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.548997 21281 raft_consensus.cc:2393] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate f926f212b9ec47e1b9832c451b18793d in this term.
I20260709 12:27:47.556474 21319 leader_election.cc:304] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.559135 21412 leader_election.cc:290] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.559939 21412 raft_consensus.cc:3060] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.566965 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "87e8e2587fb747e595f79bbb072d72ec" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.569268 21319 leader_election.cc:304] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.570492 21426 raft_consensus.cc:3060] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.573359 21412 raft_consensus.cc:2749] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.574285 21437 raft_consensus.cc:2749] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.577909 21396 tablet_bootstrap.cc:492] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.577963 21398 tablet_bootstrap.cc:492] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:47.578527 21396 ts_tablet_manager.cc:1403] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.058s	user 0.019s	sys 0.035s
I20260709 12:27:47.578645 21398 ts_tablet_manager.cc:1403] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.040s
I20260709 12:27:47.578631 21426 raft_consensus.cc:2749] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.581193 21396 raft_consensus.cc:359] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.581842 21396 raft_consensus.cc:385] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.581717 21398 raft_consensus.cc:359] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.582166 21396 raft_consensus.cc:740] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.582484 21398 raft_consensus.cc:385] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.582782 21398 raft_consensus.cc:740] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.582875 21396 consensus_queue.cc:260] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.583498 21398 consensus_queue.cc:260] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.584903 21396 ts_tablet_manager.cc:1434] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:47.585773 21398 ts_tablet_manager.cc:1434] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:27:47.585933 21396 tablet_bootstrap.cc:492] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:47.592106 21396 tablet_bootstrap.cc:654] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:47.597267 21396 tablet_bootstrap.cc:492] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:47.597975 21396 ts_tablet_manager.cc:1403] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.001s
I20260709 12:27:47.600137 21396 raft_consensus.cc:359] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.600844 21396 raft_consensus.cc:385] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:47.601090 21396 raft_consensus.cc:740] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:47.601668 21396 consensus_queue.cc:260] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.603773 21396 ts_tablet_manager.cc:1434] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.001s
I20260709 12:27:47.617117 21399 raft_consensus.cc:493] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.617694 21399 raft_consensus.cc:515] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.619634 21399 leader_election.cc:290] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.620258 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.620687 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:47.620911 21206 raft_consensus.cc:2468] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:47.621373 21355 raft_consensus.cc:2468] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:47.622046 21246 leader_election.cc:304] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.622771 21399 raft_consensus.cc:2804] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:47.623076 21399 raft_consensus.cc:493] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:47.623427 21399 raft_consensus.cc:3060] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.628549 21399 raft_consensus.cc:515] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.630105 21399 leader_election.cc:290] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:47.630932 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:47.631137 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:47.631604 21206 raft_consensus.cc:3060] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.631666 21355 raft_consensus.cc:3060] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.638664 21206 raft_consensus.cc:2468] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:47.638664 21355 raft_consensus.cc:2468] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:47.639973 21246 leader_election.cc:304] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:47.640697 21399 raft_consensus.cc:2804] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:47.641178 21399 raft_consensus.cc:697] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:47.641883 21399 consensus_queue.cc:237] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.649088 21103 catalog_manager.cc:5697] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:47.651206 21426 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:47.651757 21426 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:47.653900 21426 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:47.654652 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:47.654956 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:47.655494 21206 raft_consensus.cc:2393] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate f926f212b9ec47e1b9832c451b18793d in this term.
I20260709 12:27:47.655808 21281 raft_consensus.cc:2393] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate b38373e0b7a247bbac343689aae3d117 in this term.
I20260709 12:27:47.657083 21319 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:47.658011 21426 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.658210 21206 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.663359 21426 raft_consensus.cc:2749] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:47.664777 21426 consensus_queue.cc:1048] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.676190 21426 consensus_queue.cc:1048] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.836486 21437 consensus_queue.cc:1048] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.839294 21406 consensus_queue.cc:1048] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.842592 21205 raft_consensus.cc:3060] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:47.854313 21412 consensus_queue.cc:1048] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.857573 21412 consensus_queue.cc:1048] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.858945 21406 consensus_queue.cc:1048] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.883224 21437 consensus_queue.cc:1048] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.913111 21403 consensus_queue.cc:1048] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.924067 21433 consensus_queue.cc:1048] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.926792 21433 consensus_queue.cc:1048] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:47.939563 21406 consensus_queue.cc:1048] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.005960 21399 consensus_queue.cc:1048] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.021332 21421 consensus_queue.cc:1048] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.126844 21421 consensus_queue.cc:1048] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:48.136852 21470 consensus_queue.cc:1048] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:48.169148 21152 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:48.941843 21470 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:48.942477 21470 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:48.944669 21470 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:48.945680 21205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:48.945832 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:48.946548 21205 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:48.946606 21355 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:48.948347 21246 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:48.949043 21470 raft_consensus.cc:2804] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:48.949333 21470 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:48.949680 21470 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.955737 21470 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:48.957247 21470 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:48.958137 21205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:48.958446 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:48.958787 21205 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.959187 21355 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:48.963955 21205 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:48.964926 21355 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:48.965073 21246 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:48.965976 21470 raft_consensus.cc:2804] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:48.966405 21470 raft_consensus.cc:697] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:48.967273 21470 consensus_queue.cc:237] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:48.974486 21103 catalog_manager.cc:5697] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 2, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.321148 21355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d06fddf2a255424fac4228a091089e22"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
mode: GRACEFUL
new_leader_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:60208
I20260709 12:27:49.321796 21355 raft_consensus.cc:606] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Received request to transfer leadership to TS f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:49.337356 21279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:44376
I20260709 12:27:49.337909 21279 raft_consensus.cc:606] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Received request to transfer leadership to TS f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:49.342736 21355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
mode: GRACEFUL
new_leader_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:60208
I20260709 12:27:49.343278 21355 raft_consensus.cc:606] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Received request to transfer leadership to TS b38373e0b7a247bbac343689aae3d117
I20260709 12:27:49.356153 21205 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
mode: GRACEFUL
new_leader_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:45762
I20260709 12:27:49.356693 21205 raft_consensus.cc:606] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Received request to transfer leadership to TS b38373e0b7a247bbac343689aae3d117
I20260709 12:27:49.364315 21355 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
mode: GRACEFUL
new_leader_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:60208
I20260709 12:27:49.364794 21355 raft_consensus.cc:606] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Received request to transfer leadership to TS b38373e0b7a247bbac343689aae3d117
I20260709 12:27:49.369359 21279 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:44376
I20260709 12:27:49.370043 21279 raft_consensus.cc:606] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Received request to transfer leadership to TS a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:49.448752 21484 raft_consensus.cc:993] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: : Instructing follower b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:49.449262 21467 raft_consensus.cc:1081] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Signalling peer b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:49.449715 21485 raft_consensus.cc:993] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: : Instructing follower f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:49.450217 21426 raft_consensus.cc:1081] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Signalling peer f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:49.450903 21280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:44362
I20260709 12:27:49.451505 21280 raft_consensus.cc:493] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:49.451728 21205 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d06fddf2a255424fac4228a091089e22"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:45752
I20260709 12:27:49.451853 21280 raft_consensus.cc:3060] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.452319 21205 raft_consensus.cc:493] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:49.452674 21205 raft_consensus.cc:3060] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.457316 21280 raft_consensus.cc:515] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.457677 21205 raft_consensus.cc:515] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.459409 21280 leader_election.cc:290] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:49.459625 21205 leader_election.cc:290] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:49.460568 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:49.460942 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:49.461261 21206 raft_consensus.cc:3055] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:49.461556 21280 raft_consensus.cc:3060] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.461640 21206 raft_consensus.cc:740] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:49.462164 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1c59c12421342bba31c83aa6816450c" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:49.462743 21355 raft_consensus.cc:3060] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.462529 21206 consensus_queue.cc:260] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.463871 21206 raft_consensus.cc:3060] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.465361 21354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d06fddf2a255424fac4228a091089e22" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:49.465981 21354 raft_consensus.cc:3055] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:49.466279 21354 raft_consensus.cc:740] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:49.467140 21354 consensus_queue.cc:260] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.468472 21354 raft_consensus.cc:3060] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.469224 21280 raft_consensus.cc:2468] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:49.470352 21355 raft_consensus.cc:2468] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:49.471091 21206 raft_consensus.cc:2468] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:49.471655 21246 leader_election.cc:304] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:49.472497 21470 raft_consensus.cc:2804] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.472409 21170 leader_election.cc:304] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:49.473326 21467 raft_consensus.cc:2804] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.473748 21470 raft_consensus.cc:697] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:49.473831 21467 raft_consensus.cc:697] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:49.474689 21470 consensus_queue.cc:237] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.475893 21354 raft_consensus.cc:2468] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:49.475637 21467 consensus_queue.cc:237] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.483731 21426 raft_consensus.cc:993] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: : Instructing follower b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:49.484198 21426 raft_consensus.cc:1081] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Signalling peer b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:49.484200 21103 catalog_manager.cc:5697] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 1 to 2, leader changed from f926f212b9ec47e1b9832c451b18793d (127.11.32.1) to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.485873 21102 catalog_manager.cc:5697] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 1 to 2, leader changed from a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3) to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 2 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.488142 21280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:27:49.488747 21280 raft_consensus.cc:493] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:49.489140 21280 raft_consensus.cc:3060] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.496191 21280 raft_consensus.cc:515] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.498814 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:49.499410 21206 raft_consensus.cc:3060] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.499583 21354 raft_consensus.cc:1275] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:49.501297 21470 consensus_queue.cc:1048] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:49.505213 21280 leader_election.cc:290] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:49.507252 21206 raft_consensus.cc:2468] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:49.507638 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d62cce48e1a41b3ba8a28556f3edfff" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:49.508280 21355 raft_consensus.cc:3055] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:49.508625 21355 raft_consensus.cc:740] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:49.509052 21246 leader_election.cc:304] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:49.509459 21355 consensus_queue.cc:260] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.510610 21486 raft_consensus.cc:2804] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.510900 21355 raft_consensus.cc:3060] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.511121 21486 raft_consensus.cc:697] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:49.512012 21486 consensus_queue.cc:237] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.519940 21355 raft_consensus.cc:2468] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:49.526701 21206 raft_consensus.cc:1275] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:49.529064 21470 consensus_queue.cc:1048] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:49.531240 21102 catalog_manager.cc:5697] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 1 to 2, leader changed from a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3) to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.540501 21470 raft_consensus.cc:993] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: : Instructing follower f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:49.540956 21470 raft_consensus.cc:1081] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Signalling peer f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:49.542583 21206 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:45738
I20260709 12:27:49.543066 21206 raft_consensus.cc:493] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:49.543381 21206 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.549607 21206 raft_consensus.cc:515] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.551370 21206 leader_election.cc:290] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 3 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:49.552035 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:49.552481 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92d478d0bf794326bd62100b24feafa3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:49.552625 21280 raft_consensus.cc:3055] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:49.553089 21280 raft_consensus.cc:740] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:49.553136 21355 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.553973 21280 consensus_queue.cc:260] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.555012 21280 raft_consensus.cc:3060] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:49.559507 21355 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 3.
I20260709 12:27:49.560505 21171 leader_election.cc:304] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:49.560622 21280 raft_consensus.cc:2468] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 3.
I20260709 12:27:49.561239 21467 raft_consensus.cc:2804] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:49.561851 21467 raft_consensus.cc:697] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 3 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:49.562580 21467 consensus_queue.cc:237] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.570441 21102 catalog_manager.cc:5697] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 2 to 3, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 3 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.584756 21494 raft_consensus.cc:993] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: : Instructing follower a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:49.585155 21470 raft_consensus.cc:1081] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Signalling peer a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:49.586611 21355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:27:49.587059 21355 raft_consensus.cc:493] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:49.587309 21355 raft_consensus.cc:3060] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.592291 21355 raft_consensus.cc:515] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.593817 21355 leader_election.cc:290] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:49.594683 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:49.594978 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "475d307cccb94179bc03c20c30ff0fe3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:49.595351 21206 raft_consensus.cc:3060] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.595561 21280 raft_consensus.cc:3055] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:49.595969 21280 raft_consensus.cc:740] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:49.596786 21280 consensus_queue.cc:260] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.598069 21280 raft_consensus.cc:3060] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.602591 21206 raft_consensus.cc:2468] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:49.603824 21320 leader_election.cc:304] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:49.604601 21426 raft_consensus.cc:2804] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.604965 21280 raft_consensus.cc:2468] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:49.605110 21426 raft_consensus.cc:697] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:49.606002 21426 consensus_queue.cc:237] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.614099 21102 catalog_manager.cc:5697] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 1 to 2, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:49.705086 21485 raft_consensus.cc:993] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: : Instructing follower b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:49.705529 21426 raft_consensus.cc:1081] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Signalling peer b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:49.707005 21280 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:44372
I20260709 12:27:49.707495 21280 raft_consensus.cc:493] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:49.707801 21280 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.712725 21280 raft_consensus.cc:515] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.714438 21280 leader_election.cc:290] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:49.715221 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:49.715591 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:49.715818 21206 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.716207 21355 raft_consensus.cc:3055] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:49.716495 21355 raft_consensus.cc:740] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:49.717222 21355 consensus_queue.cc:260] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.718247 21355 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:49.721038 21206 raft_consensus.cc:2468] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:49.722126 21246 leader_election.cc:304] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:49.722923 21470 raft_consensus.cc:2804] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:49.723307 21470 raft_consensus.cc:697] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:49.723745 21355 raft_consensus.cc:2468] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:49.724125 21470 consensus_queue.cc:237] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:49.731288 21102 catalog_manager.cc:5697] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 1 to 2, leader changed from a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3) to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:49.920957 21206 raft_consensus.cc:1275] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.922339 21470 consensus_queue.cc:1048] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.931581 21355 raft_consensus.cc:1275] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.933141 21494 consensus_queue.cc:1048] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.933868 21205 raft_consensus.cc:1275] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.937335 21280 raft_consensus.cc:1275] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.937258 21486 consensus_queue.cc:1048] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.939391 21484 consensus_queue.cc:1048] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:49.960945 21355 raft_consensus.cc:1275] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.963271 21355 raft_consensus.cc:1275] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:49.963358 21494 consensus_queue.cc:1048] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:49.968346 21467 consensus_queue.cc:1048] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.057583 21280 raft_consensus.cc:1275] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:50.058917 21484 consensus_queue.cc:1048] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.069082 21354 raft_consensus.cc:1275] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:27:50.070755 21508 consensus_queue.cc:1048] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.189371 21206 raft_consensus.cc:1275] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:50.190764 21426 consensus_queue.cc:1048] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.198489 21280 raft_consensus.cc:1275] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:50.200021 21485 consensus_queue.cc:1048] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.236670 21206 raft_consensus.cc:1275] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:50.238528 21470 consensus_queue.cc:1048] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:50.247200 21354 raft_consensus.cc:1275] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:50.248736 21470 consensus_queue.cc:1048] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:52.397637 21101 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43082:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:27:52.399992 21101 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:27:52.454888 21192 tablet_service.cc:1511] Processing CreateTablet for tablet b737db1f80f04146bce4c0e8357c28bc (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:52.455821 21263 tablet_service.cc:1511] Processing CreateTablet for tablet b737db1f80f04146bce4c0e8357c28bc (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:52.456442 21192 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b737db1f80f04146bce4c0e8357c28bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.457098 21263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b737db1f80f04146bce4c0e8357c28bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.458434 21188 tablet_service.cc:1511] Processing CreateTablet for tablet 01f74b081077470897c5ec0f629eae16 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:52.459875 21188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f74b081077470897c5ec0f629eae16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.460559 21339 tablet_service.cc:1511] Processing CreateTablet for tablet 01f74b081077470897c5ec0f629eae16 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:52.461834 21339 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f74b081077470897c5ec0f629eae16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.462397 21270 tablet_service.cc:1511] Processing CreateTablet for tablet 01f74b081077470897c5ec0f629eae16 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:27:52.463745 21270 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01f74b081077470897c5ec0f629eae16. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.466562 21342 tablet_service.cc:1511] Processing CreateTablet for tablet b737db1f80f04146bce4c0e8357c28bc (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:27:52.467950 21342 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b737db1f80f04146bce4c0e8357c28bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.471825 21189 tablet_service.cc:1511] Processing CreateTablet for tablet c03f207f873e42278604136c4c88ed19 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:52.473241 21189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03f207f873e42278604136c4c88ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.475085 21264 tablet_service.cc:1511] Processing CreateTablet for tablet c03f207f873e42278604136c4c88ed19 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:52.476374 21264 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03f207f873e42278604136c4c88ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.479171 21190 tablet_service.cc:1511] Processing CreateTablet for tablet 024de366ff8e435a8bf55e7e72886069 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:52.480463 21190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024de366ff8e435a8bf55e7e72886069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.482718 21345 tablet_service.cc:1511] Processing CreateTablet for tablet c03f207f873e42278604136c4c88ed19 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:27:52.484361 21345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c03f207f873e42278604136c4c88ed19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.489544 21340 tablet_service.cc:1511] Processing CreateTablet for tablet 024de366ff8e435a8bf55e7e72886069 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:52.490813 21340 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024de366ff8e435a8bf55e7e72886069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.491868 21191 tablet_service.cc:1511] Processing CreateTablet for tablet ba006b16213840b382f280757bc7c01b (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:52.493280 21191 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba006b16213840b382f280757bc7c01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.500010 21338 tablet_service.cc:1511] Processing CreateTablet for tablet ba006b16213840b382f280757bc7c01b (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:52.501392 21338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba006b16213840b382f280757bc7c01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.510636 21526 tablet_bootstrap.cc:492] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.515064 21271 tablet_service.cc:1511] Processing CreateTablet for tablet 024de366ff8e435a8bf55e7e72886069 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:27:52.516597 21271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 024de366ff8e435a8bf55e7e72886069. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.521538 21343 tablet_service.cc:1511] Processing CreateTablet for tablet ab4776663f314f97885cd8c3722e5457 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:52.522990 21343 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4776663f314f97885cd8c3722e5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.527366 21266 tablet_service.cc:1511] Processing CreateTablet for tablet ba006b16213840b382f280757bc7c01b (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:27:52.527663 21268 tablet_service.cc:1511] Processing CreateTablet for tablet ab4776663f314f97885cd8c3722e5457 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:52.528823 21266 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba006b16213840b382f280757bc7c01b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.529510 21268 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4776663f314f97885cd8c3722e5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.530490 21189 tablet_service.cc:1511] Processing CreateTablet for tablet ab4776663f314f97885cd8c3722e5457 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:27:52.531946 21189 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab4776663f314f97885cd8c3722e5457. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.532668 21265 tablet_service.cc:1511] Processing CreateTablet for tablet e30a764565714f078aaae3c3ba5daa2c (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:52.534078 21265 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30a764565714f078aaae3c3ba5daa2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.537657 21188 tablet_service.cc:1511] Processing CreateTablet for tablet e30a764565714f078aaae3c3ba5daa2c (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:52.539108 21188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30a764565714f078aaae3c3ba5daa2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.543821 21337 tablet_service.cc:1511] Processing CreateTablet for tablet e30a764565714f078aaae3c3ba5daa2c (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:27:52.545254 21337 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e30a764565714f078aaae3c3ba5daa2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.547542 21194 tablet_service.cc:1511] Processing CreateTablet for tablet 0f03559265d94a88be94541beb735744 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:52.549134 21194 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f03559265d94a88be94541beb735744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.552188 21267 tablet_service.cc:1511] Processing CreateTablet for tablet 0f03559265d94a88be94541beb735744 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:52.554014 21267 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f03559265d94a88be94541beb735744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.554227 21338 tablet_service.cc:1511] Processing CreateTablet for tablet 0f03559265d94a88be94541beb735744 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:27:52.555576 21338 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f03559265d94a88be94541beb735744. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.561930 21196 tablet_service.cc:1511] Processing CreateTablet for tablet 753446de8ea545d98cffa3b1471a56e3 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:52.563323 21196 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753446de8ea545d98cffa3b1471a56e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.568292 21526 tablet_bootstrap.cc:654] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.574576 21527 tablet_bootstrap.cc:492] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:52.546418 21528 tablet_bootstrap.cc:492] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.580694 21263 tablet_service.cc:1511] Processing CreateTablet for tablet 753446de8ea545d98cffa3b1471a56e3 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:52.582084 21263 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753446de8ea545d98cffa3b1471a56e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.582971 21341 tablet_service.cc:1511] Processing CreateTablet for tablet 753446de8ea545d98cffa3b1471a56e3 (DEFAULT_TABLE table=soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:27:52.584506 21341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 753446de8ea545d98cffa3b1471a56e3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:52.587965 21528 tablet_bootstrap.cc:654] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.607618 21527 tablet_bootstrap.cc:654] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.639678 21526 tablet_bootstrap.cc:492] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.640283 21526 ts_tablet_manager.cc:1403] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.130s	user 0.016s	sys 0.000s
I20260709 12:27:52.643826 21526 raft_consensus.cc:359] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.650382 21526 raft_consensus.cc:385] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.654029 21526 raft_consensus.cc:740] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.657555 21527 tablet_bootstrap.cc:492] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:52.658214 21527 ts_tablet_manager.cc:1403] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.084s	user 0.010s	sys 0.008s
I20260709 12:27:52.659622 21528 tablet_bootstrap.cc:492] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.663699 21528 ts_tablet_manager.cc:1403] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.118s	user 0.014s	sys 0.015s
I20260709 12:27:52.657999 21526 consensus_queue.cc:260] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.665231 21527 raft_consensus.cc:359] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.665916 21526 ts_tablet_manager.cc:1434] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260709 12:27:52.666056 21527 raft_consensus.cc:385] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.666548 21527 raft_consensus.cc:740] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.666872 21528 raft_consensus.cc:359] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.667537 21526 tablet_bootstrap.cc:492] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.672747 21528 raft_consensus.cc:385] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.673170 21528 raft_consensus.cc:740] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.673936 21528 consensus_queue.cc:260] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.676399 21528 ts_tablet_manager.cc:1434] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 12:27:52.677481 21528 tablet_bootstrap.cc:492] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.679417 21526 tablet_bootstrap.cc:654] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.667557 21527 consensus_queue.cc:260] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.681890 21527 ts_tablet_manager.cc:1434] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:27:52.682932 21527 tablet_bootstrap.cc:492] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:52.689463 21528 tablet_bootstrap.cc:654] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.689639 21527 tablet_bootstrap.cc:654] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.695570 21526 tablet_bootstrap.cc:492] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.695729 21527 tablet_bootstrap.cc:492] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:52.696177 21527 ts_tablet_manager.cc:1403] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 12:27:52.696115 21526 ts_tablet_manager.cc:1403] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.007s
I20260709 12:27:52.696451 21528 tablet_bootstrap.cc:492] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.696908 21528 ts_tablet_manager.cc:1403] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.003s
I20260709 12:27:52.699723 21526 raft_consensus.cc:359] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.699819 21528 raft_consensus.cc:359] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.700681 21526 raft_consensus.cc:385] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.700388 21527 raft_consensus.cc:359] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.700795 21528 raft_consensus.cc:385] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.701041 21526 raft_consensus.cc:740] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.701172 21527 raft_consensus.cc:385] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.701258 21528 raft_consensus.cc:740] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.701630 21527 raft_consensus.cc:740] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.701961 21526 consensus_queue.cc:260] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.702375 21528 consensus_queue.cc:260] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.702487 21527 consensus_queue.cc:260] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.704433 21526 ts_tablet_manager.cc:1434] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.008s	user 0.000s	sys 0.005s
I20260709 12:27:52.704864 21527 ts_tablet_manager.cc:1434] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:27:52.705530 21526 tablet_bootstrap.cc:492] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.706019 21527 tablet_bootstrap.cc:492] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:52.711161 21528 ts_tablet_manager.cc:1434] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260709 12:27:52.712262 21528 tablet_bootstrap.cc:492] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.713310 21526 tablet_bootstrap.cc:654] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.718668 21528 tablet_bootstrap.cc:654] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.723481 21527 tablet_bootstrap.cc:654] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.724593 21526 tablet_bootstrap.cc:492] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.725239 21526 ts_tablet_manager.cc:1403] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.011s
I20260709 12:27:52.728693 21527 tablet_bootstrap.cc:492] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:52.728642 21526 raft_consensus.cc:359] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.729131 21528 tablet_bootstrap.cc:492] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.729219 21527 ts_tablet_manager.cc:1403] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.003s
I20260709 12:27:52.729547 21526 raft_consensus.cc:385] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.729821 21528 ts_tablet_manager.cc:1403] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.002s
I20260709 12:27:52.729884 21526 raft_consensus.cc:740] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.730798 21526 consensus_queue.cc:260] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.732154 21527 raft_consensus.cc:359] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.732892 21527 raft_consensus.cc:385] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.733268 21526 ts_tablet_manager.cc:1434] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.002s
I20260709 12:27:52.733042 21528 raft_consensus.cc:359] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.733206 21527 raft_consensus.cc:740] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.733897 21528 raft_consensus.cc:385] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.734277 21528 raft_consensus.cc:740] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.734426 21526 tablet_bootstrap.cc:492] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.734843 21527 consensus_queue.cc:260] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.735167 21528 consensus_queue.cc:260] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.738125 21528 ts_tablet_manager.cc:1434] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:52.739130 21528 tablet_bootstrap.cc:492] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.741586 21526 tablet_bootstrap.cc:654] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.743443 21527 ts_tablet_manager.cc:1434] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 12:27:52.744522 21527 tablet_bootstrap.cc:492] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:52.750927 21527 tablet_bootstrap.cc:654] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.751878 21528 tablet_bootstrap.cc:654] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.757200 21515 raft_consensus.cc:493] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.757975 21515 raft_consensus.cc:515] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.759501 21526 tablet_bootstrap.cc:492] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.760229 21526 ts_tablet_manager.cc:1403] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.026s	user 0.005s	sys 0.018s
I20260709 12:27:52.762023 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f74b081077470897c5ec0f629eae16" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:52.762971 21528 tablet_bootstrap.cc:492] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.763693 21528 ts_tablet_manager.cc:1403] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.000s
I20260709 12:27:52.763548 21526 raft_consensus.cc:359] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.764331 21526 raft_consensus.cc:385] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.764956 21526 raft_consensus.cc:740] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.765913 21526 consensus_queue.cc:260] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.767602 21528 raft_consensus.cc:359] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.768049 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f74b081077470897c5ec0f629eae16" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:52.768787 21528 raft_consensus.cc:385] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.769263 21528 raft_consensus.cc:740] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
W20260709 12:27:52.770371 21319 leader_election.cc:343] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.770403 21528 consensus_queue.cc:260] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.774844 21528 ts_tablet_manager.cc:1434] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:27:52.762893 21206 raft_consensus.cc:2468] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 0.
I20260709 12:27:52.775473 21526 ts_tablet_manager.cc:1434] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:27:52.776692 21526 tablet_bootstrap.cc:492] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.781908 21528 tablet_bootstrap.cc:492] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.783634 21526 tablet_bootstrap.cc:654] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.764318 21515 leader_election.cc:290] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:52.789515 21528 tablet_bootstrap.cc:654] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.796907 21526 tablet_bootstrap.cc:492] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.797617 21526 ts_tablet_manager.cc:1403] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.004s
I20260709 12:27:52.804287 21526 raft_consensus.cc:359] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.805305 21526 raft_consensus.cc:385] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.805702 21526 raft_consensus.cc:740] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.806730 21526 consensus_queue.cc:260] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.810206 21526 ts_tablet_manager.cc:1434] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:27:52.812783 21526 tablet_bootstrap.cc:492] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.813936 21528 tablet_bootstrap.cc:492] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.814543 21528 ts_tablet_manager.cc:1403] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.019s
I20260709 12:27:52.816198 21320 leader_election.cc:304] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: b38373e0b7a247bbac343689aae3d117
I20260709 12:27:52.817770 21528 raft_consensus.cc:359] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.818203 21515 raft_consensus.cc:2804] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.818614 21528 raft_consensus.cc:385] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.818813 21515 raft_consensus.cc:493] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.819144 21528 raft_consensus.cc:740] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.819311 21526 tablet_bootstrap.cc:654] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.819366 21515 raft_consensus.cc:3060] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.820292 21528 consensus_queue.cc:260] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.823064 21528 ts_tablet_manager.cc:1434] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:27:52.824489 21528 tablet_bootstrap.cc:492] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.829986 21470 raft_consensus.cc:493] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.830700 21470 raft_consensus.cc:515] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.831414 21526 tablet_bootstrap.cc:492] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.831981 21526 ts_tablet_manager.cc:1403] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 12:27:52.832527 21528 tablet_bootstrap.cc:654] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.834913 21470 leader_election.cc:290] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:52.835204 21526 raft_consensus.cc:359] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.836181 21526 raft_consensus.cc:385] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.836580 21526 raft_consensus.cc:740] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.837620 21526 consensus_queue.cc:260] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.842307 21470 raft_consensus.cc:493] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.842830 21470 raft_consensus.cc:515] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.844558 21526 ts_tablet_manager.cc:1434] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:27:52.844841 21470 leader_election.cc:290] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:52.845635 21526 tablet_bootstrap.cc:492] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.846378 21528 tablet_bootstrap.cc:492] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.846954 21528 ts_tablet_manager.cc:1403] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.005s
I20260709 12:27:52.850095 21528 raft_consensus.cc:359] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.850991 21528 raft_consensus.cc:385] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.851336 21528 raft_consensus.cc:740] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.852140 21528 consensus_queue.cc:260] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.852969 21526 tablet_bootstrap.cc:654] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.855126 21528 ts_tablet_manager.cc:1434] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:52.856336 21528 tablet_bootstrap.cc:492] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.870393 21470 raft_consensus.cc:493] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.871248 21470 raft_consensus.cc:515] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
W20260709 12:27:52.863646 21320 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.11.32.1:33465, user_credentials={real_user=slave}} blocked reactor thread for 47587.7us
I20260709 12:27:52.873556 21528 tablet_bootstrap.cc:654] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.875155 21526 tablet_bootstrap.cc:492] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.875746 21526 ts_tablet_manager.cc:1403] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.021s
I20260709 12:27:52.879818 21526 raft_consensus.cc:359] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.880774 21526 raft_consensus.cc:385] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.881156 21526 raft_consensus.cc:740] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.882191 21526 consensus_queue.cc:260] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.885922 21526 ts_tablet_manager.cc:1434] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.010s	user 0.010s	sys 0.002s
I20260709 12:27:52.887240 21526 tablet_bootstrap.cc:492] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.893646 21528 tablet_bootstrap.cc:492] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.894287 21528 ts_tablet_manager.cc:1403] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.003s
I20260709 12:27:52.894426 21354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:52.893246 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:52.896315 21526 tablet_bootstrap.cc:654] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:52.897472 21246 leader_election.cc:343] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.897974 21528 raft_consensus.cc:359] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
W20260709 12:27:52.898679 21246 leader_election.cc:343] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.898912 21528 raft_consensus.cc:385] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.899561 21528 raft_consensus.cc:740] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.900671 21528 consensus_queue.cc:260] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.907718 21528 ts_tablet_manager.cc:1434] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.003s
I20260709 12:27:52.908885 21528 tablet_bootstrap.cc:492] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.916982 21528 tablet_bootstrap.cc:654] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.918195 21470 leader_election.cc:290] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:52.919798 21526 tablet_bootstrap.cc:492] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.920375 21526 ts_tablet_manager.cc:1403] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.033s	user 0.019s	sys 0.003s
I20260709 12:27:52.921059 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba006b16213840b382f280757bc7c01b" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:52.922057 21355 raft_consensus.cc:2468] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:52.923979 21526 raft_consensus.cc:359] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.924966 21526 raft_consensus.cc:385] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.925325 21526 raft_consensus.cc:740] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.926139 21526 consensus_queue.cc:260] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.929442 21526 ts_tablet_manager.cc:1434] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:27:52.929718 21515 raft_consensus.cc:515] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.930706 21526 tablet_bootstrap.cc:492] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: Bootstrap starting.
I20260709 12:27:52.931984 21246 leader_election.cc:304] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:52.933264 21470 raft_consensus.cc:2804] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.934844 21470 raft_consensus.cc:493] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.935192 21470 raft_consensus.cc:3060] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.938211 21553 raft_consensus.cc:493] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.938805 21553 raft_consensus.cc:515] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.940454 21526 tablet_bootstrap.cc:654] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.940913 21553 leader_election.cc:290] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:52.942978 21528 tablet_bootstrap.cc:492] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:52.943694 21528 ts_tablet_manager.cc:1403] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.016s
I20260709 12:27:52.944774 21527 tablet_bootstrap.cc:492] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:52.944692 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:52.945387 21527 ts_tablet_manager.cc:1403] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.201s	user 0.044s	sys 0.098s
I20260709 12:27:52.946620 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:52.947279 21206 raft_consensus.cc:2468] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:52.947765 21528 raft_consensus.cc:359] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.948488 21527 raft_consensus.cc:359] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.948835 21528 raft_consensus.cc:385] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.949126 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:52.949421 21528 raft_consensus.cc:740] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.949818 21206 raft_consensus.cc:2468] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:52.950271 21527 raft_consensus.cc:385] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.950596 21527 raft_consensus.cc:740] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.950667 21528 consensus_queue.cc:260] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.951478 21527 consensus_queue.cc:260] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.952164 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba006b16213840b382f280757bc7c01b" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:52.952840 21206 raft_consensus.cc:2468] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:52.954309 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:52.954942 21206 raft_consensus.cc:2468] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:52.956296 21528 ts_tablet_manager.cc:1434] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
W20260709 12:27:52.951401 21246 leader_election.cc:343] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.957302 21526 tablet_bootstrap.cc:492] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: No bootstrap required, opened a new log
I20260709 12:27:52.956444 21527 ts_tablet_manager.cc:1434] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:27:52.957317 21528 tablet_bootstrap.cc:492] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: Bootstrap starting.
I20260709 12:27:52.957952 21246 leader_election.cc:304] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:52.958940 21527 tablet_bootstrap.cc:492] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:52.959158 21553 raft_consensus.cc:2804] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.959545 21553 raft_consensus.cc:493] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.959858 21553 raft_consensus.cc:3060] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.957834 21526 ts_tablet_manager.cc:1403] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.016s
I20260709 12:27:52.964236 21526 raft_consensus.cc:359] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.964505 21206 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f74b081077470897c5ec0f629eae16" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:52.964958 21526 raft_consensus.cc:385] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:52.965314 21526 raft_consensus.cc:740] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Initialized, Role: FOLLOWER
I20260709 12:27:52.965133 21206 raft_consensus.cc:3060] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.966060 21526 consensus_queue.cc:260] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.968143 21553 raft_consensus.cc:515] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.970911 21526 ts_tablet_manager.cc:1434] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:27:52.969462 21246 leader_election.cc:304] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:52.972124 21528 tablet_bootstrap.cc:654] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:52.971673 21548 raft_consensus.cc:2804] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.972623 21553 leader_election.cc:290] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:52.973214 21246 leader_election.cc:304] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:52.972574 21548 raft_consensus.cc:493] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.974779 21548 raft_consensus.cc:3060] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.974831 21553 raft_consensus.cc:2804] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:52.975626 21553 raft_consensus.cc:493] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:52.977747 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:52.981258 21553 raft_consensus.cc:3060] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:52.986192 21527 tablet_bootstrap.cc:654] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:52.982170 21246 leader_election.cc:343] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:52.993939 21553 raft_consensus.cc:515] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:52.996997 21553 leader_election.cc:290] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:52.997651 21553 raft_consensus.cc:493] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:52.998242 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:52.998186 21553 raft_consensus.cc:515] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
W20260709 12:27:52.999781 21246 leader_election.cc:343] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:53.000524 21553 leader_election.cc:290] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.001006 21528 tablet_bootstrap.cc:492] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: No bootstrap required, opened a new log
I20260709 12:27:53.001739 21528 ts_tablet_manager.cc:1403] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.016s
I20260709 12:27:53.001897 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:53.002578 21355 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:53.003554 21246 leader_election.cc:304] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:53.003594 21553 raft_consensus.cc:493] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.004616 21553 raft_consensus.cc:515] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.005897 21528 raft_consensus.cc:359] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.006336 21527 tablet_bootstrap.cc:492] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:53.006740 21528 raft_consensus.cc:385] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.007055 21527 ts_tablet_manager.cc:1403] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.003s
I20260709 12:27:53.007128 21528 raft_consensus.cc:740] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.008430 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f03559265d94a88be94541beb735744" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:53.008225 21528 consensus_queue.cc:260] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.009078 21355 raft_consensus.cc:2468] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:53.010620 21246 leader_election.cc:304] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:53.011222 21527 raft_consensus.cc:359] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.012174 21527 raft_consensus.cc:385] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.012454 21527 raft_consensus.cc:740] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.013130 21553 leader_election.cc:290] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.020133 21528 ts_tablet_manager.cc:1434] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: Time spent starting tablet: real 0.018s	user 0.012s	sys 0.000s
I20260709 12:27:53.019076 21205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.013228 21527 consensus_queue.cc:260] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.016341 21560 raft_consensus.cc:2804] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:53.022766 21205 raft_consensus.cc:3060] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.024493 21544 raft_consensus.cc:493] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.024899 21527 ts_tablet_manager.cc:1434] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.017s	user 0.008s	sys 0.000s
I20260709 12:27:53.024984 21544 raft_consensus.cc:515] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.026193 21527 tablet_bootstrap.cc:492] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:53.027446 21544 leader_election.cc:290] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:53.029220 21205 raft_consensus.cc:2468] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.029783 21560 raft_consensus.cc:493] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.029309 21204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:53.030449 21560 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.030797 21204 raft_consensus.cc:2393] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate b38373e0b7a247bbac343689aae3d117 in this term.
I20260709 12:27:53.018169 21559 raft_consensus.cc:2804] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:53.038439 21559 raft_consensus.cc:493] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.038825 21559 raft_consensus.cc:3060] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.040354 21560 raft_consensus.cc:515] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.041453 21527 tablet_bootstrap.cc:654] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:53.044669 21560 leader_election.cc:290] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.049590 21559 raft_consensus.cc:515] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.050571 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.051479 21355 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.053787 21559 leader_election.cc:290] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.054668 21354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f03559265d94a88be94541beb735744" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.055603 21354 raft_consensus.cc:3060] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.066382 21204 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.066987 21355 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.067422 21204 raft_consensus.cc:3060] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.068228 21354 raft_consensus.cc:2468] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.069869 21246 leader_election.cc:304] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:53.070914 21559 raft_consensus.cc:2804] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.071144 21246 leader_election.cc:304] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:53.071561 21559 raft_consensus.cc:697] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.073320 21560 raft_consensus.cc:2804] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.073877 21560 raft_consensus.cc:697] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.074015 21515 leader_election.cc:290] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:53.075100 21527 tablet_bootstrap.cc:492] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:53.074736 21560 consensus_queue.cc:237] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.075639 21527 ts_tablet_manager.cc:1403] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.019s
I20260709 12:27:53.076568 21206 raft_consensus.cc:2468] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 1.
I20260709 12:27:53.077824 21320 leader_election.cc:304] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:53.078846 21527 raft_consensus.cc:359] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.079847 21527 raft_consensus.cc:385] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.079871 21205 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:53.080260 21527 raft_consensus.cc:740] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.080451 21559 consensus_queue.cc:237] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.080866 21205 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:53.082417 21203 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f03559265d94a88be94541beb735744" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:53.083132 21203 raft_consensus.cc:2468] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 0.
I20260709 12:27:53.081293 21527 consensus_queue.cc:260] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.078888 21204 raft_consensus.cc:2468] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.085795 21544 raft_consensus.cc:2804] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.087332 21527 ts_tablet_manager.cc:1434] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:27:53.087741 21544 raft_consensus.cc:697] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:53.088428 21527 tablet_bootstrap.cc:492] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:53.088644 21544 consensus_queue.cc:237] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.096066 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:53.097155 21280 raft_consensus.cc:2393] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate b38373e0b7a247bbac343689aae3d117 in this term.
I20260709 12:27:53.096323 21279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f74b081077470897c5ec0f629eae16" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.097682 21279 raft_consensus.cc:3060] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.098917 21470 raft_consensus.cc:515] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.105916 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.106635 21201 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.100473 21548 raft_consensus.cc:515] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.102571 21319 leader_election.cc:304] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.109268 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f03559265d94a88be94541beb735744" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.108764 21104 catalog_manager.cc:5697] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.102599 21527 tablet_bootstrap.cc:654] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:53.110005 21200 raft_consensus.cc:3060] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.110752 21104 catalog_manager.cc:5697] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.115195 21548 leader_election.cc:290] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.115536 21246 leader_election.cc:304] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.116675 21543 raft_consensus.cc:493] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.117168 21543 raft_consensus.cc:515] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.119261 21543 leader_election.cc:290] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.120376 21354 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba006b16213840b382f280757bc7c01b" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.121004 21354 raft_consensus.cc:3060] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.126015 21246 leader_election.cc:304] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.126454 21515 raft_consensus.cc:3060] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.127035 21559 raft_consensus.cc:2804] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.127550 21559 raft_consensus.cc:697] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.127911 21561 raft_consensus.cc:2804] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.128659 21561 raft_consensus.cc:697] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.128396 21559 consensus_queue.cc:237] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.129894 21561 consensus_queue.cc:237] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.134426 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.135174 21353 raft_consensus.cc:3060] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.136984 21200 raft_consensus.cc:2468] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.138779 21279 raft_consensus.cc:2468] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 1.
I20260709 12:27:53.141686 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:53.147383 21280 raft_consensus.cc:2468] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 0.
I20260709 12:27:53.148664 21354 raft_consensus.cc:2468] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.150038 21246 leader_election.cc:304] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:53.150898 21561 raft_consensus.cc:2804] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.151561 21561 raft_consensus.cc:697] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.152380 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:53.105919 21470 leader_election.cc:290] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.152765 21561 consensus_queue.cc:237] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
W20260709 12:27:53.153712 21171 leader_election.cc:343] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:53.141252 21100 catalog_manager.cc:5697] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 0 to 1, leader changed from <none> to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:53.154798 21201 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.155818 21353 raft_consensus.cc:2468] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.157541 21246 leader_election.cc:304] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:53.157986 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba006b16213840b382f280757bc7c01b" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.158665 21470 raft_consensus.cc:2804] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.158672 21202 raft_consensus.cc:3060] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.159350 21470 raft_consensus.cc:697] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.160502 21470 consensus_queue.cc:237] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.172071 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.173040 21201 raft_consensus.cc:3060] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.151854 21515 raft_consensus.cc:2749] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:53.178473 21170 leader_election.cc:304] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.179411 21201 raft_consensus.cc:2468] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.179930 21543 raft_consensus.cc:2804] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:53.168911 21202 raft_consensus.cc:2468] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 1.
I20260709 12:27:53.180284 21543 raft_consensus.cc:493] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.180840 21543 raft_consensus.cc:3060] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.183053 21508 raft_consensus.cc:493] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.183351 21527 tablet_bootstrap.cc:492] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:53.183935 21527 ts_tablet_manager.cc:1403] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.096s	user 0.033s	sys 0.037s
I20260709 12:27:53.183607 21508 raft_consensus.cc:515] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.185971 21508 leader_election.cc:290] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.187762 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677" is_pre_election: true
I20260709 12:27:53.188715 21543 raft_consensus.cc:515] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
W20260709 12:27:53.189384 21171 leader_election.cc:343] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:53.190909 21543 leader_election.cc:290] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.190358 21527 raft_consensus.cc:359] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.191151 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:53.191442 21527 raft_consensus.cc:385] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.191864 21280 raft_consensus.cc:2468] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 0.
I20260709 12:27:53.191888 21527 raft_consensus.cc:740] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.192967 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.193475 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.194080 21280 raft_consensus.cc:3060] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.194288 21170 leader_election.cc:304] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.193673 21527 consensus_queue.cc:260] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.195334 21353 raft_consensus.cc:3060] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.197289 21527 ts_tablet_manager.cc:1434] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:27:53.198705 21527 tablet_bootstrap.cc:492] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
I20260709 12:27:53.201840 21280 raft_consensus.cc:2468] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:53.202505 21543 raft_consensus.cc:2804] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:53.203512 21543 raft_consensus.cc:493] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:53.203888 21543 raft_consensus.cc:3060] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.205423 21353 raft_consensus.cc:2468] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:53.209259 21170 leader_election.cc:304] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:53.210001 21527 tablet_bootstrap.cc:654] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:53.210116 21508 raft_consensus.cc:2804] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.210697 21508 raft_consensus.cc:697] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.211679 21508 consensus_queue.cc:237] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.217989 21543 raft_consensus.cc:515] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.222414 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.222853 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.223289 21280 raft_consensus.cc:3060] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:53.225708 21171 leader_election.cc:343] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:53.226502 21543 leader_election.cc:290] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.232895 21280 raft_consensus.cc:2468] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 1.
I20260709 12:27:53.233915 21527 tablet_bootstrap.cc:492] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:53.234485 21527 ts_tablet_manager.cc:1403] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.036s	user 0.013s	sys 0.017s
I20260709 12:27:53.234700 21170 leader_election.cc:304] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.236030 21543 raft_consensus.cc:2804] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.236591 21543 raft_consensus.cc:697] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.237452 21543 consensus_queue.cc:237] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.240156 21527 raft_consensus.cc:359] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.240898 21527 raft_consensus.cc:385] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.241176 21527 raft_consensus.cc:740] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.242089 21527 consensus_queue.cc:260] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.244884 21527 ts_tablet_manager.cc:1434] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260709 12:27:53.246016 21527 tablet_bootstrap.cc:492] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: Bootstrap starting.
W20260709 12:27:53.250528 21152 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:53.253737 21527 tablet_bootstrap.cc:654] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:53.253257 21103 catalog_manager.cc:5697] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 0 to 1, leader changed from <none> to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 1 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.254617 21104 catalog_manager.cc:5697] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.255945 21104 catalog_manager.cc:5697] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.257481 21104 catalog_manager.cc:5697] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.258723 21527 tablet_bootstrap.cc:492] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: No bootstrap required, opened a new log
I20260709 12:27:53.259234 21527 ts_tablet_manager.cc:1403] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 12:27:53.258998 21104 catalog_manager.cc:5697] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 0 to 1, leader changed from <none> to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.261979 21527 raft_consensus.cc:359] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.262565 21527 raft_consensus.cc:385] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.262835 21527 raft_consensus.cc:740] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.263595 21527 consensus_queue.cc:260] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.265504 21527 ts_tablet_manager.cc:1434] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:53.271817 21103 catalog_manager.cc:5697] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 0 to 1, leader changed from <none> to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 1 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.315164 21280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:44376
I20260709 12:27:53.315613 21280 raft_consensus.cc:606] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Received request to transfer leadership to TS f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.320796 21353 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01f74b081077470897c5ec0f629eae16"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
mode: GRACEFUL
new_leader_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:60208
I20260709 12:27:53.321247 21353 raft_consensus.cc:606] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Received request to transfer leadership to TS f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.326519 21280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c03f207f873e42278604136c4c88ed19"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:44376
I20260709 12:27:53.326999 21280 raft_consensus.cc:606] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Received request to transfer leadership to TS f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.331738 21280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:44376
I20260709 12:27:53.332216 21280 raft_consensus.cc:606] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Received request to transfer leadership to TS f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.342607 21202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
mode: GRACEFUL
new_leader_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:45762
I20260709 12:27:53.343073 21202 raft_consensus.cc:606] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Received request to transfer leadership to TS b38373e0b7a247bbac343689aae3d117
I20260709 12:27:53.351351 21202 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
mode: GRACEFUL
new_leader_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:45762
I20260709 12:27:53.351828 21202 raft_consensus.cc:606] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Received request to transfer leadership to TS a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.458536 21559 consensus_queue.cc:1048] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.469329 21559 consensus_queue.cc:1048] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.509703 21559 consensus_queue.cc:1048] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.520569 21559 consensus_queue.cc:1048] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.532128 21470 raft_consensus.cc:993] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: : Instructing follower f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.532644 21559 raft_consensus.cc:1081] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Signalling peer f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.534260 21202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:45738
I20260709 12:27:53.534763 21202 raft_consensus.cc:493] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.535105 21202 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.540556 21202 raft_consensus.cc:515] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.543038 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.542810 21202 leader_election.cc:290] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.543421 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.543700 21280 raft_consensus.cc:3055] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.544027 21280 raft_consensus.cc:740] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.544055 21353 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.544853 21280 consensus_queue.cc:260] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.546067 21280 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.550884 21353 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.552000 21171 leader_election.cc:304] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:53.552439 21280 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.552672 21543 raft_consensus.cc:2804] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.553648 21543 raft_consensus.cc:697] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.554546 21543 consensus_queue.cc:237] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.558856 21544 raft_consensus.cc:493] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.559326 21544 raft_consensus.cc:515] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.561251 21544 leader_election.cc:290] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:53.562287 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:53.562310 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:53.561808 21100 catalog_manager.cc:5697] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 1 to 2, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 2 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.563091 21202 raft_consensus.cc:2393] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a4fbf9bb745740699ee8d98aa1349677 in current term 1: Already voted for candidate b38373e0b7a247bbac343689aae3d117 in this term.
I20260709 12:27:53.564175 21320 leader_election.cc:304] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.564846 21544 raft_consensus.cc:3060] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.571378 21544 raft_consensus.cc:2749] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:53.608855 21544 consensus_queue.cc:1048] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.616351 21515 raft_consensus.cc:993] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: : Instructing follower f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.617172 21544 raft_consensus.cc:1081] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Signalling peer f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.618963 21201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01f74b081077470897c5ec0f629eae16"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:45752
I20260709 12:27:53.620618 21201 raft_consensus.cc:493] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.621007 21201 raft_consensus.cc:3060] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.622960 21470 consensus_queue.cc:1048] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.624953 21544 consensus_queue.cc:1048] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:27:53.630180 21201 raft_consensus.cc:515] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.638039 21201 leader_election.cc:290] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.639434 21279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f74b081077470897c5ec0f629eae16" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.639779 21559 consensus_queue.cc:1048] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.642530 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01f74b081077470897c5ec0f629eae16" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.643105 21355 raft_consensus.cc:3055] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.643388 21355 raft_consensus.cc:740] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:53.644129 21355 consensus_queue.cc:260] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.645315 21355 raft_consensus.cc:3060] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.650302 21548 consensus_queue.cc:1048] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.654275 21548 consensus_queue.cc:1048] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.655360 21355 raft_consensus.cc:2468] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.658197 21548 consensus_queue.cc:1048] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.658542 21171 leader_election.cc:304] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: b38373e0b7a247bbac343689aae3d117
I20260709 12:27:53.659505 21543 raft_consensus.cc:2804] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.660006 21543 raft_consensus.cc:697] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.660830 21543 consensus_queue.cc:237] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.675849 21561 consensus_queue.cc:1048] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.683792 21559 consensus_queue.cc:1048] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.697587 21470 raft_consensus.cc:993] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: : Instructing follower f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.698132 21561 raft_consensus.cc:1081] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Signalling peer f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.697650 21100 catalog_manager.cc:5697] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 1 to 2, leader changed from a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3) to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 2 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.705262 21201 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c03f207f873e42278604136c4c88ed19"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:45738
I20260709 12:27:53.705885 21201 raft_consensus.cc:493] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.706233 21201 raft_consensus.cc:3060] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.713709 21470 consensus_queue.cc:1048] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:53.715066 21543 consensus_queue.cc:1048] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.715018 21201 raft_consensus.cc:515] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.717288 21201 leader_election.cc:290] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.717383 21202 raft_consensus.cc:1240] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Rejecting Update request from peer b38373e0b7a247bbac343689aae3d117 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:53.718474 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.719105 21353 raft_consensus.cc:3060] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.724170 21279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c03f207f873e42278604136c4c88ed19" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.724833 21279 raft_consensus.cc:3055] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.725143 21279 raft_consensus.cc:740] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.725953 21279 consensus_queue.cc:260] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.727039 21279 raft_consensus.cc:3060] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.727072 21353 raft_consensus.cc:2468] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.727958 21355 raft_consensus.cc:1240] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Rejecting Update request from peer b38373e0b7a247bbac343689aae3d117 for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:53.728500 21171 leader_election.cc:304] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:53.729450 21543 raft_consensus.cc:2804] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.730048 21543 raft_consensus.cc:697] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.731498 21543 consensus_queue.cc:237] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.732141 21544 raft_consensus.cc:493] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:53.732733 21544 raft_consensus.cc:515] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.734848 21544 leader_election.cc:290] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:53.736816 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f926f212b9ec47e1b9832c451b18793d" is_pre_election: true
I20260709 12:27:53.738740 21542 raft_consensus.cc:993] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: : Instructing follower b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:53.740020 21508 raft_consensus.cc:1081] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Signalling peer b38373e0b7a247bbac343689aae3d117 to start an election
I20260709 12:27:53.741945 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b38373e0b7a247bbac343689aae3d117" is_pre_election: true
I20260709 12:27:53.743522 21281 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
 from {username='slave'} at 127.0.0.1:44362
I20260709 12:27:53.743664 21319 leader_election.cc:304] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677; no voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d
I20260709 12:27:53.744071 21281 raft_consensus.cc:493] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.744473 21281 raft_consensus.cc:3060] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.744619 21544 raft_consensus.cc:2749] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:53.750989 21279 raft_consensus.cc:2468] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.753681 21543 consensus_queue.cc:1048] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.755290 21281 raft_consensus.cc:515] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.762286 21281 leader_election.cc:290] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.766665 21354 raft_consensus.cc:3060] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.767246 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.767961 21201 raft_consensus.cc:3055] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.768352 21201 raft_consensus.cc:740] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.769277 21201 consensus_queue.cc:260] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.769755 21104 catalog_manager.cc:5697] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 1 to 2, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 2 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.770591 21201 raft_consensus.cc:3060] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.771998 21353 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e30a764565714f078aaae3c3ba5daa2c" candidate_uuid: "b38373e0b7a247bbac343689aae3d117" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.774645 21596 raft_consensus.cc:993] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: : Instructing follower f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.775082 21596 raft_consensus.cc:1081] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Signalling peer f926f212b9ec47e1b9832c451b18793d to start an election
I20260709 12:27:53.776922 21202 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
 from {username='slave'} at 127.0.0.1:45738
I20260709 12:27:53.777519 21202 raft_consensus.cc:493] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.778721 21202 raft_consensus.cc:3060] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.779042 21201 raft_consensus.cc:2468] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b38373e0b7a247bbac343689aae3d117 in term 2.
I20260709 12:27:53.780428 21246 leader_election.cc:304] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:53.781332 21470 raft_consensus.cc:2804] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.781837 21470 raft_consensus.cc:697] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Leader. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.782627 21470 consensus_queue.cc:237] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.788311 21508 raft_consensus.cc:993] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: : Instructing follower a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:53.788892 21508 raft_consensus.cc:1081] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Signalling peer a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:53.790429 21202 raft_consensus.cc:515] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.793431 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.794203 21281 raft_consensus.cc:3055] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.794530 21281 raft_consensus.cc:740] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:53.794698 21354 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:60198
I20260709 12:27:53.795338 21354 raft_consensus.cc:493] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:53.795739 21354 raft_consensus.cc:3060] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.798017 21281 consensus_queue.cc:260] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.799207 21281 raft_consensus.cc:3060] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.803319 21202 leader_election.cc:290] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Requested vote from peers b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333), a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3:41249)
I20260709 12:27:53.804957 21543 consensus_queue.cc:1048] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:53.803073 21354 raft_consensus.cc:515] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.808590 21355 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b737db1f80f04146bce4c0e8357c28bc" candidate_uuid: "f926f212b9ec47e1b9832c451b18793d" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
I20260709 12:27:53.809199 21355 raft_consensus.cc:3060] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.811147 21281 raft_consensus.cc:2468] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.811666 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:53.812323 21202 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "753446de8ea545d98cffa3b1471a56e3" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:53.812423 21170 leader_election.cc:304] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b38373e0b7a247bbac343689aae3d117, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:53.813045 21202 raft_consensus.cc:3055] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:53.813400 21202 raft_consensus.cc:740] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.813540 21354 leader_election.cc:290] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:53.813247 21100 catalog_manager.cc:5697] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 reported cstate change: term changed from 1 to 2, leader changed from f926f212b9ec47e1b9832c451b18793d (127.11.32.1) to b38373e0b7a247bbac343689aae3d117 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "b38373e0b7a247bbac343689aae3d117" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.814321 21202 consensus_queue.cc:260] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.815148 21600 raft_consensus.cc:2804] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.815502 21202 raft_consensus.cc:3060] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:53.817377 21600 raft_consensus.cc:697] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Becoming Leader. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:53.818334 21600 consensus_queue.cc:237] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.820853 21355 raft_consensus.cc:2468] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f926f212b9ec47e1b9832c451b18793d in term 2.
I20260709 12:27:53.823510 21202 raft_consensus.cc:2468] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:53.825490 21320 leader_election.cc:304] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: b38373e0b7a247bbac343689aae3d117
I20260709 12:27:53.826679 21544 raft_consensus.cc:2804] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:53.827124 21544 raft_consensus.cc:697] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:53.827911 21544 consensus_queue.cc:237] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:53.832737 21100 catalog_manager.cc:5697] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d reported cstate change: term changed from 1 to 2, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to f926f212b9ec47e1b9832c451b18793d (127.11.32.1). New cstate: current_term: 2 leader_uuid: "f926f212b9ec47e1b9832c451b18793d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:53.842768 21104 catalog_manager.cc:5697] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 1 to 2, leader changed from f926f212b9ec47e1b9832c451b18793d (127.11.32.1) to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:54.043702 21279 raft_consensus.cc:1275] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.044998 21600 consensus_queue.cc:1048] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.052604 21355 raft_consensus.cc:1275] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.054183 21600 consensus_queue.cc:1048] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.162932 21355 raft_consensus.cc:1275] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.164161 21600 consensus_queue.cc:1048] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.171267 21279 raft_consensus.cc:3060] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.181661 21279 raft_consensus.cc:1275] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.182931 21600 consensus_queue.cc:1048] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.190904 21355 raft_consensus.cc:1275] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.192436 21600 consensus_queue.cc:1048] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:54.207389 21279 raft_consensus.cc:1275] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.212745 21543 consensus_queue.cc:1048] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:54.279019 21279 raft_consensus.cc:1275] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.282454 21355 raft_consensus.cc:1275] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer f926f212b9ec47e1b9832c451b18793d: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.282228 21600 consensus_queue.cc:1048] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.284348 21543 consensus_queue.cc:1048] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.308363 21202 raft_consensus.cc:1275] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.310048 21548 consensus_queue.cc:1048] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.332381 21355 raft_consensus.cc:3060] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.344515 21279 raft_consensus.cc:3060] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:54.349859 21355 raft_consensus.cc:1275] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Refusing update from remote peer b38373e0b7a247bbac343689aae3d117: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.352057 21548 consensus_queue.cc:1048] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:54.356174 21279 raft_consensus.cc:1275] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.358093 21544 consensus_queue.cc:1048] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:27:54.369526 21202 raft_consensus.cc:1275] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:54.371423 21544 consensus_queue.cc:1048] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:56.357498 21103 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43082:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:27:56.388856 21103 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:43082:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:27:56.436698 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:56.509552 21639 tablet.cc:1724] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.529950 21636 tablet.cc:1724] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.568594 21649 tablet.cc:1724] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.651188 21651 log.cc:927] Time spent T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: Append to log took a long time: real 0.080s	user 0.002s	sys 0.000s
I20260709 12:27:56.653057 21639 tablet.cc:1724] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.653174 21319 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.2:46333, user_credentials={real_user=slave}} blocked reactor thread for 66515.6us
I20260709 12:27:56.653057 21636 tablet.cc:1724] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.716627 21381 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:01f74b081077470897c5ec0f629eae16)
I20260709 12:27:56.751960 21661 tablet.cc:1724] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.754047 21660 tablet.cc:1724] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.777570 21671 tablet.cc:1724] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:27:56.781095 21232 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:01f74b081077470897c5ec0f629eae16)
W20260709 12:27:56.782187 21232 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:01f74b081077470897c5ec0f629eae16)
W20260709 12:27:56.805371 21669 log.cc:927] Time spent T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:27:56.766271 21657 tablet.cc:1724] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.810213 21649 tablet.cc:1724] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.812819 21201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
mode: GRACEFUL
new_leader_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:45770
I20260709 12:27:56.813761 21201 raft_consensus.cc:606] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Received request to transfer leadership to TS a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:56.773351 21670 tablet.cc:1724] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.813789 21668 tablet.cc:1724] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.840555 21675 tablet.cc:1724] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.845326 21674 tablet.cc:1724] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.848014 21103 catalog_manager.cc:5789] TS f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465) does not have the latest schema for tablet b737db1f80f04146bce4c0e8357c28bc (table soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]). Expected version 1 got 0
I20260709 12:27:56.854858 21103 catalog_manager.cc:5789] TS f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465) does not have the latest schema for tablet 024de366ff8e435a8bf55e7e72886069 (table soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]). Expected version 1 got 0
I20260709 12:27:56.857435 21103 catalog_manager.cc:5789] TS f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465) does not have the latest schema for tablet c03f207f873e42278604136c4c88ed19 (table soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]). Expected version 1 got 0
I20260709 12:27:56.868386 21668 tablet.cc:1724] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.865984 21673 tablet.cc:1724] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.875572 21636 tablet.cc:1724] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.877949 21639 tablet.cc:1724] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.880832 21633 raft_consensus.cc:993] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: : Instructing follower a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:56.872865 21671 tablet.cc:1724] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.888178 21649 tablet.cc:1724] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.889859 21670 tablet.cc:1724] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.900254 21633 raft_consensus.cc:1081] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Signalling peer a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:56.906265 21355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:60198
I20260709 12:27:56.906904 21355 raft_consensus.cc:493] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:56.907253 21355 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.912194 21657 tablet.cc:1724] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.916558 21355 raft_consensus.cc:515] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:56.930076 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:56.930773 21200 raft_consensus.cc:3055] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:56.931180 21200 raft_consensus.cc:740] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:56.932101 21200 consensus_queue.cc:260] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:56.933389 21200 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.922894 21661 tablet.cc:1724] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.903402 21675 tablet.cc:1724] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.926281 21660 tablet.cc:1724] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.938979 21355 leader_election.cc:290] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 3 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:56.940183 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "024de366ff8e435a8bf55e7e72886069" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:56.948895 21280 raft_consensus.cc:3060] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:56.951085 21281 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:37532
I20260709 12:27:56.951789 21281 raft_consensus.cc:606] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Received request to transfer leadership to TS a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:56.953457 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:27:56.954090 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:56.957638 21280 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 3.
I20260709 12:27:56.961369 21319 leader_election.cc:304] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:56.962453 21642 raft_consensus.cc:2804] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:56.962932 21642 raft_consensus.cc:697] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 3 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:56.963852 21642 consensus_queue.cc:237] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:56.966717 21201 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9"
dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
mode: GRACEFUL
new_leader_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:45770
I20260709 12:27:56.967415 21201 raft_consensus.cc:606] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Received request to transfer leadership to TS a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:56.966259 21673 tablet.cc:1724] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.974099 21103 catalog_manager.cc:5789] TS b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333) does not have the latest schema for tablet e30a764565714f078aaae3c3ba5daa2c (table soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5]). Expected version 1 got 0
I20260709 12:27:56.975330 21100 catalog_manager.cc:5697] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 2 to 3, leader changed from f926f212b9ec47e1b9832c451b18793d (127.11.32.1) to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.977453 21280 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09"
dest_uuid: "b38373e0b7a247bbac343689aae3d117"
mode: GRACEFUL
new_leader_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:37532
I20260709 12:27:56.978061 21280 raft_consensus.cc:606] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Received request to transfer leadership to TS a4fbf9bb745740699ee8d98aa1349677
I20260709 12:27:56.978296 21200 raft_consensus.cc:2468] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 3.
I20260709 12:27:56.989056 21673 tablet.cc:1724] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:27:56.979523 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:56.997221 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:57.025655 21100 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0: soft_deleted_table [id=cb3afdb263e0431e8c3a0780d74151b5] alter complete (version 1)
I20260709 12:27:57.286532 21633 raft_consensus.cc:993] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: : Instructing follower a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:57.287165 21635 raft_consensus.cc:1081] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Signalling peer a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:57.288830 21355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:60198
I20260709 12:27:57.289296 21355 raft_consensus.cc:493] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.289634 21355 raft_consensus.cc:3060] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.294356 21355 raft_consensus.cc:515] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.295820 21355 leader_election.cc:290] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:57.296833 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:57.296725 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46f02bd366174de8a7df40635254cbf9" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:57.297508 21280 raft_consensus.cc:3060] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.297600 21200 raft_consensus.cc:3055] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:57.298005 21200 raft_consensus.cc:740] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f926f212b9ec47e1b9832c451b18793d, State: Running, Role: LEADER
I20260709 12:27:57.298911 21200 consensus_queue.cc:260] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.300268 21200 raft_consensus.cc:3060] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.304533 21280 raft_consensus.cc:2468] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:57.305929 21319 leader_election.cc:304] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:57.306720 21642 raft_consensus.cc:2804] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:57.307142 21642 raft_consensus.cc:697] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:57.307545 21200 raft_consensus.cc:2468] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:57.307988 21642 consensus_queue.cc:237] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.318980 21100 catalog_manager.cc:5697] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 1 to 2, leader changed from f926f212b9ec47e1b9832c451b18793d (127.11.32.1) to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.389812 21280 raft_consensus.cc:1275] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:57.391495 21642 consensus_queue.cc:1048] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:27:57.394976 21665 raft_consensus.cc:993] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: : Instructing follower a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:57.395560 21665 raft_consensus.cc:1081] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Signalling peer a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:57.397280 21355 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:27:57.397806 21355 raft_consensus.cc:493] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.398171 21355 raft_consensus.cc:3060] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.404271 21200 raft_consensus.cc:1275] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:27:57.405943 21606 consensus_queue.cc:1048] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:27:57.407052 21355 raft_consensus.cc:515] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.417176 21655 raft_consensus.cc:993] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: : Instructing follower a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:57.417771 21655 raft_consensus.cc:1081] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Signalling peer a4fbf9bb745740699ee8d98aa1349677 to start an election
I20260709 12:27:57.418905 21355 leader_election.cc:290] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:57.420495 21280 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:57.420418 21350 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09"
dest_uuid: "a4fbf9bb745740699ee8d98aa1349677"
 from {username='slave'} at 127.0.0.1:60206
I20260709 12:27:57.421135 21280 raft_consensus.cc:3055] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:57.421451 21350 raft_consensus.cc:493] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:57.421828 21350 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:57.421455 21280 raft_consensus.cc:740] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:57.424152 21201 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab4776663f314f97885cd8c3722e5457" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:57.424799 21201 raft_consensus.cc:3060] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.424392 21280 consensus_queue.cc:260] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.426761 21280 raft_consensus.cc:3060] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:57.429494 21350 raft_consensus.cc:515] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.432632 21281 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b38373e0b7a247bbac343689aae3d117"
I20260709 12:27:57.433199 21281 raft_consensus.cc:3055] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:27:57.433272 21350 leader_election.cc:290] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 3 election: Requested vote from peers f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465), b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333)
I20260709 12:27:57.433683 21281 raft_consensus.cc:740] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b38373e0b7a247bbac343689aae3d117, State: Running, Role: LEADER
I20260709 12:27:57.434048 21200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8bca91b2101f49f2bf353f7748081b09" candidate_uuid: "a4fbf9bb745740699ee8d98aa1349677" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f926f212b9ec47e1b9832c451b18793d"
I20260709 12:27:57.434548 21280 raft_consensus.cc:2468] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:57.434631 21200 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:57.434616 21281 consensus_queue.cc:260] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.435817 21319 leader_election.cc:304] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, b38373e0b7a247bbac343689aae3d117; no voters: 
I20260709 12:27:57.436761 21281 raft_consensus.cc:3060] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:27:57.436843 21686 raft_consensus.cc:2804] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:27:57.437469 21686 raft_consensus.cc:697] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:57.438448 21686 consensus_queue.cc:237] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.445436 21200 raft_consensus.cc:2468] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 3.
I20260709 12:27:57.446851 21320 leader_election.cc:304] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: a4fbf9bb745740699ee8d98aa1349677, f926f212b9ec47e1b9832c451b18793d; no voters: 
I20260709 12:27:57.433125 21201 raft_consensus.cc:2468] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 2.
I20260709 12:27:57.446491 21100 catalog_manager.cc:5697] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 1 to 2, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.448006 21281 raft_consensus.cc:2468] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a4fbf9bb745740699ee8d98aa1349677 in term 3.
I20260709 12:27:57.448884 21686 raft_consensus.cc:2804] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:27:57.449443 21686 raft_consensus.cc:697] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 3 LEADER]: Becoming Leader. State: Replica: a4fbf9bb745740699ee8d98aa1349677, State: Running, Role: LEADER
I20260709 12:27:57.450147 21686 consensus_queue.cc:237] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } }
I20260709 12:27:57.461761 21100 catalog_manager.cc:5697] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 reported cstate change: term changed from 2 to 3, leader changed from b38373e0b7a247bbac343689aae3d117 (127.11.32.2) to a4fbf9bb745740699ee8d98aa1349677 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "a4fbf9bb745740699ee8d98aa1349677" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a4fbf9bb745740699ee8d98aa1349677" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 41249 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.714289 21201 raft_consensus.cc:1275] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:57.715456 21686 consensus_queue.cc:1048] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:57.724032 21281 raft_consensus.cc:1275] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:27:57.725612 21642 consensus_queue.cc:1048] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:27:57.828722 21281 raft_consensus.cc:1275] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:57.829882 21642 consensus_queue.cc:1048] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.837770 21201 raft_consensus.cc:1275] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:27:57.839395 21642 consensus_queue.cc:1048] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.967180 21281 raft_consensus.cc:1275] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:57.968361 21642 consensus_queue.cc:1048] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b38373e0b7a247bbac343689aae3d117" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 46333 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.978021 21201 raft_consensus.cc:1275] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Refusing update from remote peer a4fbf9bb745740699ee8d98aa1349677: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:27:57.979477 21685 consensus_queue.cc:1048] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f926f212b9ec47e1b9832c451b18793d" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 33465 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:27:57.998231 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:58.003949 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:58.004400 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:58.009197 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:58.009661 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:59.010749 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:27:59.015775 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:27:59.016222 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:59.020752 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:27:59.021113 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:00.022117 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:00.026916 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:00.027315 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:00.033349 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:00.033816 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:01.034757 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:01.039605 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:01.040020 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:01.045596 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:01.046052 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:02.047052 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:02.051877 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:02.052243 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:02.057471 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:02.057936 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:03.059046 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:03.066604 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:03.067186 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:03.071911 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:03.072310 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:04.073312 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:04.078926 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:04.079301 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:04.083959 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:04.084293 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:05.085371 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:05.090651 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:05.091004 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:05.095431 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:05.095765 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:06.167644 11392 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:06.173147 11392 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:06.173623 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:06.178298 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:06.178653 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:28:06.883858 21135 debug-util.cc:398] Leaking SignalData structure 0x7b080002fa40 after lost signal to thread 11395
W20260709 12:28:06.884943 21135 debug-util.cc:398] Leaking SignalData structure 0x7b08000499a0 after lost signal to thread 21138
W20260709 12:28:06.885999 21135 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5da0 after lost signal to thread 21230
W20260709 12:28:06.886912 21135 debug-util.cc:398] Leaking SignalData structure 0x7b08002892a0 after lost signal to thread 21305
W20260709 12:28:06.887787 21135 debug-util.cc:398] Leaking SignalData structure 0x7b080024dee0 after lost signal to thread 21379
I20260709 12:28:07.244863 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
W20260709 12:28:07.248804 21246 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:28:07.259016 21246 consensus_peers.cc:597] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:07.290760 21320 consensus_peers.cc:597] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.304751 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:07.306757 11392 tablet_replica.cc:333] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.308030 11392 raft_consensus.cc:2243] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.309105 11392 raft_consensus.cc:2272] T e30a764565714f078aaae3c3ba5daa2c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.312915 11392 tablet_replica.cc:333] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.313982 11392 raft_consensus.cc:2243] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.314955 11392 raft_consensus.cc:2272] T 0f03559265d94a88be94541beb735744 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.318310 11392 tablet_replica.cc:333] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.319195 11392 raft_consensus.cc:2243] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.320297 11392 raft_consensus.cc:2272] T b737db1f80f04146bce4c0e8357c28bc P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.323272 11392 tablet_replica.cc:333] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.324026 11392 raft_consensus.cc:2243] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.324759 11392 raft_consensus.cc:2272] T 753446de8ea545d98cffa3b1471a56e3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.327862 11392 tablet_replica.cc:333] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.328711 11392 raft_consensus.cc:2243] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.329602 11392 raft_consensus.cc:2272] T 024de366ff8e435a8bf55e7e72886069 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.333287 11392 tablet_replica.cc:333] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.334308 11392 raft_consensus.cc:2243] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.335704 11392 raft_consensus.cc:2272] T c03f207f873e42278604136c4c88ed19 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:07.338850 21246 consensus_peers.cc:597] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.340008 11392 tablet_replica.cc:333] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.340816 11392 raft_consensus.cc:2243] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.341617 11392 raft_consensus.cc:2272] T ba006b16213840b382f280757bc7c01b P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.345662 11392 tablet_replica.cc:333] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.347115 11392 raft_consensus.cc:2243] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.348085 11392 raft_consensus.cc:2272] T 8bca91b2101f49f2bf353f7748081b09 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:07.348075 21246 consensus_peers.cc:597] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:07.350903 21320 consensus_peers.cc:597] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.352334 11392 tablet_replica.cc:333] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.353276 11392 raft_consensus.cc:2243] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.353941 11392 raft_consensus.cc:2272] T ab4776663f314f97885cd8c3722e5457 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.357816 11392 tablet_replica.cc:333] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.358932 11392 raft_consensus.cc:2243] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.360069 11392 raft_consensus.cc:2272] T 1d62cce48e1a41b3ba8a28556f3edfff P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:07.360353 21246 consensus_peers.cc:597] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.364131 11392 tablet_replica.cc:333] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.365213 11392 raft_consensus.cc:2243] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.365993 11392 raft_consensus.cc:2272] T 87e8e2587fb747e595f79bbb072d72ec P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:07.366410 21246 consensus_peers.cc:597] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.369563 11392 tablet_replica.cc:333] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.370388 11392 raft_consensus.cc:2243] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.371524 11392 raft_consensus.cc:2272] T 01f74b081077470897c5ec0f629eae16 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.374541 11392 tablet_replica.cc:333] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.375291 11392 raft_consensus.cc:2243] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.375976 11392 raft_consensus.cc:2272] T 46f02bd366174de8a7df40635254cbf9 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.378983 11392 tablet_replica.cc:333] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.379698 11392 raft_consensus.cc:2243] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.380998 11392 raft_consensus.cc:2272] T 333ac402b2f248179b8da1f7d28b2918 P f926f212b9ec47e1b9832c451b18793d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.384330 11392 tablet_replica.cc:333] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.385010 11392 raft_consensus.cc:2243] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.386353 11392 raft_consensus.cc:2272] T d06fddf2a255424fac4228a091089e22 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.390249 11392 tablet_replica.cc:333] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
W20260709 12:28:07.390841 21320 consensus_peers.cc:597] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.391140 11392 raft_consensus.cc:2243] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.391919 11392 raft_consensus.cc:2272] T e1c59c12421342bba31c83aa6816450c P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.395596 11392 tablet_replica.cc:333] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.396548 11392 raft_consensus.cc:2243] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.397316 11392 raft_consensus.cc:2272] T 475d307cccb94179bc03c20c30ff0fe3 P f926f212b9ec47e1b9832c451b18793d [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:07.397814 21320 consensus_peers.cc:597] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.400940 11392 tablet_replica.cc:333] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d: stopping tablet replica
I20260709 12:28:07.401736 11392 raft_consensus.cc:2243] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.402878 11392 raft_consensus.cc:2272] T 92d478d0bf794326bd62100b24feafa3 P f926f212b9ec47e1b9832c451b18793d [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.458659 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
I20260709 12:28:07.518265 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
W20260709 12:28:07.544613 21319 consensus_peers.cc:597] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 -> Peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Couldn't send request to peer b38373e0b7a247bbac343689aae3d117. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.565712 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:07.568567 11392 tablet_replica.cc:333] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.569864 11392 raft_consensus.cc:2243] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.570842 11392 raft_consensus.cc:2272] T 753446de8ea545d98cffa3b1471a56e3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.575147 11392 tablet_replica.cc:333] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.576376 11392 raft_consensus.cc:2243] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.577841 11392 raft_consensus.cc:2272] T e30a764565714f078aaae3c3ba5daa2c P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.581938 11392 tablet_replica.cc:333] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.582943 11392 raft_consensus.cc:2243] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.583710 11392 raft_consensus.cc:2272] T 01f74b081077470897c5ec0f629eae16 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.587270 11392 tablet_replica.cc:333] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.588222 11392 raft_consensus.cc:2243] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.588879 11392 raft_consensus.cc:2272] T 024de366ff8e435a8bf55e7e72886069 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.592870 11392 tablet_replica.cc:333] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.593853 11392 raft_consensus.cc:2243] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:07.593981 21319 consensus_peers.cc:597] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 -> Peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Couldn't send request to peer b38373e0b7a247bbac343689aae3d117. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.595139 11392 raft_consensus.cc:2272] T 0f03559265d94a88be94541beb735744 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.598765 11392 tablet_replica.cc:333] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.599728 11392 raft_consensus.cc:2243] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.600548 11392 raft_consensus.cc:2272] T c03f207f873e42278604136c4c88ed19 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.604260 11392 tablet_replica.cc:333] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.605355 11392 raft_consensus.cc:2243] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.606244 11392 raft_consensus.cc:2272] T b737db1f80f04146bce4c0e8357c28bc P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.609938 11392 tablet_replica.cc:333] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.610632 11392 raft_consensus.cc:2243] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.611256 11392 raft_consensus.cc:2272] T 46f02bd366174de8a7df40635254cbf9 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.613888 11392 tablet_replica.cc:333] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.614517 11392 raft_consensus.cc:2243] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.615005 11392 raft_consensus.cc:2272] T 333ac402b2f248179b8da1f7d28b2918 P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.617676 11392 tablet_replica.cc:333] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.618350 11392 raft_consensus.cc:2243] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.618986 11392 raft_consensus.cc:2272] T ab4776663f314f97885cd8c3722e5457 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.622251 11392 tablet_replica.cc:333] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.622879 11392 raft_consensus.cc:2243] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.623833 11392 raft_consensus.cc:2272] T 87e8e2587fb747e595f79bbb072d72ec P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.626304 11392 tablet_replica.cc:333] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.626827 11392 raft_consensus.cc:2243] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.627660 11392 raft_consensus.cc:2272] T 1d62cce48e1a41b3ba8a28556f3edfff P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.630218 11392 tablet_replica.cc:333] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.630781 11392 raft_consensus.cc:2243] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.631256 11392 raft_consensus.cc:2272] T d06fddf2a255424fac4228a091089e22 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.633859 11392 tablet_replica.cc:333] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.634409 11392 raft_consensus.cc:2243] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.635329 11392 raft_consensus.cc:2272] T e1c59c12421342bba31c83aa6816450c P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.637639 11392 tablet_replica.cc:333] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.638141 11392 raft_consensus.cc:2243] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.638648 11392 raft_consensus.cc:2272] T 475d307cccb94179bc03c20c30ff0fe3 P b38373e0b7a247bbac343689aae3d117 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.640992 11392 tablet_replica.cc:333] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.641577 11392 raft_consensus.cc:2243] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.642117 11392 raft_consensus.cc:2272] T 92d478d0bf794326bd62100b24feafa3 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.644382 11392 tablet_replica.cc:333] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.644850 11392 raft_consensus.cc:2243] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.645850 11392 raft_consensus.cc:2272] T ba006b16213840b382f280757bc7c01b P b38373e0b7a247bbac343689aae3d117 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.648161 11392 tablet_replica.cc:333] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117: stopping tablet replica
I20260709 12:28:07.648648 11392 raft_consensus.cc:2243] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.649156 11392 raft_consensus.cc:2272] T 8bca91b2101f49f2bf353f7748081b09 P b38373e0b7a247bbac343689aae3d117 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:07.666602 21320 consensus_peers.cc:597] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:33465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.701365 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
W20260709 12:28:07.712577 21320 consensus_peers.cc:597] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 -> Peer f926f212b9ec47e1b9832c451b18793d (127.11.32.1:33465): Couldn't send request to peer f926f212b9ec47e1b9832c451b18793d. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:33465: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.764174 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
W20260709 12:28:07.798908 21319 consensus_peers.cc:597] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 -> Peer b38373e0b7a247bbac343689aae3d117 (127.11.32.2:46333): Couldn't send request to peer b38373e0b7a247bbac343689aae3d117. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:46333: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.802799 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:07.805172 11392 tablet_replica.cc:333] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.806466 11392 raft_consensus.cc:2243] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.807363 11392 raft_consensus.cc:2272] T e30a764565714f078aaae3c3ba5daa2c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.811537 11392 tablet_replica.cc:333] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.812647 11392 raft_consensus.cc:2243] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.813947 11392 raft_consensus.cc:2272] T 753446de8ea545d98cffa3b1471a56e3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.817173 11392 tablet_replica.cc:333] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.818176 11392 raft_consensus.cc:2243] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.818917 11392 raft_consensus.cc:2272] T b737db1f80f04146bce4c0e8357c28bc P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.822279 11392 tablet_replica.cc:333] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.823171 11392 raft_consensus.cc:2243] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.823889 11392 raft_consensus.cc:2272] T c03f207f873e42278604136c4c88ed19 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.827077 11392 tablet_replica.cc:333] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.828006 11392 raft_consensus.cc:2243] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.828712 11392 raft_consensus.cc:2272] T 0f03559265d94a88be94541beb735744 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.831780 11392 tablet_replica.cc:333] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.832660 11392 raft_consensus.cc:2243] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.833871 11392 raft_consensus.cc:2272] T 024de366ff8e435a8bf55e7e72886069 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.837047 11392 tablet_replica.cc:333] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.837852 11392 raft_consensus.cc:2243] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.838932 11392 raft_consensus.cc:2272] T 8bca91b2101f49f2bf353f7748081b09 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.841981 11392 tablet_replica.cc:333] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.842797 11392 raft_consensus.cc:2243] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.843482 11392 raft_consensus.cc:2272] T ba006b16213840b382f280757bc7c01b P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.846540 11392 tablet_replica.cc:333] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.847290 11392 raft_consensus.cc:2243] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.848423 11392 raft_consensus.cc:2272] T ab4776663f314f97885cd8c3722e5457 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.851641 11392 tablet_replica.cc:333] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.852433 11392 raft_consensus.cc:2243] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.853052 11392 raft_consensus.cc:2272] T 1d62cce48e1a41b3ba8a28556f3edfff P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.856259 11392 tablet_replica.cc:333] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.857025 11392 raft_consensus.cc:2243] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.857786 11392 raft_consensus.cc:2272] T 87e8e2587fb747e595f79bbb072d72ec P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.861094 11392 tablet_replica.cc:333] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.861999 11392 raft_consensus.cc:2243] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.863237 11392 raft_consensus.cc:2272] T 46f02bd366174de8a7df40635254cbf9 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.866216 11392 tablet_replica.cc:333] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.867025 11392 raft_consensus.cc:2243] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.867666 11392 raft_consensus.cc:2272] T 333ac402b2f248179b8da1f7d28b2918 P a4fbf9bb745740699ee8d98aa1349677 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.870913 11392 tablet_replica.cc:333] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.871731 11392 raft_consensus.cc:2243] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.872354 11392 raft_consensus.cc:2272] T e1c59c12421342bba31c83aa6816450c P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.875272 11392 tablet_replica.cc:333] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.875976 11392 raft_consensus.cc:2243] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.876570 11392 raft_consensus.cc:2272] T d06fddf2a255424fac4228a091089e22 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.879488 11392 tablet_replica.cc:333] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.880249 11392 raft_consensus.cc:2243] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.880934 11392 raft_consensus.cc:2272] T 01f74b081077470897c5ec0f629eae16 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.884078 11392 tablet_replica.cc:333] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.884788 11392 raft_consensus.cc:2243] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:07.885483 11392 raft_consensus.cc:2272] T 92d478d0bf794326bd62100b24feafa3 P a4fbf9bb745740699ee8d98aa1349677 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.888288 11392 tablet_replica.cc:333] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677: stopping tablet replica
I20260709 12:28:07.888808 11392 raft_consensus.cc:2243] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:07.889782 11392 raft_consensus.cc:2272] T 475d307cccb94179bc03c20c30ff0fe3 P a4fbf9bb745740699ee8d98aa1349677 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:07.943444 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
I20260709 12:28:08.001942 11392 master.cc:562] Master@127.11.32.62:41291 shutting down...
I20260709 12:28:08.035234 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:08.036041 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:08.036495 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3cadc72b4a0a4e918ba3f631a23133d0: stopping tablet replica
W20260709 12:28:09.056052 11392 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 21135)
I20260709 12:28:09.611526 11392 master.cc:584] Master@127.11.32.62:41291 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (23635 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:28:09.666751 11392 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.11.32.62:36379
I20260709 12:28:09.667824 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:09.673856 21723 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:09.673995 21722 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:09.674378 21725 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:09.675637 11392 server_base.cc:1061] running on GCE node
I20260709 12:28:09.676555 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:09.676728 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:09.676837 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600089676826 us; error 0 us; skew 500 ppm
I20260709 12:28:09.677278 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:09.679646 11392 webserver.cc:533] Webserver started at http://127.11.32.62:40977/ using document root <none> and password file <none>
I20260709 12:28:09.680073 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:09.680218 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:09.680423 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:09.681722 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/master-0-root/instance:
uuid: "5af41c5de0db473da5c81aa52c26bddc"
format_stamp: "Formatted at 2026-07-09 12:28:09 on dist-test-slave-sckv"
I20260709 12:28:09.685930 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:28:09.689049 21730 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:09.689862 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:28:09.690160 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/master-0-root
uuid: "5af41c5de0db473da5c81aa52c26bddc"
format_stamp: "Formatted at 2026-07-09 12:28:09 on dist-test-slave-sckv"
I20260709 12:28:09.690400 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:09.708727 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:09.710019 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:09.747422 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.62:36379
I20260709 12:28:09.747542 21781 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.62:36379 every 8 connection(s)
I20260709 12:28:09.751211 21782 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:09.762322 21782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc: Bootstrap starting.
I20260709 12:28:09.767418 21782 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:09.771482 21782 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc: No bootstrap required, opened a new log
I20260709 12:28:09.773708 21782 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af41c5de0db473da5c81aa52c26bddc" member_type: VOTER }
I20260709 12:28:09.774123 21782 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:09.774328 21782 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5af41c5de0db473da5c81aa52c26bddc, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.774892 21782 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af41c5de0db473da5c81aa52c26bddc" member_type: VOTER }
I20260709 12:28:09.775319 21782 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:09.775508 21782 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:09.775731 21782 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:09.780408 21782 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af41c5de0db473da5c81aa52c26bddc" member_type: VOTER }
I20260709 12:28:09.780882 21782 leader_election.cc:304] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5af41c5de0db473da5c81aa52c26bddc; no voters: 
I20260709 12:28:09.781967 21782 leader_election.cc:290] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:09.782303 21785 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:09.783711 21785 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 1 LEADER]: Becoming Leader. State: Replica: 5af41c5de0db473da5c81aa52c26bddc, State: Running, Role: LEADER
I20260709 12:28:09.784332 21785 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af41c5de0db473da5c81aa52c26bddc" member_type: VOTER }
I20260709 12:28:09.784847 21782 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:09.789060 21786 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5af41c5de0db473da5c81aa52c26bddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af41c5de0db473da5c81aa52c26bddc" member_type: VOTER } }
I20260709 12:28:09.789367 21787 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5af41c5de0db473da5c81aa52c26bddc. Latest consensus state: current_term: 1 leader_uuid: "5af41c5de0db473da5c81aa52c26bddc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5af41c5de0db473da5c81aa52c26bddc" member_type: VOTER } }
I20260709 12:28:09.789965 21786 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:09.790277 21787 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:09.797132 21792 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:09.801896 21792 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:09.802910 11392 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:09.810475 21792 catalog_manager.cc:1383] Generated new cluster ID: 801bd13b16e24e3180d063629337f423
I20260709 12:28:09.810779 21792 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:09.835621 21792 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:09.836949 21792 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:09.852429 21792 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc: Generated new TSK 0
I20260709 12:28:09.853036 21792 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:09.869495 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:09.875675 21803 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:09.877005 21804 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:09.880123 21806 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:09.881157 11392 server_base.cc:1061] running on GCE node
I20260709 12:28:09.882625 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:09.882938 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:09.883152 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600089883131 us; error 0 us; skew 500 ppm
I20260709 12:28:09.883898 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:09.886099 11392 webserver.cc:533] Webserver started at http://127.11.32.1:34553/ using document root <none> and password file <none>
I20260709 12:28:09.886574 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:09.886765 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:09.887009 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:09.888017 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-0-root/instance:
uuid: "0bcb11d332554f9eafea151e33814cbf"
format_stamp: "Formatted at 2026-07-09 12:28:09 on dist-test-slave-sckv"
I20260709 12:28:09.892338 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:28:09.895663 21811 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:09.896523 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:28:09.896809 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-0-root
uuid: "0bcb11d332554f9eafea151e33814cbf"
format_stamp: "Formatted at 2026-07-09 12:28:09 on dist-test-slave-sckv"
I20260709 12:28:09.897092 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:09.924564 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:09.925835 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:09.927310 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:09.929514 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:09.929729 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:09.929973 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:09.930166 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:09.971206 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.1:44129
I20260709 12:28:09.971325 21873 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.1:44129 every 8 connection(s)
I20260709 12:28:09.976260 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:09.983064 21878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:09.984069 21879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:09.987368 21881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:09.989262 11392 server_base.cc:1061] running on GCE node
I20260709 12:28:09.990823 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:09.990942 21874 heartbeater.cc:344] Connected to a master server at 127.11.32.62:36379
W20260709 12:28:09.991087 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:09.991420 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600089991390 us; error 0 us; skew 500 ppm
I20260709 12:28:09.991448 21874 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:09.992096 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:09.992455 21874 heartbeater.cc:507] Master 127.11.32.62:36379 requested a full tablet report, sending...
I20260709 12:28:09.994879 11392 webserver.cc:533] Webserver started at http://127.11.32.2:46285/ using document root <none> and password file <none>
I20260709 12:28:09.995092 21747 ts_manager.cc:194] Registered new tserver with Master: 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129)
I20260709 12:28:09.995445 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:09.995774 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:09.996086 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:09.997251 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-1-root/instance:
uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
format_stamp: "Formatted at 2026-07-09 12:28:09 on dist-test-slave-sckv"
I20260709 12:28:09.997299 21747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36558
I20260709 12:28:10.002432 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:10.005877 21886 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.006697 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:28:10.006989 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-1-root
uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
format_stamp: "Formatted at 2026-07-09 12:28:09 on dist-test-slave-sckv"
I20260709 12:28:10.007287 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:10.031945 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:10.033139 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:10.034660 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:10.036939 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:10.037170 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.037436 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:10.037617 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.077171 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.2:44643
I20260709 12:28:10.077306 21948 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.2:44643 every 8 connection(s)
I20260709 12:28:10.082113 11392 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:10.089478 21952 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:10.091490 21953 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:10.094421 11392 server_base.cc:1061] running on GCE node
I20260709 12:28:10.095543 21949 heartbeater.cc:344] Connected to a master server at 127.11.32.62:36379
I20260709 12:28:10.096004 21949 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:10.096750 21949 heartbeater.cc:507] Master 127.11.32.62:36379 requested a full tablet report, sending...
W20260709 12:28:10.097803 21955 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:10.098901 11392 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:10.098907 21747 ts_manager.cc:194] Registered new tserver with Master: a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
W20260709 12:28:10.099184 11392 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:10.099519 11392 hybrid_clock.cc:648] HybridClock initialized: now 1783600090099490 us; error 0 us; skew 500 ppm
I20260709 12:28:10.100140 11392 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:10.100633 21747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36564
I20260709 12:28:10.102860 11392 webserver.cc:533] Webserver started at http://127.11.32.3:41893/ using document root <none> and password file <none>
I20260709 12:28:10.103507 11392 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:10.103672 11392 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:10.103875 11392 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:10.104941 11392 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-2-root/instance:
uuid: "391c5f190db448bd981ce1e56cc044f1"
format_stamp: "Formatted at 2026-07-09 12:28:10 on dist-test-slave-sckv"
I20260709 12:28:10.109338 11392 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:28:10.112439 21960 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.113170 11392 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:10.113511 11392 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-2-root
uuid: "391c5f190db448bd981ce1e56cc044f1"
format_stamp: "Formatted at 2026-07-09 12:28:10 on dist-test-slave-sckv"
I20260709 12:28:10.113801 11392 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskBsdEHZ/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599746451920-11392-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:10.127931 11392 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:10.129091 11392 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:10.130584 11392 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:10.132696 11392 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:10.132917 11392 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.133178 11392 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:10.133368 11392 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:10.172848 11392 rpc_server.cc:307] RPC server started. Bound to: 127.11.32.3:43817
I20260709 12:28:10.172952 22022 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.11.32.3:43817 every 8 connection(s)
I20260709 12:28:10.186425 22023 heartbeater.cc:344] Connected to a master server at 127.11.32.62:36379
I20260709 12:28:10.186934 22023 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:10.187688 22023 heartbeater.cc:507] Master 127.11.32.62:36379 requested a full tablet report, sending...
I20260709 12:28:10.189746 21747 ts_manager.cc:194] Registered new tserver with Master: 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.190528 11392 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014392067s
I20260709 12:28:10.191097 21747 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:36570
I20260709 12:28:10.215453 21747 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36584:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:10.218384 21747 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:10.296489 21914 tablet_service.cc:1511] Processing CreateTablet for tablet ce3ca40bfb7d44a28290f87cdf749fdf (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:10.298007 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3ca40bfb7d44a28290f87cdf749fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.297658 21911 tablet_service.cc:1511] Processing CreateTablet for tablet f712fbaaa60341e289c89879c4a0aebe (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:10.299072 21911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f712fbaaa60341e289c89879c4a0aebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.299436 21988 tablet_service.cc:1511] Processing CreateTablet for tablet ce3ca40bfb7d44a28290f87cdf749fdf (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:10.300161 21913 tablet_service.cc:1511] Processing CreateTablet for tablet f34adaccdb2540ac81183b33de02f27a (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:10.300776 21988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3ca40bfb7d44a28290f87cdf749fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.302626 21912 tablet_service.cc:1511] Processing CreateTablet for tablet ba643b47e920428ca786ced660a6a5d5 (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:10.304852 21987 tablet_service.cc:1511] Processing CreateTablet for tablet f34adaccdb2540ac81183b33de02f27a (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:10.306409 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34adaccdb2540ac81183b33de02f27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.309122 21986 tablet_service.cc:1511] Processing CreateTablet for tablet ba643b47e920428ca786ced660a6a5d5 (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:10.310439 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba643b47e920428ca786ced660a6a5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.316483 21984 tablet_service.cc:1511] Processing CreateTablet for tablet 29eefb0340e843319123ba8f60a9cfd5 (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:10.317919 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29eefb0340e843319123ba8f60a9cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.317986 21983 tablet_service.cc:1511] Processing CreateTablet for tablet 20c9d57544fa4577989a8f7969fc6f6b (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:10.319327 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c9d57544fa4577989a8f7969fc6f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.322285 21839 tablet_service.cc:1511] Processing CreateTablet for tablet ce3ca40bfb7d44a28290f87cdf749fdf (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:10.322623 21982 tablet_service.cc:1511] Processing CreateTablet for tablet 259a2c4182f6430abe26383bb59ab3ba (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:10.323685 21839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ce3ca40bfb7d44a28290f87cdf749fdf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.324054 21982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259a2c4182f6430abe26383bb59ab3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.323799 21833 tablet_service.cc:1511] Processing CreateTablet for tablet 259a2c4182f6430abe26383bb59ab3ba (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:10.325119 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259a2c4182f6430abe26383bb59ab3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.326524 21910 tablet_service.cc:1511] Processing CreateTablet for tablet 29eefb0340e843319123ba8f60a9cfd5 (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:10.327230 21981 tablet_service.cc:1511] Processing CreateTablet for tablet b6e2c7ac4a2f42e5ae0d1e48a2c65add (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:10.328536 21981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e2c7ac4a2f42e5ae0d1e48a2c65add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.328456 21832 tablet_service.cc:1511] Processing CreateTablet for tablet b6e2c7ac4a2f42e5ae0d1e48a2c65add (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:10.328699 21837 tablet_service.cc:1511] Processing CreateTablet for tablet ba643b47e920428ca786ced660a6a5d5 (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:10.330935 21835 tablet_service.cc:1511] Processing CreateTablet for tablet 29eefb0340e843319123ba8f60a9cfd5 (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:10.331275 21908 tablet_service.cc:1511] Processing CreateTablet for tablet 259a2c4182f6430abe26383bb59ab3ba (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:10.333158 21836 tablet_service.cc:1511] Processing CreateTablet for tablet f712fbaaa60341e289c89879c4a0aebe (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:10.333521 21980 tablet_service.cc:1511] Processing CreateTablet for tablet a653a791ef9f43329be55e94cfa5e4bc (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:10.334764 21980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a653a791ef9f43329be55e94cfa5e4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.335357 21909 tablet_service.cc:1511] Processing CreateTablet for tablet 20c9d57544fa4577989a8f7969fc6f6b (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:10.337455 21838 tablet_service.cc:1511] Processing CreateTablet for tablet f34adaccdb2540ac81183b33de02f27a (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:10.339781 21834 tablet_service.cc:1511] Processing CreateTablet for tablet 20c9d57544fa4577989a8f7969fc6f6b (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:10.340353 21832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e2c7ac4a2f42e5ae0d1e48a2c65add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.341076 21834 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c9d57544fa4577989a8f7969fc6f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.313912 21985 tablet_service.cc:1511] Processing CreateTablet for tablet f712fbaaa60341e289c89879c4a0aebe (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:10.342686 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f712fbaaa60341e289c89879c4a0aebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.347935 21831 tablet_service.cc:1511] Processing CreateTablet for tablet a653a791ef9f43329be55e94cfa5e4bc (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:10.349252 21837 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba643b47e920428ca786ced660a6a5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.350621 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34adaccdb2540ac81183b33de02f27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.351858 21835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29eefb0340e843319123ba8f60a9cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.351997 21907 tablet_service.cc:1511] Processing CreateTablet for tablet b6e2c7ac4a2f42e5ae0d1e48a2c65add (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:10.353246 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f712fbaaa60341e289c89879c4a0aebe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.353567 22038 tablet_bootstrap.cc:492] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.354063 21913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f34adaccdb2540ac81183b33de02f27a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.354466 21906 tablet_service.cc:1511] Processing CreateTablet for tablet a653a791ef9f43329be55e94cfa5e4bc (DEFAULT_TABLE table=test-workload [id=e0bc271fec394e8ba416f30e8673a479]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:10.355707 21906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a653a791ef9f43329be55e94cfa5e4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.357549 21909 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 20c9d57544fa4577989a8f7969fc6f6b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.360594 22038 tablet_bootstrap.cc:654] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.361801 21907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b6e2c7ac4a2f42e5ae0d1e48a2c65add. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.362517 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 29eefb0340e843319123ba8f60a9cfd5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.363152 21908 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 259a2c4182f6430abe26383bb59ab3ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.363795 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba643b47e920428ca786ced660a6a5d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.373783 21831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a653a791ef9f43329be55e94cfa5e4bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:10.485621 22038 tablet_bootstrap.cc:492] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.486220 22038 ts_tablet_manager.cc:1403] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.133s	user 0.049s	sys 0.053s
I20260709 12:28:10.497797 22040 tablet_bootstrap.cc:492] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:10.512058 22038 raft_consensus.cc:359] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.513844 22038 raft_consensus.cc:385] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.514205 22038 raft_consensus.cc:740] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.514958 22038 consensus_queue.cc:260] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.519620 22041 tablet_bootstrap.cc:492] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.537961 22041 tablet_bootstrap.cc:654] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.540043 22040 tablet_bootstrap.cc:654] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.546722 22023 heartbeater.cc:499] Master 127.11.32.62:36379 was elected leader, sending a full tablet report...
I20260709 12:28:10.547238 22038 ts_tablet_manager.cc:1434] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.057s	user 0.018s	sys 0.017s
I20260709 12:28:10.548254 22038 tablet_bootstrap.cc:492] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.556435 22038 tablet_bootstrap.cc:654] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.559823 22041 tablet_bootstrap.cc:492] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.560536 22041 ts_tablet_manager.cc:1403] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.008s
I20260709 12:28:10.562485 22040 tablet_bootstrap.cc:492] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:10.563176 22040 ts_tablet_manager.cc:1403] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.003s
I20260709 12:28:10.564455 22041 raft_consensus.cc:359] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.565351 22041 raft_consensus.cc:385] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.565714 22041 raft_consensus.cc:740] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.566561 22041 consensus_queue.cc:260] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.566789 22040 raft_consensus.cc:359] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.567721 22040 raft_consensus.cc:385] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.568235 22040 raft_consensus.cc:740] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.569569 22040 consensus_queue.cc:260] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.583391 21874 heartbeater.cc:499] Master 127.11.32.62:36379 was elected leader, sending a full tablet report...
I20260709 12:28:10.584210 22041 ts_tablet_manager.cc:1434] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.013s
I20260709 12:28:10.584407 21949 heartbeater.cc:499] Master 127.11.32.62:36379 was elected leader, sending a full tablet report...
I20260709 12:28:10.584650 22038 tablet_bootstrap.cc:492] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.585130 22038 ts_tablet_manager.cc:1403] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.037s	user 0.019s	sys 0.014s
I20260709 12:28:10.585536 22041 tablet_bootstrap.cc:492] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.588191 22038 raft_consensus.cc:359] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.588922 22038 raft_consensus.cc:385] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.589212 22038 raft_consensus.cc:740] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.589638 22040 ts_tablet_manager.cc:1434] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.026s	user 0.010s	sys 0.010s
I20260709 12:28:10.590111 22038 consensus_queue.cc:260] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.590930 22040 tablet_bootstrap.cc:492] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:10.592476 22038 ts_tablet_manager.cc:1434] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:10.592595 22041 tablet_bootstrap.cc:654] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.596279 22038 tablet_bootstrap.cc:492] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.598290 22040 tablet_bootstrap.cc:654] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.604003 22038 tablet_bootstrap.cc:654] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.612380 22040 tablet_bootstrap.cc:492] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:10.613148 22040 ts_tablet_manager.cc:1403] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.004s
I20260709 12:28:10.617391 22040 raft_consensus.cc:359] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.618464 22040 raft_consensus.cc:385] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.618904 22040 raft_consensus.cc:740] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.620054 22040 consensus_queue.cc:260] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.623675 22038 tablet_bootstrap.cc:492] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.623905 22040 ts_tablet_manager.cc:1434] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 12:28:10.624246 22038 ts_tablet_manager.cc:1403] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.028s	user 0.020s	sys 0.004s
I20260709 12:28:10.625074 22040 tablet_bootstrap.cc:492] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:10.627303 22038 raft_consensus.cc:359] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.628014 22038 raft_consensus.cc:385] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.628300 22038 raft_consensus.cc:740] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.629192 22038 consensus_queue.cc:260] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.632284 22040 tablet_bootstrap.cc:654] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.635607 22038 ts_tablet_manager.cc:1434] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:10.637005 22038 tablet_bootstrap.cc:492] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.645288 22038 tablet_bootstrap.cc:654] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.648440 22041 tablet_bootstrap.cc:492] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.648957 22041 ts_tablet_manager.cc:1403] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.064s	user 0.023s	sys 0.038s
I20260709 12:28:10.650550 22047 raft_consensus.cc:493] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.651247 22047 raft_consensus.cc:515] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.651870 22041 raft_consensus.cc:359] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.652683 22041 raft_consensus.cc:385] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.652956 22041 raft_consensus.cc:740] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.653839 22041 consensus_queue.cc:260] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.656129 22041 ts_tablet_manager.cc:1434] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:10.657064 22041 tablet_bootstrap.cc:492] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.663534 22041 tablet_bootstrap.cc:654] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.667531 22042 raft_consensus.cc:493] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.667716 22047 leader_election.cc:290] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.668179 22042 raft_consensus.cc:515] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.674823 22042 leader_election.cc:290] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:10.675120 22041 tablet_bootstrap.cc:492] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
W20260709 12:28:10.677055 22024 tablet.cc:2406] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:10.677201 22041 ts_tablet_manager.cc:1403] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.005s
I20260709 12:28:10.680536 22041 raft_consensus.cc:359] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.681553 22041 raft_consensus.cc:385] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.681948 22041 raft_consensus.cc:740] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.683063 22041 consensus_queue.cc:260] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.686189 22041 ts_tablet_manager.cc:1434] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 12:28:10.687585 22041 tablet_bootstrap.cc:492] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.690966 22040 tablet_bootstrap.cc:492] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:10.694255 22041 tablet_bootstrap.cc:654] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.698086 22040 ts_tablet_manager.cc:1403] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.073s	user 0.017s	sys 0.011s
I20260709 12:28:10.697971 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
W20260709 12:28:10.700189 21964 leader_election.cc:343] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.702347 22038 tablet_bootstrap.cc:492] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.702905 22038 ts_tablet_manager.cc:1403] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.066s	user 0.035s	sys 0.009s
I20260709 12:28:10.709625 22038 raft_consensus.cc:359] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.708948 22040 raft_consensus.cc:359] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.710994 22041 tablet_bootstrap.cc:492] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.711444 22040 raft_consensus.cc:385] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.713519 22040 raft_consensus.cc:740] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.713814 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:10.710793 22038 raft_consensus.cc:385] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.714872 22038 raft_consensus.cc:740] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.711685 22041 ts_tablet_manager.cc:1403] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.009s
I20260709 12:28:10.714490 22040 consensus_queue.cc:260] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
W20260709 12:28:10.715355 21964 leader_election.cc:343] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.715868 21964 leader_election.cc:304] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1; no voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:10.716986 22040 ts_tablet_manager.cc:1434] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:28:10.718032 22040 tablet_bootstrap.cc:492] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:10.717940 22041 raft_consensus.cc:359] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.718024 22038 consensus_queue.cc:260] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.718556 22042 raft_consensus.cc:2749] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.718822 22041 raft_consensus.cc:385] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.719182 22041 raft_consensus.cc:740] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.720098 22041 consensus_queue.cc:260] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.723069 22041 ts_tablet_manager.cc:1434] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:28:10.724359 22041 tablet_bootstrap.cc:492] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.727609 22046 raft_consensus.cc:493] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.728195 22046 raft_consensus.cc:515] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.730877 22041 tablet_bootstrap.cc:654] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.738955 22046 leader_election.cc:290] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.747614 22040 tablet_bootstrap.cc:654] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.751765 22046 raft_consensus.cc:493] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.752540 22046 raft_consensus.cc:515] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.755327 22046 leader_election.cc:290] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.756897 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:10.758162 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
W20260709 12:28:10.758426 21890 leader_election.cc:343] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.759239 22038 ts_tablet_manager.cc:1434] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.056s	user 0.011s	sys 0.006s
I20260709 12:28:10.759444 22040 tablet_bootstrap.cc:492] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:10.759972 22040 ts_tablet_manager.cc:1403] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.003s
I20260709 12:28:10.760710 22041 tablet_bootstrap.cc:492] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.761737 22038 tablet_bootstrap.cc:492] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.763013 22040 raft_consensus.cc:359] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.763751 22040 raft_consensus.cc:385] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.763060 22041 ts_tablet_manager.cc:1403] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.016s
I20260709 12:28:10.764079 22040 raft_consensus.cc:740] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
W20260709 12:28:10.765165 21887 leader_election.cc:343] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.765679 21887 leader_election.cc:304] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a950f168eb4846bcacf3fd8ab51e88; no voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:10.766793 22047 raft_consensus.cc:2749] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.768385 22038 tablet_bootstrap.cc:654] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.770216 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba643b47e920428ca786ced660a6a5d5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.769973 22041 raft_consensus.cc:359] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.770637 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.770938 21998 raft_consensus.cc:2468] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:10.771000 22041 raft_consensus.cc:385] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.771550 22041 raft_consensus.cc:740] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.772369 22041 consensus_queue.cc:260] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
W20260709 12:28:10.772236 21812 leader_election.cc:343] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.774106 21812 leader_election.cc:304] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:10.775106 22041 ts_tablet_manager.cc:1434] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:10.775393 22046 raft_consensus.cc:2804] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.775976 22046 raft_consensus.cc:493] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.776409 22046 raft_consensus.cc:3060] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.772549 22040 consensus_queue.cc:260] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.781960 22040 ts_tablet_manager.cc:1434] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:28:10.785009 22046 raft_consensus.cc:515] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.776469 22041 tablet_bootstrap.cc:492] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.790446 22040 tablet_bootstrap.cc:492] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:10.790989 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:10.790300 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba643b47e920428ca786ced660a6a5d5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:10.789235 22038 tablet_bootstrap.cc:492] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.792565 22038 ts_tablet_manager.cc:1403] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.008s
I20260709 12:28:10.792910 22066 raft_consensus.cc:493] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.793422 22066 raft_consensus.cc:515] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.793841 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba643b47e920428ca786ced660a6a5d5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
W20260709 12:28:10.795154 21815 leader_election.cc:343] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.795650 21815 leader_election.cc:304] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf; no voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:10.796764 22041 tablet_bootstrap.cc:654] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:10.796903 21795 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:10.798326 22040 tablet_bootstrap.cc:654] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.798980 22066 leader_election.cc:290] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.798372 22038 raft_consensus.cc:359] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.800356 22038 raft_consensus.cc:385] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.800686 22038 raft_consensus.cc:740] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.801527 22038 consensus_queue.cc:260] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.799609 22066 raft_consensus.cc:2749] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.799557 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34adaccdb2540ac81183b33de02f27a" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.802996 21998 raft_consensus.cc:2468] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:10.804646 21812 leader_election.cc:304] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:10.806140 22066 raft_consensus.cc:2804] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.806583 22066 raft_consensus.cc:493] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.807013 22066 raft_consensus.cc:3060] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.814894 22046 leader_election.cc:290] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.816650 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba643b47e920428ca786ced660a6a5d5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:10.817499 21998 raft_consensus.cc:3060] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:10.820335 21815 leader_election.cc:343] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:10.821668 21815 leader_election.cc:343] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.823604 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34adaccdb2540ac81183b33de02f27a" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
W20260709 12:28:10.825560 21815 leader_election.cc:343] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.829249 22041 tablet_bootstrap.cc:492] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.829972 22041 ts_tablet_manager.cc:1403] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.054s	user 0.013s	sys 0.023s
I20260709 12:28:10.829665 21998 raft_consensus.cc:2468] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:10.832482 21812 leader_election.cc:304] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:10.833376 22038 ts_tablet_manager.cc:1434] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.002s
I20260709 12:28:10.833045 22041 raft_consensus.cc:359] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.833851 22041 raft_consensus.cc:385] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.834147 22041 raft_consensus.cc:740] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.834177 22067 raft_consensus.cc:2804] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.834908 22067 raft_consensus.cc:697] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:10.834980 22041 consensus_queue.cc:260] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.836099 22067 consensus_queue.cc:237] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.841356 22038 tablet_bootstrap.cc:492] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.850421 22066 raft_consensus.cc:515] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.854542 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34adaccdb2540ac81183b33de02f27a" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:10.854869 22041 ts_tablet_manager.cc:1434] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.025s	user 0.018s	sys 0.003s
I20260709 12:28:10.856016 22041 tablet_bootstrap.cc:492] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
W20260709 12:28:10.856400 21815 leader_election.cc:343] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.857540 21744 catalog_manager.cc:5697] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.862442 22038 tablet_bootstrap.cc:654] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.862764 22041 tablet_bootstrap.cc:654] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.867842 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34adaccdb2540ac81183b33de02f27a" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:10.868692 21998 raft_consensus.cc:3060] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.868806 22066 leader_election.cc:290] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.871289 22047 raft_consensus.cc:493] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.871778 22047 raft_consensus.cc:515] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.868667 22040 tablet_bootstrap.cc:492] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:10.873344 22040 ts_tablet_manager.cc:1403] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.083s	user 0.044s	sys 0.030s
I20260709 12:28:10.875430 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:10.876372 21849 raft_consensus.cc:2468] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:10.878144 21890 leader_election.cc:304] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:10.880143 22047 leader_election.cc:290] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.882270 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.885180 22047 raft_consensus.cc:2804] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.886181 22047 raft_consensus.cc:493] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.886628 22047 raft_consensus.cc:3060] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.885511 21997 raft_consensus.cc:2468] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:10.890657 22038 tablet_bootstrap.cc:492] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.891228 22038 ts_tablet_manager.cc:1403] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.010s
I20260709 12:28:10.890810 22040 raft_consensus.cc:359] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.893185 21998 raft_consensus.cc:2468] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:10.894629 22040 raft_consensus.cc:385] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.898787 21812 leader_election.cc:304] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:10.895952 22040 raft_consensus.cc:740] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.899549 22041 tablet_bootstrap.cc:492] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.900131 22041 ts_tablet_manager.cc:1403] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.044s	user 0.025s	sys 0.003s
I20260709 12:28:10.894320 22038 raft_consensus.cc:359] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.900882 22038 raft_consensus.cc:385] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.900271 22040 consensus_queue.cc:260] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.901288 22066 raft_consensus.cc:2804] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.901952 22066 raft_consensus.cc:697] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:10.902870 22066 consensus_queue.cc:237] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.903959 22047 raft_consensus.cc:515] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.907963 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:10.909866 22041 raft_consensus.cc:359] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.908849 21998 raft_consensus.cc:3060] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.901271 22038 raft_consensus.cc:740] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.912130 22038 consensus_queue.cc:260] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.913653 22077 raft_consensus.cc:493] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.914263 22077 raft_consensus.cc:515] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.914944 22038 ts_tablet_manager.cc:1434] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.000s
I20260709 12:28:10.915747 22070 raft_consensus.cc:493] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.916286 22070 raft_consensus.cc:515] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.918715 22070 leader_election.cc:290] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.922343 22079 raft_consensus.cc:493] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.922510 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:10.923316 21924 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:10.910789 22041 raft_consensus.cc:385] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:10.923923 22041 raft_consensus.cc:740] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.925707 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.925917 22077 leader_election.cc:290] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.926440 21997 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:10.926390 22041 consensus_queue.cc:260] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.928941 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.929764 21996 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:10.931126 21887 leader_election.cc:304] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:10.924713 22047 leader_election.cc:290] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.924605 21815 leader_election.cc:304] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:10.924602 22040 ts_tablet_manager.cc:1434] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.007s
I20260709 12:28:10.933492 22040 tablet_bootstrap.cc:492] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:10.933907 22041 ts_tablet_manager.cc:1434] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.033s	user 0.004s	sys 0.006s
I20260709 12:28:10.935004 22041 tablet_bootstrap.cc:492] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:10.935724 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:10.935817 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:10.936580 21849 raft_consensus.cc:3060] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.936671 21848 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:10.937635 22066 raft_consensus.cc:2804] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.937790 21998 raft_consensus.cc:2468] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:10.938094 22066 raft_consensus.cc:493] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.938593 22066 raft_consensus.cc:3060] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.938442 21745 catalog_manager.cc:5697] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.942279 22041 tablet_bootstrap.cc:654] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.942444 21887 leader_election.cc:304] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:10.943346 22047 raft_consensus.cc:2804] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.943804 22047 raft_consensus.cc:697] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:10.944602 22047 consensus_queue.cc:237] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.948375 22066 raft_consensus.cc:515] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.955247 22038 tablet_bootstrap.cc:492] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:10.923153 22079 raft_consensus.cc:515] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.959811 22078 raft_consensus.cc:2804] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.960328 22078 raft_consensus.cc:493] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.960711 22078 raft_consensus.cc:3060] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.961978 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259a2c4182f6430abe26383bb59ab3ba" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:10.962687 21998 raft_consensus.cc:2468] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:10.962776 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259a2c4182f6430abe26383bb59ab3ba" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:10.964442 21887 leader_election.cc:304] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:10.965384 22077 raft_consensus.cc:2804] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:10.965932 22077 raft_consensus.cc:493] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.967974 22077 raft_consensus.cc:3060] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.968585 22040 tablet_bootstrap.cc:654] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.969759 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:10.971652 22079 leader_election.cc:290] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
W20260709 12:28:10.965987 21890 leader_election.cc:343] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.967095 21849 raft_consensus.cc:2468] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:10.976223 22066 leader_election.cc:290] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.976343 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:10.977029 21998 raft_consensus.cc:3060] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.977730 22038 tablet_bootstrap.cc:654] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:10.980031 22077 raft_consensus.cc:515] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.983893 22038 tablet_bootstrap.cc:492] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:10.984460 22038 ts_tablet_manager.cc:1403] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:28:10.983736 22078 raft_consensus.cc:515] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.985165 21998 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:10.986079 21924 raft_consensus.cc:2393] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0bcb11d332554f9eafea151e33814cbf in current term 1: Already voted for candidate a6a950f168eb4846bcacf3fd8ab51e88 in this term.
I20260709 12:28:10.986713 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259a2c4182f6430abe26383bb59ab3ba" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:10.986974 21812 leader_election.cc:304] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
W20260709 12:28:10.988125 21890 leader_election.cc:343] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.989251 22066 raft_consensus.cc:2804] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:10.989907 22066 raft_consensus.cc:697] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:10.990387 22040 tablet_bootstrap.cc:492] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:10.991058 22040 ts_tablet_manager.cc:1403] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.003s
I20260709 12:28:10.990936 22066 consensus_queue.cc:237] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:10.989540 22077 leader_election.cc:290] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:10.993463 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259a2c4182f6430abe26383bb59ab3ba" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:10.994297 21998 raft_consensus.cc:3060] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:10.997747 22041 tablet_bootstrap.cc:492] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:10.998383 22041 ts_tablet_manager.cc:1403] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.064s	user 0.029s	sys 0.009s
I20260709 12:28:10.999724 21744 catalog_manager.cc:5697] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.000795 21998 raft_consensus.cc:2468] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:11.002251 21887 leader_election.cc:304] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 0bcb11d332554f9eafea151e33814cbf
I20260709 12:28:11.003408 22077 raft_consensus.cc:2804] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.003700 22078 leader_election.cc:290] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.003885 22077 raft_consensus.cc:697] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.001240 22041 raft_consensus.cc:359] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.004653 22040 raft_consensus.cc:359] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.004982 22041 raft_consensus.cc:385] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.004829 22077 consensus_queue.cc:237] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.005496 22040 raft_consensus.cc:385] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.005540 22041 raft_consensus.cc:740] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.005967 22040 raft_consensus.cc:740] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.006482 22041 consensus_queue.cc:260] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.006783 22040 consensus_queue.cc:260] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.007181 21745 catalog_manager.cc:5697] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.007870 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.008731 21996 raft_consensus.cc:2393] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6a950f168eb4846bcacf3fd8ab51e88 in current term 1: Already voted for candidate 0bcb11d332554f9eafea151e33814cbf in this term.
I20260709 12:28:11.009079 22041 ts_tablet_manager.cc:1434] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:11.009977 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.010181 22041 tablet_bootstrap.cc:492] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:11.011556 21890 leader_election.cc:304] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a950f168eb4846bcacf3fd8ab51e88; no voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:11.012555 22047 raft_consensus.cc:2749] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:10.988000 22038 raft_consensus.cc:359] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.013720 22038 raft_consensus.cc:385] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.014120 22038 raft_consensus.cc:740] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.015069 22038 consensus_queue.cc:260] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.009079 22040 ts_tablet_manager.cc:1434] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:28:11.016994 22041 tablet_bootstrap.cc:654] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.021512 22040 tablet_bootstrap.cc:492] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:11.023229 22038 ts_tablet_manager.cc:1434] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.000s
I20260709 12:28:11.028195 22038 tablet_bootstrap.cc:492] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:11.032641 22040 tablet_bootstrap.cc:654] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.041023 22038 tablet_bootstrap.cc:654] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.044349 22041 tablet_bootstrap.cc:492] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:11.044960 22041 ts_tablet_manager.cc:1403] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.018s
I20260709 12:28:11.047976 22041 raft_consensus.cc:359] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.048862 22041 raft_consensus.cc:385] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.047887 21744 catalog_manager.cc:5697] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.049156 22041 raft_consensus.cc:740] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.050117 22041 consensus_queue.cc:260] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.054845 22041 ts_tablet_manager.cc:1434] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:28:11.066543 22038 tablet_bootstrap.cc:492] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:11.067123 22040 tablet_bootstrap.cc:492] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:11.067117 22038 ts_tablet_manager.cc:1403] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.039s	user 0.014s	sys 0.017s
I20260709 12:28:11.067724 22040 ts_tablet_manager.cc:1403] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.021s
I20260709 12:28:11.069963 22038 raft_consensus.cc:359] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.070523 22038 raft_consensus.cc:385] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.070408 22040 raft_consensus.cc:359] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.070990 22038 raft_consensus.cc:740] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.071321 22040 raft_consensus.cc:385] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.071655 22040 raft_consensus.cc:740] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.071786 22038 consensus_queue.cc:260] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.072295 22040 consensus_queue.cc:260] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.074365 22040 ts_tablet_manager.cc:1434] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:28:11.075285 22040 tablet_bootstrap.cc:492] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:11.075692 22038 ts_tablet_manager.cc:1434] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:11.076675 22038 tablet_bootstrap.cc:492] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:11.082116 22040 tablet_bootstrap.cc:654] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.084865 22038 tablet_bootstrap.cc:654] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.090143 22038 tablet_bootstrap.cc:492] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:11.090564 22038 ts_tablet_manager.cc:1403] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:28:11.091717 22040 tablet_bootstrap.cc:492] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:11.092330 22040 ts_tablet_manager.cc:1403] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260709 12:28:11.092722 22038 raft_consensus.cc:359] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.093292 22038 raft_consensus.cc:385] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.093571 22038 raft_consensus.cc:740] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.094264 22038 consensus_queue.cc:260] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.095021 22040 raft_consensus.cc:359] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.095808 22040 raft_consensus.cc:385] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.096117 22040 raft_consensus.cc:740] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.096263 22038 ts_tablet_manager.cc:1434] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:28:11.096832 22040 consensus_queue.cc:260] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.098925 22040 ts_tablet_manager.cc:1434] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:28:11.100024 22040 tablet_bootstrap.cc:492] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:11.105134 22040 tablet_bootstrap.cc:654] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:11.106128 22059 raft_consensus.cc:493] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.106583 22059 raft_consensus.cc:515] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.108551 22059 leader_election.cc:290] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:11.109982 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:11.110169 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:11.110651 22040 tablet_bootstrap.cc:492] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:11.110956 21924 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 0.
I20260709 12:28:11.111153 22040 ts_tablet_manager.cc:1403] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.001s
I20260709 12:28:11.110671 21849 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 0.
I20260709 12:28:11.112172 21964 leader_election.cc:304] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.113054 22059 raft_consensus.cc:2804] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.113441 22059 raft_consensus.cc:493] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.113781 22059 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.114087 22040 raft_consensus.cc:359] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.114790 22040 raft_consensus.cc:385] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:11.115144 22040 raft_consensus.cc:740] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.116261 22040 consensus_queue.cc:260] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.118260 22040 ts_tablet_manager.cc:1434] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:11.120802 22059 raft_consensus.cc:515] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.122592 22059 leader_election.cc:290] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:11.123270 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.123889 21849 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.123767 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:11.124603 21924 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.131206 21849 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 1.
I20260709 12:28:11.131772 21924 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 1.
I20260709 12:28:11.132508 21964 leader_election.cc:304] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:11.133268 22059 raft_consensus.cc:2804] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.133759 22059 raft_consensus.cc:697] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Becoming Leader. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:11.134459 22059 consensus_queue.cc:237] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.142381 21747 catalog_manager.cc:5697] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "391c5f190db448bd981ce1e56cc044f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.221061 21924 raft_consensus.cc:3060] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.227591 22066 consensus_queue.cc:1048] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.239789 22070 consensus_queue.cc:1048] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.247359 22077 raft_consensus.cc:493] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.248030 22077 raft_consensus.cc:515] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.249925 22077 leader_election.cc:290] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.250721 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34adaccdb2540ac81183b33de02f27a" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:11.251047 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f34adaccdb2540ac81183b33de02f27a" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:11.252177 21998 raft_consensus.cc:2393] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate a6a950f168eb4846bcacf3fd8ab51e88 in current term 1: Already voted for candidate 0bcb11d332554f9eafea151e33814cbf in this term.
I20260709 12:28:11.253074 22077 raft_consensus.cc:493] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.253275 21887 leader_election.cc:304] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a950f168eb4846bcacf3fd8ab51e88; no voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:11.253849 22077 raft_consensus.cc:515] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.254235 22078 raft_consensus.cc:3060] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.256867 22077 leader_election.cc:290] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.257022 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:11.257726 21849 raft_consensus.cc:2468] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:11.258657 21890 leader_election.cc:304] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.259387 22077 raft_consensus.cc:2804] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.259806 22077 raft_consensus.cc:493] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.260162 22077 raft_consensus.cc:3060] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.262117 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:11.262667 21998 raft_consensus.cc:2468] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:11.263073 22078 raft_consensus.cc:2749] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:11.266855 22077 raft_consensus.cc:515] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.268736 22077 leader_election.cc:290] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.269459 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.269925 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.270077 21849 raft_consensus.cc:3060] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.270538 21998 raft_consensus.cc:3060] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.277398 21998 raft_consensus.cc:2468] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:11.277395 21849 raft_consensus.cc:2468] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:11.278575 21890 leader_election.cc:304] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.279237 22077 raft_consensus.cc:2804] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.279744 22077 raft_consensus.cc:697] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.280524 22077 consensus_queue.cc:237] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.288268 21745 catalog_manager.cc:5697] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.322764 22077 raft_consensus.cc:493] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.323334 22077 raft_consensus.cc:515] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.325022 22077 leader_election.cc:290] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.325774 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:11.326067 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:11.326532 21849 raft_consensus.cc:2468] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:11.326697 21998 raft_consensus.cc:2468] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:11.327627 21890 leader_election.cc:304] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.328416 22077 raft_consensus.cc:2804] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.328734 22077 raft_consensus.cc:493] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.329005 22077 raft_consensus.cc:3060] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.333801 22077 raft_consensus.cc:515] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.335718 22077 leader_election.cc:290] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.336333 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.336351 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.337137 21849 raft_consensus.cc:3060] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.337621 21998 raft_consensus.cc:3060] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.339660 22067 raft_consensus.cc:493] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.340299 22077 raft_consensus.cc:493] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.340183 22070 consensus_queue.cc:1048] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:11.340814 22077 raft_consensus.cc:515] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.343430 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:11.344205 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:11.340184 22067 raft_consensus.cc:515] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.345080 21996 raft_consensus.cc:2468] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:11.345482 21848 raft_consensus.cc:2468] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:11.346437 21887 leader_election.cc:304] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.346669 22067 leader_election.cc:290] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.344460 22077 leader_election.cc:290] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.347424 22077 raft_consensus.cc:2804] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.347766 22077 raft_consensus.cc:493] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.348079 22077 raft_consensus.cc:3060] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.348240 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:11.348378 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:11.348994 21996 raft_consensus.cc:2468] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:11.349268 21998 raft_consensus.cc:2468] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:11.350365 21887 leader_election.cc:304] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.350881 21812 leader_election.cc:304] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:11.351238 22078 raft_consensus.cc:2804] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.344272 21849 raft_consensus.cc:2468] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:11.351790 22078 raft_consensus.cc:697] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.352867 22070 raft_consensus.cc:2804] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:11.353271 22070 raft_consensus.cc:493] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:11.352793 22078 consensus_queue.cc:237] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.353638 22070 raft_consensus.cc:3060] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.356632 22077 raft_consensus.cc:515] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.357995 21923 raft_consensus.cc:2393] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0bcb11d332554f9eafea151e33814cbf in current term 1: Already voted for candidate a6a950f168eb4846bcacf3fd8ab51e88 in this term.
I20260709 12:28:11.359181 22077 leader_election.cc:290] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.360229 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.360831 21998 raft_consensus.cc:3060] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.364014 22066 consensus_queue.cc:1048] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.366074 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.368105 22070 raft_consensus.cc:515] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.371654 22070 leader_election.cc:290] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.372349 21849 raft_consensus.cc:2393] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate a6a950f168eb4846bcacf3fd8ab51e88 in current term 1: Already voted for candidate 0bcb11d332554f9eafea151e33814cbf in this term.
I20260709 12:28:11.372243 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:11.373232 21924 raft_consensus.cc:2393] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0bcb11d332554f9eafea151e33814cbf in current term 1: Already voted for candidate a6a950f168eb4846bcacf3fd8ab51e88 in this term.
I20260709 12:28:11.375152 21998 raft_consensus.cc:2468] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:11.375361 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "29eefb0340e843319123ba8f60a9cfd5" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.376312 21997 raft_consensus.cc:2393] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0bcb11d332554f9eafea151e33814cbf in current term 1: Already voted for candidate a6a950f168eb4846bcacf3fd8ab51e88 in this term.
I20260709 12:28:11.379024 21812 leader_election.cc:304] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf; no voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:11.379072 21745 catalog_manager.cc:5697] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.379925 22070 raft_consensus.cc:2749] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:11.379879 21887 leader_election.cc:304] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.381233 22078 raft_consensus.cc:2804] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:11.381752 22078 raft_consensus.cc:697] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.382584 22078 consensus_queue.cc:237] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.394066 21747 catalog_manager.cc:5697] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.407481 22078 consensus_queue.cc:1048] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.417040 22077 consensus_queue.cc:1048] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.440275 22070 raft_consensus.cc:493] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:11.440657 22070 raft_consensus.cc:515] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.442464 22070 leader_election.cc:290] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.443018 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259a2c4182f6430abe26383bb59ab3ba" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:11.443482 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "259a2c4182f6430abe26383bb59ab3ba" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:11.444324 21996 raft_consensus.cc:2393] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0bcb11d332554f9eafea151e33814cbf in current term 1: Already voted for candidate a6a950f168eb4846bcacf3fd8ab51e88 in this term.
I20260709 12:28:11.445173 21812 leader_election.cc:304] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf; no voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:11.445887 22070 raft_consensus.cc:3060] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:11.450902 22070 raft_consensus.cc:2749] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:11.503180 21924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
mode: GRACEFUL
new_leader_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:56884
I20260709 12:28:11.503815 21924 raft_consensus.cc:606] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Received request to transfer leadership to TS 0bcb11d332554f9eafea151e33814cbf
I20260709 12:28:11.522118 21996 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe"
dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
mode: GRACEFUL
new_leader_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:33560
I20260709 12:28:11.522710 21996 raft_consensus.cc:606] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Received request to transfer leadership to TS 0bcb11d332554f9eafea151e33814cbf
I20260709 12:28:11.537190 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:28:11.537724 21849 raft_consensus.cc:606] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Received request to transfer leadership to TS a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:11.541002 22070 consensus_queue.cc:1048] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.548812 21924 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
mode: GRACEFUL
new_leader_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:56884
I20260709 12:28:11.549384 21924 raft_consensus.cc:606] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Received request to transfer leadership to TS 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:11.555387 22070 consensus_queue.cc:1048] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.561729 22077 consensus_queue.cc:1048] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.562718 22067 raft_consensus.cc:993] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:11.563242 22070 raft_consensus.cc:1081] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Signalling peer a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:11.565351 21924 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:56880
I20260709 12:28:11.569756 21924 raft_consensus.cc:493] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.570135 21924 raft_consensus.cc:3060] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.574128 22077 consensus_queue.cc:1048] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.588061 21924 raft_consensus.cc:515] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.590569 21924 leader_election.cc:290] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.590827 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.591163 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "20c9d57544fa4577989a8f7969fc6f6b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.592163 21996 raft_consensus.cc:3060] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.591634 21849 raft_consensus.cc:3055] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.593065 21849 raft_consensus.cc:740] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:11.594080 21849 consensus_queue.cc:260] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.595131 21849 raft_consensus.cc:3060] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.600082 21996 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:11.600970 21849 raft_consensus.cc:2468] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:11.601572 21887 leader_election.cc:304] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.602422 22077 raft_consensus.cc:2804] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.602898 22077 raft_consensus.cc:697] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.603601 22077 consensus_queue.cc:237] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.610368 21745 catalog_manager.cc:5697] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 1 to 2, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.610910 22059 consensus_queue.cc:1048] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.623049 22115 consensus_queue.cc:1048] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.632259 22042 raft_consensus.cc:993] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: : Instructing follower 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:11.632710 22115 raft_consensus.cc:1081] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Signalling peer 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:11.634397 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:50160
I20260709 12:28:11.635030 21849 raft_consensus.cc:493] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.635427 21849 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.640758 21849 raft_consensus.cc:515] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.642267 21849 leader_election.cc:290] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.642942 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:11.643236 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.643586 21924 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.643841 21996 raft_consensus.cc:3055] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.644194 21996 raft_consensus.cc:740] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:11.644829 21996 consensus_queue.cc:260] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.645841 21996 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.648571 21924 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:11.649569 21815 leader_election.cc:304] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:11.650315 22070 raft_consensus.cc:2804] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.650707 22070 raft_consensus.cc:697] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:11.651055 21996 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:11.651444 22070 consensus_queue.cc:237] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.657454 21747 catalog_manager.cc:5697] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 1 to 2, leader changed from 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3) to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 2 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:11.680217 22077 consensus_queue.cc:1048] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.690006 22047 consensus_queue.cc:1048] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.856869 22047 consensus_queue.cc:1048] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.863891 22079 raft_consensus.cc:993] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: : Instructing follower 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:11.864477 22077 raft_consensus.cc:1081] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Signalling peer 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:11.866720 21997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc"
dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:33538
I20260709 12:28:11.868152 21997 raft_consensus.cc:493] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.868603 21997 raft_consensus.cc:3060] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.869028 22077 consensus_queue.cc:1048] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.879419 21997 raft_consensus.cc:515] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.881492 21997 leader_election.cc:290] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:11.882957 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:11.883003 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a653a791ef9f43329be55e94cfa5e4bc" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:11.883708 21849 raft_consensus.cc:3060] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.883800 21924 raft_consensus.cc:3055] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.884244 21924 raft_consensus.cc:740] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.884967 21924 consensus_queue.cc:260] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.885963 21924 raft_consensus.cc:3060] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.890846 21849 raft_consensus.cc:2468] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 2.
I20260709 12:28:11.891479 21924 raft_consensus.cc:2468] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 2.
I20260709 12:28:11.891916 21964 leader_election.cc:304] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:11.892753 22115 raft_consensus.cc:2804] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.893229 22115 raft_consensus.cc:697] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 2 LEADER]: Becoming Leader. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:11.894052 22115 consensus_queue.cc:237] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.900141 21744 catalog_manager.cc:5697] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 reported cstate change: term changed from 1 to 2, leader changed from a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2) to 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "391c5f190db448bd981ce1e56cc044f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:11.935132 22047 raft_consensus.cc:993] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: : Instructing follower 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:11.935616 22079 raft_consensus.cc:1081] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Signalling peer 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:11.937280 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:50152
I20260709 12:28:11.937892 21849 raft_consensus.cc:493] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:11.938299 21849 raft_consensus.cc:3060] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.943578 21849 raft_consensus.cc:515] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.945152 21849 leader_election.cc:290] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:11.946062 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:11.946691 21924 raft_consensus.cc:3055] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:11.946769 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ce3ca40bfb7d44a28290f87cdf749fdf" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:11.947059 21924 raft_consensus.cc:740] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:11.947465 21997 raft_consensus.cc:3060] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.948042 21924 consensus_queue.cc:260] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.948304 22079 consensus_queue.cc:1048] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.949189 21924 raft_consensus.cc:3060] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.953680 21997 raft_consensus.cc:2468] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:11.955085 21812 leader_election.cc:304] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:11.955919 22070 raft_consensus.cc:2804] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:11.956418 22070 raft_consensus.cc:697] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:11.957446 22070 consensus_queue.cc:237] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:11.958370 21924 raft_consensus.cc:2468] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:11.964951 22047 consensus_queue.cc:1048] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:11.967869 21745 catalog_manager.cc:5697] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 1 to 2, leader changed from a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2) to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 2 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:12.048527 21849 raft_consensus.cc:1275] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.049805 22047 consensus_queue.cc:1048] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.057173 21997 raft_consensus.cc:1275] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.058534 22047 consensus_queue.cc:1048] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.152344 21997 raft_consensus.cc:1275] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.153600 22070 consensus_queue.cc:1048] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.160884 21924 raft_consensus.cc:1275] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.162753 22066 consensus_queue.cc:1048] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.319936 21924 raft_consensus.cc:1275] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.321327 22115 consensus_queue.cc:1048] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.329999 21849 raft_consensus.cc:1275] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.331869 22115 consensus_queue.cc:1048] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.472205 21924 raft_consensus.cc:1275] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.473541 22066 consensus_queue.cc:1048] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:12.483793 21997 raft_consensus.cc:1275] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:12.485500 22070 consensus_queue.cc:1048] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:14.587920 21745 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:36594:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:14.592590 21745 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:14.648653 21832 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcb41e0c54a462faf8457dccaf5bd20 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:14.649931 21913 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcb41e0c54a462faf8457dccaf5bd20 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:14.650717 21832 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcb41e0c54a462faf8457dccaf5bd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.651719 21913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcb41e0c54a462faf8457dccaf5bd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.651950 21980 tablet_service.cc:1511] Processing CreateTablet for tablet 6bcb41e0c54a462faf8457dccaf5bd20 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:14.653604 21980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bcb41e0c54a462faf8457dccaf5bd20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.655303 21833 tablet_service.cc:1511] Processing CreateTablet for tablet cbc4036faaa84306b29e44414e08b97b (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:14.656880 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc4036faaa84306b29e44414e08b97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.663539 21907 tablet_service.cc:1511] Processing CreateTablet for tablet cbc4036faaa84306b29e44414e08b97b (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:14.665114 21907 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc4036faaa84306b29e44414e08b97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.676959 21984 tablet_service.cc:1511] Processing CreateTablet for tablet cbc4036faaa84306b29e44414e08b97b (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:14.678635 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 3d63746d1aaa410796e738e07e2863ef (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:14.679993 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63746d1aaa410796e738e07e2863ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.680995 21910 tablet_service.cc:1511] Processing CreateTablet for tablet 3d63746d1aaa410796e738e07e2863ef (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:14.682761 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63746d1aaa410796e738e07e2863ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.683952 21835 tablet_service.cc:1511] Processing CreateTablet for tablet fb9b2d46c3af4399b39c04e435e63bfe (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:14.685267 21835 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9b2d46c3af4399b39c04e435e63bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.686625 21912 tablet_service.cc:1511] Processing CreateTablet for tablet fb9b2d46c3af4399b39c04e435e63bfe (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:14.688042 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9b2d46c3af4399b39c04e435e63bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.692368 21987 tablet_service.cc:1511] Processing CreateTablet for tablet 3d63746d1aaa410796e738e07e2863ef (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:14.693790 21836 tablet_service.cc:1511] Processing CreateTablet for tablet 837d17f3e8b84109bf6fd77d06a3bb1f (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:14.695185 21836 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837d17f3e8b84109bf6fd77d06a3bb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.695070 21985 tablet_service.cc:1511] Processing CreateTablet for tablet fb9b2d46c3af4399b39c04e435e63bfe (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:14.705688 21984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbc4036faaa84306b29e44414e08b97b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.711347 21906 tablet_service.cc:1511] Processing CreateTablet for tablet 837d17f3e8b84109bf6fd77d06a3bb1f (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:14.713109 21906 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837d17f3e8b84109bf6fd77d06a3bb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.713244 21831 tablet_service.cc:1511] Processing CreateTablet for tablet 8713aed51e8b45be8f44b414245f5a20 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:14.714689 21831 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8713aed51e8b45be8f44b414245f5a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.715067 21983 tablet_service.cc:1511] Processing CreateTablet for tablet 837d17f3e8b84109bf6fd77d06a3bb1f (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:14.716945 21983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 837d17f3e8b84109bf6fd77d06a3bb1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.723368 21914 tablet_service.cc:1511] Processing CreateTablet for tablet 8713aed51e8b45be8f44b414245f5a20 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:14.724772 21914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8713aed51e8b45be8f44b414245f5a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.732381 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d63746d1aaa410796e738e07e2863ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.736393 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fb9b2d46c3af4399b39c04e435e63bfe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.775302 22141 tablet_bootstrap.cc:492] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:14.777959 21986 tablet_service.cc:1511] Processing CreateTablet for tablet 8713aed51e8b45be8f44b414245f5a20 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:14.780436 22142 tablet_bootstrap.cc:492] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:14.780687 21986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8713aed51e8b45be8f44b414245f5a20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.790786 22142 tablet_bootstrap.cc:654] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.793519 21833 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c3400e1de46baa15e3d465f27e571 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:14.795957 21913 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c3400e1de46baa15e3d465f27e571 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:14.797526 21913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c3400e1de46baa15e3d465f27e571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.798259 21981 tablet_service.cc:1511] Processing CreateTablet for tablet 5e1c3400e1de46baa15e3d465f27e571 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:14.799599 21981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c3400e1de46baa15e3d465f27e571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.800837 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e1c3400e1de46baa15e3d465f27e571. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.811156 22141 tablet_bootstrap.cc:654] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.823290 22142 tablet_bootstrap.cc:492] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:14.825449 22142 ts_tablet_manager.cc:1403] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.045s	user 0.005s	sys 0.009s
I20260709 12:28:14.832351 22144 tablet_bootstrap.cc:492] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:14.832942 21838 tablet_service.cc:1511] Processing CreateTablet for tablet 309fc2e847d64c6c91e77fd7220aca03 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:14.834978 21838 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309fc2e847d64c6c91e77fd7220aca03. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:14.835083 21795 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:14.828781 22142 raft_consensus.cc:359] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.849921 21985 tablet_service.cc:1511] Processing CreateTablet for tablet 309fc2e847d64c6c91e77fd7220aca03 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:14.851356 21985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309fc2e847d64c6c91e77fd7220aca03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.841887 22142 raft_consensus.cc:385] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.852176 22142 raft_consensus.cc:740] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.852468 21833 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7e01fc30845f19c2ef0931d9e0b33 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:14.855026 21833 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7e01fc30845f19c2ef0931d9e0b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.854861 22142 consensus_queue.cc:260] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.853615 21912 tablet_service.cc:1511] Processing CreateTablet for tablet 309fc2e847d64c6c91e77fd7220aca03 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:14.856729 21912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 309fc2e847d64c6c91e77fd7220aca03. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.860556 22142 ts_tablet_manager.cc:1434] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:28:14.871292 21910 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7e01fc30845f19c2ef0931d9e0b33 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:14.871987 22141 tablet_bootstrap.cc:492] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:14.872130 21987 tablet_service.cc:1511] Processing CreateTablet for tablet a7c7e01fc30845f19c2ef0931d9e0b33 (DEFAULT_TABLE table=soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:14.872635 22141 ts_tablet_manager.cc:1403] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.101s	user 0.020s	sys 0.009s
I20260709 12:28:14.872663 21910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7e01fc30845f19c2ef0931d9e0b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.873533 21987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7c7e01fc30845f19c2ef0931d9e0b33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:14.874387 22144 tablet_bootstrap.cc:654] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.876210 22141 raft_consensus.cc:359] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.877003 22141 raft_consensus.cc:385] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.877383 22141 raft_consensus.cc:740] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.878221 22141 consensus_queue.cc:260] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.889950 22144 tablet_bootstrap.cc:492] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:14.890535 22144 ts_tablet_manager.cc:1403] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.006s
I20260709 12:28:14.897006 22142 tablet_bootstrap.cc:492] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:14.904505 22142 tablet_bootstrap.cc:654] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.905920 22141 ts_tablet_manager.cc:1434] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.004s
I20260709 12:28:14.907243 22141 tablet_bootstrap.cc:492] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:14.913208 22144 raft_consensus.cc:359] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.914229 22144 raft_consensus.cc:385] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.914610 22144 raft_consensus.cc:740] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.915496 22144 consensus_queue.cc:260] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.916509 22141 tablet_bootstrap.cc:654] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.919638 22142 tablet_bootstrap.cc:492] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:14.920255 22142 ts_tablet_manager.cc:1403] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:28:14.923318 22144 ts_tablet_manager.cc:1434] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.032s	user 0.010s	sys 0.000s
I20260709 12:28:14.923362 22142 raft_consensus.cc:359] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.924754 22144 tablet_bootstrap.cc:492] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:14.924711 22142 raft_consensus.cc:385] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.925570 22142 raft_consensus.cc:740] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.925971 22141 tablet_bootstrap.cc:492] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:14.926527 22141 ts_tablet_manager.cc:1403] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.005s
I20260709 12:28:14.926698 22142 consensus_queue.cc:260] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.929507 22141 raft_consensus.cc:359] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.930313 22141 raft_consensus.cc:385] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.932881 22141 raft_consensus.cc:740] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.932957 22144 tablet_bootstrap.cc:654] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.933641 22141 consensus_queue.cc:260] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.930285 22142 ts_tablet_manager.cc:1434] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.001s
I20260709 12:28:14.937840 22142 tablet_bootstrap.cc:492] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:14.938401 22141 ts_tablet_manager.cc:1434] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:14.939486 22141 tablet_bootstrap.cc:492] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:14.940151 22144 tablet_bootstrap.cc:492] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:14.940793 22144 ts_tablet_manager.cc:1403] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 12:28:14.944159 22144 raft_consensus.cc:359] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.944983 22144 raft_consensus.cc:385] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.945129 22142 tablet_bootstrap.cc:654] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.945906 22141 tablet_bootstrap.cc:654] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.947105 22144 raft_consensus.cc:740] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.948088 22144 consensus_queue.cc:260] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.950860 22144 ts_tablet_manager.cc:1434] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.005s
I20260709 12:28:14.952056 22144 tablet_bootstrap.cc:492] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:14.958204 22142 tablet_bootstrap.cc:492] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:14.958845 22142 ts_tablet_manager.cc:1403] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.009s
I20260709 12:28:14.962114 22144 tablet_bootstrap.cc:654] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.962472 22142 raft_consensus.cc:359] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.965034 22142 raft_consensus.cc:385] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.965351 22142 raft_consensus.cc:740] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.966403 22141 tablet_bootstrap.cc:492] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:14.966184 22142 consensus_queue.cc:260] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.967031 22141 ts_tablet_manager.cc:1403] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.028s	user 0.016s	sys 0.010s
I20260709 12:28:14.968575 22142 ts_tablet_manager.cc:1434] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:28:14.969705 22142 tablet_bootstrap.cc:492] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:14.971179 22141 raft_consensus.cc:359] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.972291 22141 raft_consensus.cc:385] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.972747 22141 raft_consensus.cc:740] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.974298 22141 consensus_queue.cc:260] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.976315 22142 tablet_bootstrap.cc:654] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.977988 22141 ts_tablet_manager.cc:1434] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.003s
I20260709 12:28:14.980588 22141 tablet_bootstrap.cc:492] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:14.986531 22144 tablet_bootstrap.cc:492] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:14.987799 22142 tablet_bootstrap.cc:492] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:14.989252 22144 ts_tablet_manager.cc:1403] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.003s
I20260709 12:28:14.989315 22142 ts_tablet_manager.cc:1403] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:28:14.992681 22142 raft_consensus.cc:359] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.993870 22141 tablet_bootstrap.cc:654] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:14.993438 22142 raft_consensus.cc:385] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.994669 22142 raft_consensus.cc:740] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.994414 22144 raft_consensus.cc:359] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.995836 22144 raft_consensus.cc:385] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:14.995488 22142 consensus_queue.cc:260] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:14.996287 22144 raft_consensus.cc:740] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:14.997228 22144 consensus_queue.cc:260] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.000619 22144 ts_tablet_manager.cc:1434] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:28:15.001309 22142 ts_tablet_manager.cc:1434] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:28:15.002147 22144 tablet_bootstrap.cc:492] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:15.002686 22142 tablet_bootstrap.cc:492] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:15.007854 22141 tablet_bootstrap.cc:492] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:15.008641 22141 ts_tablet_manager.cc:1403] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.005s
I20260709 12:28:15.010303 22142 tablet_bootstrap.cc:654] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.011231 22144 tablet_bootstrap.cc:654] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.012291 22141 raft_consensus.cc:359] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.013291 22141 raft_consensus.cc:385] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.013732 22141 raft_consensus.cc:740] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.014875 22141 consensus_queue.cc:260] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.018420 22141 ts_tablet_manager.cc:1434] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260709 12:28:15.020450 22141 tablet_bootstrap.cc:492] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:15.039192 22144 tablet_bootstrap.cc:492] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:15.039997 22144 ts_tablet_manager.cc:1403] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.012s
I20260709 12:28:15.040175 22141 tablet_bootstrap.cc:654] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.041644 22142 tablet_bootstrap.cc:492] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:15.042230 22142 ts_tablet_manager.cc:1403] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.014s
I20260709 12:28:15.043821 22126 raft_consensus.cc:493] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.044013 22150 raft_consensus.cc:493] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.044451 22150 raft_consensus.cc:515] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.044427 22126 raft_consensus.cc:515] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.044772 22144 raft_consensus.cc:359] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.045684 22144 raft_consensus.cc:385] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.046084 22144 raft_consensus.cc:740] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.047037 22150 leader_election.cc:290] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.047114 22144 consensus_queue.cc:260] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.048357 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:15.049201 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.049882 22126 leader_election.cc:290] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:15.049979 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63746d1aaa410796e738e07e2863ef" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:15.050944 22150 raft_consensus.cc:493] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.051524 22150 raft_consensus.cc:515] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
W20260709 12:28:15.052034 21964 leader_election.cc:343] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.055486 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63746d1aaa410796e738e07e2863ef" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.055351 22142 raft_consensus.cc:359] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.057524 22142 raft_consensus.cc:385] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.057894 22142 raft_consensus.cc:740] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
W20260709 12:28:15.059128 21964 leader_election.cc:343] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.058866 22142 consensus_queue.cc:260] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.059728 21964 leader_election.cc:304] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1; no voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:15.061702 22142 ts_tablet_manager.cc:1434] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 12:28:15.063923 22141 tablet_bootstrap.cc:492] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:15.064495 22141 ts_tablet_manager.cc:1403] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.044s	user 0.012s	sys 0.005s
W20260709 12:28:15.055770 21890 leader_election.cc:343] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:15.066896 21887 leader_election.cc:343] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.068022 22141 raft_consensus.cc:359] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.068610 21887 leader_election.cc:304] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a6a950f168eb4846bcacf3fd8ab51e88; no voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:15.058925 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.069854 22047 raft_consensus.cc:2749] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.070230 22142 tablet_bootstrap.cc:492] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:15.070477 21996 raft_consensus.cc:2468] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:15.070957 22147 raft_consensus.cc:493] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.071640 22147 raft_consensus.cc:515] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.072042 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:15.072798 21849 raft_consensus.cc:2468] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 0.
I20260709 12:28:15.073917 22126 raft_consensus.cc:2749] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.057036 22150 leader_election.cc:290] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.069021 22141 raft_consensus.cc:385] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.075313 22141 raft_consensus.cc:740] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.075937 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.076841 21924 raft_consensus.cc:2468] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.076262 22141 consensus_queue.cc:260] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.078593 22142 tablet_bootstrap.cc:654] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.078902 22144 ts_tablet_manager.cc:1434] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.038s	user 0.017s	sys 0.012s
I20260709 12:28:15.080348 22141 ts_tablet_manager.cc:1434] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 12:28:15.080408 22144 tablet_bootstrap.cc:492] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:15.081645 22070 raft_consensus.cc:493] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.081923 22141 tablet_bootstrap.cc:492] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:15.082149 22070 raft_consensus.cc:515] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.085659 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9b2d46c3af4399b39c04e435e63bfe" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
W20260709 12:28:15.087373 21812 leader_election.cc:343] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.089149 21815 leader_election.cc:304] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.091082 21890 leader_election.cc:304] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.092072 22150 raft_consensus.cc:2804] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.092152 22070 leader_election.cc:290] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.092816 22070 raft_consensus.cc:2804] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.092468 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9b2d46c3af4399b39c04e435e63bfe" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.098115 21924 raft_consensus.cc:2468] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.093327 22070 raft_consensus.cc:493] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.094199 22147 leader_election.cc:290] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.102625 22144 tablet_bootstrap.cc:654] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.095446 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.102625 22070 raft_consensus.cc:3060] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.092557 22150 raft_consensus.cc:493] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.103768 22150 raft_consensus.cc:3060] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.103842 21996 raft_consensus.cc:2468] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.107223 22141 tablet_bootstrap.cc:654] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.113787 22070 raft_consensus.cc:515] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.115749 22144 tablet_bootstrap.cc:492] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:15.118916 22144 ts_tablet_manager.cc:1403] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.004s
I20260709 12:28:15.117835 21815 leader_election.cc:304] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:15.117751 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.121115 21924 raft_consensus.cc:3060] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.125747 22147 raft_consensus.cc:2804] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.125582 22150 raft_consensus.cc:515] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.126026 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.126255 22147 raft_consensus.cc:493] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.126721 21996 raft_consensus.cc:3060] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.126793 22147 raft_consensus.cc:3060] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.128441 22144 raft_consensus.cc:359] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.128829 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:15.129243 22144 raft_consensus.cc:385] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.132999 22144 raft_consensus.cc:740] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.130584 22150 leader_election.cc:290] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.132294 22142 tablet_bootstrap.cc:492] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:15.132089 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.129544 21849 raft_consensus.cc:3060] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.134282 22142 ts_tablet_manager.cc:1403] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.064s	user 0.012s	sys 0.014s
I20260709 12:28:15.133936 22144 consensus_queue.cc:260] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.136353 22144 ts_tablet_manager.cc:1434] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:28:15.137306 22144 tablet_bootstrap.cc:492] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:15.138936 22142 raft_consensus.cc:359] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.134289 21997 raft_consensus.cc:3060] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.139777 22142 raft_consensus.cc:385] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.142238 22142 raft_consensus.cc:740] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.144723 22144 tablet_bootstrap.cc:654] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.151096 22142 consensus_queue.cc:260] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.159610 22162 raft_consensus.cc:493] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.160306 22162 raft_consensus.cc:515] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.165539 22070 leader_election.cc:290] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.166846 21849 raft_consensus.cc:2468] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
I20260709 12:28:15.174294 21924 raft_consensus.cc:2468] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.177901 22141 tablet_bootstrap.cc:492] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:15.176093 21890 leader_election.cc:304] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.178196 21998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.179183 22047 raft_consensus.cc:2804] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.176734 22162 leader_election.cc:290] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.165074 21996 raft_consensus.cc:2468] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.181098 22141 ts_tablet_manager.cc:1403] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.099s	user 0.015s	sys 0.011s
I20260709 12:28:15.176918 22147 raft_consensus.cc:515] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.175591 21997 raft_consensus.cc:2468] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 1.
W20260709 12:28:15.179813 21812 leader_election.cc:343] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.187166 22144 tablet_bootstrap.cc:492] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:15.187542 21812 leader_election.cc:304] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:15.187937 22144 ts_tablet_manager.cc:1403] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.027s
I20260709 12:28:15.188076 22147 leader_election.cc:290] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.188858 22147 raft_consensus.cc:2804] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.190286 22147 raft_consensus.cc:697] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.191337 22147 consensus_queue.cc:237] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.192303 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9b2d46c3af4399b39c04e435e63bfe" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.192575 22144 raft_consensus.cc:359] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.193738 22144 raft_consensus.cc:385] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.194101 22144 raft_consensus.cc:740] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
W20260709 12:28:15.194334 21812 leader_election.cc:343] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:15.192950 22047 raft_consensus.cc:697] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:15.192343 22141 raft_consensus.cc:359] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.194927 22144 consensus_queue.cc:260] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.195580 22141 raft_consensus.cc:385] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.196074 22047 consensus_queue.cc:237] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.198040 22144 ts_tablet_manager.cc:1434] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260709 12:28:15.196113 22141 raft_consensus.cc:740] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.199263 22144 tablet_bootstrap.cc:492] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:15.199501 22141 consensus_queue.cc:260] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.202740 22141 ts_tablet_manager.cc:1434] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
I20260709 12:28:15.204011 22141 tablet_bootstrap.cc:492] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:15.206022 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.206519 22144 tablet_bootstrap.cc:654] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.206789 21924 raft_consensus.cc:2468] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.209482 22142 ts_tablet_manager.cc:1434] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.075s	user 0.011s	sys 0.010s
I20260709 12:28:15.211803 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9b2d46c3af4399b39c04e435e63bfe" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.212491 21924 raft_consensus.cc:3060] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.212591 22142 tablet_bootstrap.cc:492] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:15.210381 21815 leader_election.cc:304] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:15.218438 22144 tablet_bootstrap.cc:492] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:15.219062 22144 ts_tablet_manager.cc:1403] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.020s	user 0.007s	sys 0.011s
I20260709 12:28:15.222143 22144 raft_consensus.cc:359] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.223141 22144 raft_consensus.cc:385] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.223503 22144 raft_consensus.cc:740] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.224136 22147 raft_consensus.cc:2804] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.224705 22147 raft_consensus.cc:493] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.224316 22144 consensus_queue.cc:260] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.224925 22141 tablet_bootstrap.cc:654] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.225056 22147 raft_consensus.cc:3060] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.227260 21924 raft_consensus.cc:2468] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.231629 22142 tablet_bootstrap.cc:654] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.227375 22144 ts_tablet_manager.cc:1434] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:15.234769 22144 tablet_bootstrap.cc:492] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:15.236733 21815 leader_election.cc:304] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:15.237783 22167 raft_consensus.cc:493] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.238283 22167 raft_consensus.cc:515] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.239387 21746 catalog_manager.cc:5697] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.241904 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63746d1aaa410796e738e07e2863ef" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.242650 21997 raft_consensus.cc:2468] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.242898 22144 tablet_bootstrap.cc:654] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.244131 21812 leader_election.cc:304] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:15.245100 22162 raft_consensus.cc:2804] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.245695 22167 leader_election.cc:290] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.246018 22162 raft_consensus.cc:697] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.251088 22165 raft_consensus.cc:2804] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.251590 22165 raft_consensus.cc:493] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.251974 22165 raft_consensus.cc:3060] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.233399 22147 raft_consensus.cc:515] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.255436 21744 catalog_manager.cc:5697] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 0 to 1, leader changed from <none> to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 1 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.257982 22147 leader_election.cc:290] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.261081 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.270236 21997 raft_consensus.cc:3060] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.253350 22162 consensus_queue.cc:237] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.263713 22141 tablet_bootstrap.cc:492] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:15.274351 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.277683 22159 raft_consensus.cc:493] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.279906 21923 raft_consensus.cc:3060] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.279940 22159 raft_consensus.cc:515] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.282775 22159 leader_election.cc:290] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:15.283707 22141 ts_tablet_manager.cc:1403] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.080s	user 0.012s	sys 0.009s
I20260709 12:28:15.284235 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:15.284919 21848 raft_consensus.cc:2468] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 0.
I20260709 12:28:15.286616 21964 leader_election.cc:304] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:15.286450 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.287844 21922 raft_consensus.cc:2468] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 0.
I20260709 12:28:15.288570 22141 raft_consensus.cc:359] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.289342 22141 raft_consensus.cc:385] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.289650 22141 raft_consensus.cc:740] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.289791 22159 raft_consensus.cc:2804] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.290400 22159 raft_consensus.cc:493] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.290853 22159 raft_consensus.cc:3060] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.292896 22144 tablet_bootstrap.cc:492] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:15.295172 22144 ts_tablet_manager.cc:1403] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.061s	user 0.018s	sys 0.020s
I20260709 12:28:15.296586 21923 raft_consensus.cc:2468] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.298061 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63746d1aaa410796e738e07e2863ef" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.298194 21815 leader_election.cc:304] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.299989 22147 raft_consensus.cc:2804] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.300549 22147 raft_consensus.cc:697] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.300213 22144 raft_consensus.cc:359] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.301254 22144 raft_consensus.cc:385] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.300238 22165 raft_consensus.cc:515] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.301522 22147 consensus_queue.cc:237] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.303664 21997 raft_consensus.cc:2468] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.304137 22159 raft_consensus.cc:515] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.308086 22165 leader_election.cc:290] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.305972 21923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63746d1aaa410796e738e07e2863ef" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.299043 22142 tablet_bootstrap.cc:492] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:15.309123 22142 ts_tablet_manager.cc:1403] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.097s	user 0.035s	sys 0.017s
I20260709 12:28:15.306234 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d63746d1aaa410796e738e07e2863ef" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.290424 22141 consensus_queue.cc:260] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.311072 21997 raft_consensus.cc:3060] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.312680 22141 ts_tablet_manager.cc:1434] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.029s	user 0.004s	sys 0.002s
I20260709 12:28:15.313596 21924 raft_consensus.cc:2468] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.313958 22141 tablet_bootstrap.cc:492] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:15.301582 22144 raft_consensus.cc:740] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.317749 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:15.318394 21848 raft_consensus.cc:3060] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.318077 22144 consensus_queue.cc:260] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.322343 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.322945 21924 raft_consensus.cc:3060] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.312600 22142 raft_consensus.cc:359] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.325568 22142 raft_consensus.cc:385] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.325974 22142 raft_consensus.cc:740] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.327184 21997 raft_consensus.cc:2468] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.328578 21812 leader_election.cc:304] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:15.326849 22142 consensus_queue.cc:260] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.329797 22165 raft_consensus.cc:2804] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.330694 22165 raft_consensus.cc:697] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.330896 21848 raft_consensus.cc:2468] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 1.
I20260709 12:28:15.320673 22144 ts_tablet_manager.cc:1434] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:28:15.331593 22165 consensus_queue.cc:237] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.340762 22144 tablet_bootstrap.cc:492] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: Bootstrap starting.
I20260709 12:28:15.332201 22142 ts_tablet_manager.cc:1434] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 12:28:15.343505 22142 tablet_bootstrap.cc:492] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:15.344149 22141 tablet_bootstrap.cc:654] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.346738 22144 tablet_bootstrap.cc:654] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.334300 22159 leader_election.cc:290] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:15.335254 21924 raft_consensus.cc:2468] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 1.
I20260709 12:28:15.350003 21964 leader_election.cc:304] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:15.351812 22159 raft_consensus.cc:2804] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.352435 22159 raft_consensus.cc:697] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Becoming Leader. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:15.352998 22142 tablet_bootstrap.cc:654] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.353250 22159 consensus_queue.cc:237] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.354583 22147 raft_consensus.cc:493] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.355155 22147 raft_consensus.cc:515] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.359280 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.360009 21924 raft_consensus.cc:2468] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.362061 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.363025 21997 raft_consensus.cc:2468] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.365325 21815 leader_election.cc:304] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.367319 22165 raft_consensus.cc:2804] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.367720 22165 raft_consensus.cc:493] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.368074 22165 raft_consensus.cc:3060] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.371439 21744 catalog_manager.cc:5697] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.373483 22147 leader_election.cc:290] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.373749 21744 catalog_manager.cc:5697] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.375603 21744 catalog_manager.cc:5697] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.379710 22141 tablet_bootstrap.cc:492] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:15.380371 22141 ts_tablet_manager.cc:1403] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.009s
I20260709 12:28:15.380254 22165 raft_consensus.cc:515] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.383677 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.384383 21924 raft_consensus.cc:3060] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.387768 22141 raft_consensus.cc:359] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.388540 22141 raft_consensus.cc:385] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.388885 22141 raft_consensus.cc:740] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.397706 22126 raft_consensus.cc:493] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.398356 22126 raft_consensus.cc:515] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.399367 22141 consensus_queue.cc:260] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.400714 22126 leader_election.cc:290] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:15.403606 21922 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9b2d46c3af4399b39c04e435e63bfe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.404451 21922 raft_consensus.cc:2393] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 391c5f190db448bd981ce1e56cc044f1 in current term 1: Already voted for candidate 0bcb11d332554f9eafea151e33814cbf in this term.
I20260709 12:28:15.406744 21924 raft_consensus.cc:2468] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.407943 21815 leader_election.cc:304] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.409081 22147 raft_consensus.cc:2804] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.405419 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fb9b2d46c3af4399b39c04e435e63bfe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0bcb11d332554f9eafea151e33814cbf" is_pre_election: true
I20260709 12:28:15.401870 22141 ts_tablet_manager.cc:1434] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.000s
I20260709 12:28:15.402335 21746 catalog_manager.cc:5697] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3). New cstate: current_term: 1 leader_uuid: "391c5f190db448bd981ce1e56cc044f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:15.411880 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.412614 22141 tablet_bootstrap.cc:492] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: Bootstrap starting.
I20260709 12:28:15.412923 21997 raft_consensus.cc:3060] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.423812 21964 leader_election.cc:304] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1; no voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:15.409798 22147 raft_consensus.cc:697] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.425277 22126 raft_consensus.cc:3060] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.425881 22141 tablet_bootstrap.cc:654] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.426213 22147 consensus_queue.cc:237] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.434893 21997 raft_consensus.cc:2468] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.437044 22165 leader_election.cc:290] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.438792 22126 raft_consensus.cc:2749] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:15.442579 22142 tablet_bootstrap.cc:492] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:15.443192 22142 ts_tablet_manager.cc:1403] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.100s	user 0.026s	sys 0.043s
I20260709 12:28:15.445756 22144 tablet_bootstrap.cc:492] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: No bootstrap required, opened a new log
I20260709 12:28:15.446396 22144 ts_tablet_manager.cc:1403] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: Time spent bootstrapping tablet: real 0.106s	user 0.023s	sys 0.033s
I20260709 12:28:15.446420 22141 tablet_bootstrap.cc:492] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: No bootstrap required, opened a new log
I20260709 12:28:15.446173 22142 raft_consensus.cc:359] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.447129 22142 raft_consensus.cc:385] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.447439 22142 raft_consensus.cc:740] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.447831 22141 ts_tablet_manager.cc:1403] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent bootstrapping tablet: real 0.035s	user 0.011s	sys 0.006s
I20260709 12:28:15.448691 22142 consensus_queue.cc:260] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.449617 22144 raft_consensus.cc:359] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.450357 22144 raft_consensus.cc:385] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.450641 22144 raft_consensus.cc:740] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.451192 22142 ts_tablet_manager.cc:1434] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:15.450954 22141 raft_consensus.cc:359] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.450608 21746 catalog_manager.cc:5697] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.451738 22141 raft_consensus.cc:385] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.452190 22142 tablet_bootstrap.cc:492] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: Bootstrap starting.
I20260709 12:28:15.451804 22144 consensus_queue.cc:260] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.452222 22141 raft_consensus.cc:740] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.454413 22144 ts_tablet_manager.cc:1434] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:15.455528 22141 consensus_queue.cc:260] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.457756 22141 ts_tablet_manager.cc:1434] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:28:15.459267 22142 tablet_bootstrap.cc:654] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:15.474330 22142 tablet_bootstrap.cc:492] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: No bootstrap required, opened a new log
I20260709 12:28:15.474679 22142 ts_tablet_manager.cc:1403] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: Time spent bootstrapping tablet: real 0.023s	user 0.011s	sys 0.005s
I20260709 12:28:15.476640 22142 raft_consensus.cc:359] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.477094 22142 raft_consensus.cc:385] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:15.477267 22142 raft_consensus.cc:740] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Initialized, Role: FOLLOWER
I20260709 12:28:15.477761 22142 consensus_queue.cc:260] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.479270 22142 ts_tablet_manager.cc:1434] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:28:15.537297 22147 raft_consensus.cc:493] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.537768 22147 raft_consensus.cc:515] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.539328 22147 leader_election.cc:290] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.539971 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.540256 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.540587 21924 raft_consensus.cc:2468] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.540921 21997 raft_consensus.cc:2468] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.541615 21815 leader_election.cc:304] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.542393 22147 raft_consensus.cc:2804] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.542776 22147 raft_consensus.cc:493] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.543051 22147 raft_consensus.cc:3060] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.548652 22147 raft_consensus.cc:515] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.550334 22147 leader_election.cc:290] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.551070 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.551321 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.551636 21924 raft_consensus.cc:3060] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.551895 21997 raft_consensus.cc:3060] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.556279 21924 raft_consensus.cc:2468] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.557288 21815 leader_election.cc:304] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.557633 21997 raft_consensus.cc:2468] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.558002 22147 raft_consensus.cc:2804] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.558517 22147 raft_consensus.cc:697] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.559298 22147 consensus_queue.cc:237] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.565822 21745 catalog_manager.cc:5697] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:15.608026 22147 raft_consensus.cc:493] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:15.608440 22147 raft_consensus.cc:515] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.610361 22147 leader_election.cc:290] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.611083 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" is_pre_election: true
I20260709 12:28:15.611438 21997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1" is_pre_election: true
I20260709 12:28:15.611778 21924 raft_consensus.cc:2468] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.612130 21997 raft_consensus.cc:2468] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 0.
I20260709 12:28:15.612815 21815 leader_election.cc:304] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:15.613561 22147 raft_consensus.cc:2804] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:15.613863 22147 raft_consensus.cc:493] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:15.614130 22147 raft_consensus.cc:3060] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.619644 22147 raft_consensus.cc:515] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.621376 22147 leader_election.cc:290] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:15.622200 21924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:15.622752 21924 raft_consensus.cc:3060] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.622532 21996 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:15.623288 21996 raft_consensus.cc:3060] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:15.630831 21996 raft_consensus.cc:2468] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.631206 21924 raft_consensus.cc:2468] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 1.
I20260709 12:28:15.632195 21812 leader_election.cc:304] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:15.633477 22147 raft_consensus.cc:2804] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:15.634091 22147 raft_consensus.cc:697] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:15.635730 22147 consensus_queue.cc:237] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:15.803541 22192 consensus_queue.cc:1048] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:15.813606 22165 consensus_queue.cc:1048] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:15.813932 22162 consensus_queue.cc:1048] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:15.821213 22191 consensus_queue.cc:1048] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:15.837306 22165 consensus_queue.cc:1048] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:15.842526 22126 consensus_queue.cc:1048] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:15.851493 22192 consensus_queue.cc:1048] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:16.005338 22195 log.cc:927] Time spent T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:28:16.020620 21918 raft_consensus.cc:3060] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:16.022917 22126 consensus_queue.cc:1048] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:16.024933 22165 consensus_queue.cc:1048] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.035475 22165 consensus_queue.cc:1048] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.035686 22070 consensus_queue.cc:1048] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.037271 22165 consensus_queue.cc:1048] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:16.017390 22199 log.cc:927] Time spent T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:28:16.048183 22070 consensus_queue.cc:1048] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.099037 21745 catalog_manager.cc:5697] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 0 to 1, leader changed from <none> to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 1 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:16.110244 21795 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:16.129694 22070 consensus_queue.cc:1048] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.133723 22210 consensus_queue.cc:1048] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.144454 22162 consensus_queue.cc:1048] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:16.206462 22070 consensus_queue.cc:1048] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:28:16.293488 22200 consensus_queue.cc:1048] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:16.278328 22194 log.cc:927] Time spent T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:28:16.396525 21994 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20"
dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
mode: GRACEFUL
new_leader_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:33560
I20260709 12:28:16.397228 21994 raft_consensus.cc:606] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Received request to transfer leadership to TS 0bcb11d332554f9eafea151e33814cbf
I20260709 12:28:16.402575 21921 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
mode: GRACEFUL
new_leader_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:56884
I20260709 12:28:16.403041 21921 raft_consensus.cc:606] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Received request to transfer leadership to TS 0bcb11d332554f9eafea151e33814cbf
I20260709 12:28:16.412871 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:28:16.413491 21848 raft_consensus.cc:606] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Received request to transfer leadership to TS a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:16.418231 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:28:16.418735 21848 raft_consensus.cc:606] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Received request to transfer leadership to TS a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:16.423178 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:28:16.423667 21848 raft_consensus.cc:606] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Received request to transfer leadership to TS a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:16.428020 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:28:16.428531 21848 raft_consensus.cc:606] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Received request to transfer leadership to TS a6a950f168eb4846bcacf3fd8ab51e88
I20260709 12:28:16.433189 21848 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:50164
I20260709 12:28:16.433693 21848 raft_consensus.cc:606] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Received request to transfer leadership to TS 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:16.474920 22162 raft_consensus.cc:993] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.475458 22225 raft_consensus.cc:1081] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Signalling peer a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.476814 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:56880
I20260709 12:28:16.477289 21921 raft_consensus.cc:493] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.477561 21921 raft_consensus.cc:3060] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.482600 21921 raft_consensus.cc:515] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.484150 21921 leader_election.cc:290] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:16.484933 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:16.485268 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e1c3400e1de46baa15e3d465f27e571" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:16.485630 21848 raft_consensus.cc:3055] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.485896 21994 raft_consensus.cc:3060] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.485996 21848 raft_consensus.cc:740] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.486907 21848 consensus_queue.cc:260] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.488559 21848 raft_consensus.cc:3060] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.493947 21994 raft_consensus.cc:2468] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.495253 21887 leader_election.cc:304] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:16.495699 21848 raft_consensus.cc:2468] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.496285 22211 raft_consensus.cc:2804] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.496850 22211 raft_consensus.cc:697] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:16.497712 22211 consensus_queue.cc:237] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.503201 22162 raft_consensus.cc:993] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.503701 22225 raft_consensus.cc:1081] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Signalling peer a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.505137 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:56880
I20260709 12:28:16.505731 21921 raft_consensus.cc:493] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.506207 21921 raft_consensus.cc:3060] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.505352 21744 catalog_manager.cc:5697] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 1 to 2, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.513001 21921 raft_consensus.cc:515] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.515686 21921 leader_election.cc:290] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:16.515822 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:16.515913 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "837d17f3e8b84109bf6fd77d06a3bb1f" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:16.516780 21848 raft_consensus.cc:3055] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.516919 21994 raft_consensus.cc:3060] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.517123 21848 raft_consensus.cc:740] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.518013 21848 consensus_queue.cc:260] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.519030 21848 raft_consensus.cc:3060] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.522235 21994 raft_consensus.cc:2468] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.523355 21887 leader_election.cc:304] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:16.524145 22211 raft_consensus.cc:2804] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.524577 22211 raft_consensus.cc:697] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:16.524946 21848 raft_consensus.cc:2468] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.525316 22211 consensus_queue.cc:237] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.531808 21744 catalog_manager.cc:5697] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 1 to 2, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:16.750350 21945 debug-util.cc:398] Leaking SignalData structure 0x7b08000c0e60 after lost signal to thread 11395
W20260709 12:28:16.751343 21945 debug-util.cc:398] Leaking SignalData structure 0x7b080032c280 after lost signal to thread 21781
W20260709 12:28:16.752399 21945 debug-util.cc:398] Leaking SignalData structure 0x7b080010e480 after lost signal to thread 21873
W20260709 12:28:16.753319 21945 debug-util.cc:398] Leaking SignalData structure 0x7b080005d900 after lost signal to thread 21948
W20260709 12:28:16.754280 21945 debug-util.cc:398] Leaking SignalData structure 0x7b08001646e0 after lost signal to thread 22022
W20260709 12:28:16.754763 21945 debug-util.cc:398] Leaking SignalData structure 0x7b0800200280 after lost signal to thread 22167
I20260709 12:28:16.802155 22162 raft_consensus.cc:993] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.802714 22225 raft_consensus.cc:1081] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Signalling peer a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.804436 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:56880
I20260709 12:28:16.804934 21921 raft_consensus.cc:493] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.805243 21921 raft_consensus.cc:3060] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.810962 21921 raft_consensus.cc:515] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.813647 21921 leader_election.cc:290] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:16.816048 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:16.816371 22201 raft_consensus.cc:993] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: : Instructing follower 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:16.816761 21848 raft_consensus.cc:3055] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.816933 22229 raft_consensus.cc:1081] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Signalling peer 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:16.817207 21848 raft_consensus.cc:740] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.818140 21848 consensus_queue.cc:260] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.819410 21848 raft_consensus.cc:3060] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.820881 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:50160
I20260709 12:28:16.821559 21849 raft_consensus.cc:493] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.821905 21849 raft_consensus.cc:3060] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.819998 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "309fc2e847d64c6c91e77fd7220aca03" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:16.825958 21994 raft_consensus.cc:3060] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.830353 21849 raft_consensus.cc:515] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.831943 21994 raft_consensus.cc:2468] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.832715 21849 leader_election.cc:290] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:16.837435 21887 leader_election.cc:304] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:16.833918 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:16.834285 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bcb41e0c54a462faf8457dccaf5bd20" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:16.838184 21921 raft_consensus.cc:3060] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.838284 22211 raft_consensus.cc:2804] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.838613 21995 raft_consensus.cc:3055] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.838852 22211 raft_consensus.cc:697] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:16.839035 21995 raft_consensus.cc:740] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:16.839776 22211 consensus_queue.cc:237] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.840142 21995 consensus_queue.cc:260] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.841650 21995 raft_consensus.cc:3060] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.850582 21848 raft_consensus.cc:2468] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.851679 21921 raft_consensus.cc:2468] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:16.853091 21815 leader_election.cc:304] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:16.854051 22225 raft_consensus.cc:2804] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.853458 21746 catalog_manager.cc:5697] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 1 to 2, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.855333 22225 raft_consensus.cc:697] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.856976 22192 raft_consensus.cc:993] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:16.857455 22192 raft_consensus.cc:1081] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Signalling peer 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:16.858673 21995 raft_consensus.cc:2468] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:16.859197 21994 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33"
dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:33546
I20260709 12:28:16.859790 21994 raft_consensus.cc:493] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.860127 21994 raft_consensus.cc:3060] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.856230 22225 consensus_queue.cc:237] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.867110 21994 raft_consensus.cc:515] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.869040 21994 leader_election.cc:290] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:16.870560 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:16.871150 21848 raft_consensus.cc:3055] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.871454 21848 raft_consensus.cc:740] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.872056 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7c7e01fc30845f19c2ef0931d9e0b33" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:16.871379 21746 catalog_manager.cc:5697] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 1 to 2, leader changed from 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3) to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 2 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.872709 21921 raft_consensus.cc:3060] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.872596 21848 consensus_queue.cc:260] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.873857 21848 raft_consensus.cc:3060] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.883620 21848 raft_consensus.cc:2468] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 2.
I20260709 12:28:16.884677 21921 raft_consensus.cc:2468] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 2.
I20260709 12:28:16.884698 21964 leader_election.cc:304] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:16.885893 22229 raft_consensus.cc:2804] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.886394 22229 raft_consensus.cc:697] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 2 LEADER]: Becoming Leader. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:16.887190 22229 consensus_queue.cc:237] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.889806 22211 raft_consensus.cc:993] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: : Instructing follower 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:16.890305 22211 raft_consensus.cc:1081] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Signalling peer 0bcb11d332554f9eafea151e33814cbf to start an election
I20260709 12:28:16.895682 21849 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
 from {username='slave'} at 127.0.0.1:50152
I20260709 12:28:16.896301 21849 raft_consensus.cc:493] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.896669 21849 raft_consensus.cc:3060] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.897809 21746 catalog_manager.cc:5697] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 reported cstate change: term changed from 1 to 2, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "391c5f190db448bd981ce1e56cc044f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:16.904563 21849 raft_consensus.cc:515] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.907521 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:16.908195 21921 raft_consensus.cc:3055] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.908361 21994 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbc4036faaa84306b29e44414e08b97b" candidate_uuid: "0bcb11d332554f9eafea151e33814cbf" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:16.908604 21921 raft_consensus.cc:740] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:16.909283 21994 raft_consensus.cc:3060] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.910205 21921 consensus_queue.cc:260] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.911577 21921 raft_consensus.cc:3060] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.914565 21849 leader_election.cc:290] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Requested vote from peers a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:16.919385 21921 raft_consensus.cc:2468] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:16.919734 21994 raft_consensus.cc:2468] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0bcb11d332554f9eafea151e33814cbf in term 2.
I20260709 12:28:16.920758 21815 leader_election.cc:304] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:16.921548 22225 raft_consensus.cc:2804] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.922071 22225 raft_consensus.cc:697] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Becoming Leader. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.922919 22225 consensus_queue.cc:237] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.931288 21746 catalog_manager.cc:5697] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf reported cstate change: term changed from 1 to 2, leader changed from a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2) to 0bcb11d332554f9eafea151e33814cbf (127.11.32.1). New cstate: current_term: 2 leader_uuid: "0bcb11d332554f9eafea151e33814cbf" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.938553 21849 raft_consensus.cc:1275] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:16.940493 22224 consensus_queue.cc:1048] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:16.946815 22162 raft_consensus.cc:993] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.947304 22162 raft_consensus.cc:1081] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Signalling peer a6a950f168eb4846bcacf3fd8ab51e88 to start an election
I20260709 12:28:16.948944 21921 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
 from {username='slave'} at 127.0.0.1:56880
I20260709 12:28:16.949664 21921 raft_consensus.cc:493] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:16.950192 21921 raft_consensus.cc:3060] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.959118 21921 raft_consensus.cc:515] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.961700 21994 raft_consensus.cc:1275] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:16.963758 22224 consensus_queue.cc:1048] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:16.967386 21995 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
I20260709 12:28:16.968019 21995 raft_consensus.cc:3060] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.971669 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8713aed51e8b45be8f44b414245f5a20" candidate_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:16.972579 21848 raft_consensus.cc:3055] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:16.972986 21848 raft_consensus.cc:740] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:16.976655 21995 raft_consensus.cc:2468] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:16.978534 21887 leader_election.cc:304] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 391c5f190db448bd981ce1e56cc044f1, a6a950f168eb4846bcacf3fd8ab51e88; no voters: 
I20260709 12:28:16.979539 22224 raft_consensus.cc:2804] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:16.980026 22224 raft_consensus.cc:697] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Becoming Leader. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:16.980958 22224 consensus_queue.cc:237] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.983059 21848 consensus_queue.cc:260] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:16.984807 21848 raft_consensus.cc:3060] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:16.977236 21921 leader_election.cc:290] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3:43817)
I20260709 12:28:16.996897 21746 catalog_manager.cc:5697] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 reported cstate change: term changed from 1 to 2, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2). New cstate: current_term: 2 leader_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:16.999145 21848 raft_consensus.cc:2468] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a6a950f168eb4846bcacf3fd8ab51e88 in term 2.
I20260709 12:28:17.091019 21848 raft_consensus.cc:1275] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.092515 22211 consensus_queue.cc:1048] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.101436 21994 raft_consensus.cc:1275] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.103044 22211 consensus_queue.cc:1048] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.263777 21995 raft_consensus.cc:1275] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.265204 22225 consensus_queue.cc:1048] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.275086 21921 raft_consensus.cc:1275] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.277176 22192 consensus_queue.cc:1048] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.282742 21994 raft_consensus.cc:1275] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.284814 22238 consensus_queue.cc:1048] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.301951 21848 raft_consensus.cc:1275] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.305207 22211 consensus_queue.cc:1048] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.365453 21848 raft_consensus.cc:1275] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.366897 22229 consensus_queue.cc:1048] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.371260 21995 raft_consensus.cc:1275] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.372766 22192 consensus_queue.cc:1048] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.387611 21921 raft_consensus.cc:1275] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.389869 22229 consensus_queue.cc:1048] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.396734 21848 raft_consensus.cc:1275] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.398458 22211 consensus_queue.cc:1048] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.406388 21921 raft_consensus.cc:1275] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 0bcb11d332554f9eafea151e33814cbf: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.410090 22225 consensus_queue.cc:1048] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:17.425382 21995 raft_consensus.cc:1275] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Refusing update from remote peer a6a950f168eb4846bcacf3fd8ab51e88: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:17.427413 22224 consensus_queue.cc:1048] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [LEADER]: Connected to new peer: Peer: permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:19.436837 21746 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:36594:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:28:19.459465 21746 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:36594:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:28:19.484982 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:19.622189 21918 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add"
dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
mode: GRACEFUL
new_leader_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:46738
I20260709 12:28:19.647586 21918 raft_consensus.cc:606] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Received request to transfer leadership to TS 391c5f190db448bd981ce1e56cc044f1
W20260709 12:28:19.777716 21887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43817, user_credentials={real_user=slave}} blocked reactor thread for 80426.2us
I20260709 12:28:19.803892 22305 tablet.cc:1724] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:19.825309 22307 tablet.cc:1724] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:19.858289 22313 tablet.cc:1724] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:19.889884 21887 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.11.32.3:43817, user_credentials={real_user=slave}} blocked reactor thread for 74150.7us
W20260709 12:28:19.892568 22303 log.cc:927] Time spent T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:28:19.920287 22308 tablet.cc:1724] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:19.953542 22315 tablet.cc:1724] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:19.969643 22310 tablet.cc:1724] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:19.991951 22317 raft_consensus.cc:993] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: : Instructing follower 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:19.992623 22317 raft_consensus.cc:1081] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Signalling peer 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:19.990700 21849 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe"
dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
mode: GRACEFUL
new_leader_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:44750
I20260709 12:28:19.993439 21849 raft_consensus.cc:606] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Received request to transfer leadership to TS 391c5f190db448bd981ce1e56cc044f1
I20260709 12:28:19.963964 22318 tablet.cc:1724] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:19.997072 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:19.997736 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:20.001427 22286 raft_consensus.cc:993] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: : Instructing follower 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:20.001678 21998 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add"
dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:33538
I20260709 12:28:20.001965 22286 raft_consensus.cc:1081] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Signalling peer 391c5f190db448bd981ce1e56cc044f1 to start an election
I20260709 12:28:20.002302 21998 raft_consensus.cc:493] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.002722 21998 raft_consensus.cc:3060] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.004034 21997 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe"
dest_uuid: "391c5f190db448bd981ce1e56cc044f1"
 from {username='slave'} at 127.0.0.1:33546
I20260709 12:28:20.004693 21997 raft_consensus.cc:493] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.005043 21997 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:20.010725 22311 log.cc:927] Time spent T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: Append to log took a long time: real 0.136s	user 0.003s	sys 0.000s
W20260709 12:28:20.020084 22316 log.cc:927] Time spent T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: Append to log took a long time: real 0.130s	user 0.001s	sys 0.001s
I20260709 12:28:19.946287 22313 tablet.cc:1724] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.050632 22307 tablet.cc:1724] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.025640 22322 tablet.cc:1724] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.047905 21997 raft_consensus.cc:515] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:20.066430 21849 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:20.067694 21849 raft_consensus.cc:3055] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:20.067899 21849 raft_consensus.cc:740] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0bcb11d332554f9eafea151e33814cbf, State: Running, Role: LEADER
I20260709 12:28:20.070133 21849 consensus_queue.cc:260] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:20.067333 21997 leader_election.cc:290] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 3 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:20.077502 21921 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f712fbaaa60341e289c89879c4a0aebe" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:20.078163 21921 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.078928 21849 raft_consensus.cc:3060] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.080885 22327 tablet.cc:1724] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.081374 22307 tablet.cc:1724] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.083261 22326 tablet.cc:1724] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.062350 22315 tablet.cc:1724] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.090895 22323 tablet.cc:1724] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.057224 21998 raft_consensus.cc:515] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:20.100658 22307 tablet.cc:1724] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.107311 21849 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 3.
I20260709 12:28:20.101307 21921 raft_consensus.cc:2468] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 3.
I20260709 12:28:20.110966 21918 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a6a950f168eb4846bcacf3fd8ab51e88"
I20260709 12:28:20.109644 21998 leader_election.cc:290] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 2 election: Requested vote from peers 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129), a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643)
I20260709 12:28:20.113425 21848 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b6e2c7ac4a2f42e5ae0d1e48a2c65add" candidate_uuid: "391c5f190db448bd981ce1e56cc044f1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0bcb11d332554f9eafea151e33814cbf"
I20260709 12:28:20.125929 21918 raft_consensus.cc:3055] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:20.121513 21964 leader_election.cc:304] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:20.128846 21848 raft_consensus.cc:3060] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.135154 21746 catalog_manager.cc:5789] TS 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129) does not have the latest schema for tablet cbc4036faaa84306b29e44414e08b97b (table soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58]). Expected version 1 got 0
I20260709 12:28:20.127830 21918 raft_consensus.cc:740] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a6a950f168eb4846bcacf3fd8ab51e88, State: Running, Role: LEADER
I20260709 12:28:20.136438 22319 raft_consensus.cc:2804] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:20.120273 22305 tablet.cc:1724] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.139243 22319 raft_consensus.cc:697] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 3 LEADER]: Becoming Leader. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:20.140179 22319 consensus_queue.cc:237] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:20.113893 22308 tablet.cc:1724] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.102259 22310 tablet.cc:1724] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.154676 21918 consensus_queue.cc:260] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:20.157958 21918 raft_consensus.cc:3060] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.114074 22325 tablet.cc:1724] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.166270 22318 tablet.cc:1724] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.174551 22313 tablet.cc:1724] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.181439 21744 catalog_manager.cc:5697] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 reported cstate change: term changed from 2 to 3, leader changed from 0bcb11d332554f9eafea151e33814cbf (127.11.32.1) to 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3). New cstate: current_term: 3 leader_uuid: "391c5f190db448bd981ce1e56cc044f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.195274 22323 tablet.cc:1724] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.212872 22308 tablet.cc:1724] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.188714 22322 tablet.cc:1724] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.205132 22327 tablet.cc:1724] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.226919 22325 tablet.cc:1724] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:20.233193 21848 raft_consensus.cc:2468] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 2.
I20260709 12:28:20.234606 21964 leader_election.cc:304] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0bcb11d332554f9eafea151e33814cbf, 391c5f190db448bd981ce1e56cc044f1; no voters: 
I20260709 12:28:20.235478 22319 raft_consensus.cc:2804] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:20.235988 22319 raft_consensus.cc:697] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 2 LEADER]: Becoming Leader. State: Replica: 391c5f190db448bd981ce1e56cc044f1, State: Running, Role: LEADER
I20260709 12:28:20.236789 22319 consensus_queue.cc:237] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } }
I20260709 12:28:20.213025 21918 raft_consensus.cc:2468] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 391c5f190db448bd981ce1e56cc044f1 in term 2.
I20260709 12:28:20.291639 21744 catalog_manager.cc:5697] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 reported cstate change: term changed from 1 to 2, leader changed from a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2) to 391c5f190db448bd981ce1e56cc044f1 (127.11.32.3). New cstate: current_term: 2 leader_uuid: "391c5f190db448bd981ce1e56cc044f1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "391c5f190db448bd981ce1e56cc044f1" member_type: VOTER last_known_addr { host: "127.11.32.3" port: 43817 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.296049 21745 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc: soft_deleted_table [id=d3aaa7473b7c4a96a9331ee14409fc58] alter complete (version 1)
I20260709 12:28:20.607242 21918 raft_consensus.cc:1275] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 3 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:20.608660 22319 consensus_queue.cc:1048] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:20.623363 21848 raft_consensus.cc:1275] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 3 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:20.627218 22319 consensus_queue.cc:1048] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:20.632508 21918 raft_consensus.cc:1275] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.634479 22319 consensus_queue.cc:1048] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a6a950f168eb4846bcacf3fd8ab51e88" member_type: VOTER last_known_addr { host: "127.11.32.2" port: 44643 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.652531 21848 raft_consensus.cc:1275] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Refusing update from remote peer 391c5f190db448bd981ce1e56cc044f1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.653968 22250 consensus_queue.cc:1048] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0bcb11d332554f9eafea151e33814cbf" member_type: VOTER last_known_addr { host: "127.11.32.1" port: 44129 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.998854 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:21.003898 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:21.004278 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:22.005138 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:22.010921 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:22.011322 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:23.012123 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:23.017098 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:23.017478 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:24.018517 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:24.024240 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:24.024699 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:25.026012 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.032400 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:25.032804 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:26.033890 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:26.038690 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:26.039075 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:27.039894 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:27.044909 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:27.045385 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:28.046672 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:28.052984 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:28.053468 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:29.054486 11392 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:29.060577 11392 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:29.061091 11392 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:30.137346 11392 tablet_server.cc:179] TabletServer@127.11.32.1:0 shutting down...
W20260709 12:28:30.172644 21890 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 14 similar messages]
W20260709 12:28:30.178665 21890 consensus_peers.cc:597] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.180521 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:30.181748 11392 tablet_replica.cc:333] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.183391 11392 raft_consensus.cc:2243] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.184443 11392 raft_consensus.cc:2272] T 309fc2e847d64c6c91e77fd7220aca03 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.188686 11392 tablet_replica.cc:333] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.189567 11392 raft_consensus.cc:2243] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.190119 11392 raft_consensus.cc:2272] T 5e1c3400e1de46baa15e3d465f27e571 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.192866 11392 tablet_replica.cc:333] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.193528 11392 raft_consensus.cc:2243] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.194115 11392 raft_consensus.cc:2272] T 8713aed51e8b45be8f44b414245f5a20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.197247 11392 tablet_replica.cc:333] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.198302 11392 raft_consensus.cc:2243] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.199138 11392 raft_consensus.cc:2272] T a7c7e01fc30845f19c2ef0931d9e0b33 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:30.199287 21890 consensus_peers.cc:597] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.202221 11392 tablet_replica.cc:333] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.203192 11392 raft_consensus.cc:2243] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.204192 11392 raft_consensus.cc:2272] T 6bcb41e0c54a462faf8457dccaf5bd20 P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.207333 11392 tablet_replica.cc:333] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.207957 11392 raft_consensus.cc:2243] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.208827 11392 raft_consensus.cc:2272] T 837d17f3e8b84109bf6fd77d06a3bb1f P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.212284 11392 tablet_replica.cc:333] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.213146 11392 raft_consensus.cc:2243] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.213876 11392 raft_consensus.cc:2272] T 20c9d57544fa4577989a8f7969fc6f6b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.217895 11392 tablet_replica.cc:333] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.218776 11392 raft_consensus.cc:2243] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:30.219473 21890 consensus_peers.cc:597] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.219970 11392 raft_consensus.cc:2272] T fb9b2d46c3af4399b39c04e435e63bfe P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.223196 11392 tablet_replica.cc:333] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.223948 11392 raft_consensus.cc:2243] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.224576 11392 raft_consensus.cc:2272] T 259a2c4182f6430abe26383bb59ab3ba P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:30.226037 21964 consensus_peers.cc:597] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.227531 11392 tablet_replica.cc:333] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.228286 11392 raft_consensus.cc:2243] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.229547 11392 raft_consensus.cc:2272] T 3d63746d1aaa410796e738e07e2863ef P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:30.231814 21890 consensus_peers.cc:597] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.232622 11392 tablet_replica.cc:333] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.233335 11392 raft_consensus.cc:2243] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.233867 11392 raft_consensus.cc:2272] T 29eefb0340e843319123ba8f60a9cfd5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.236369 11392 tablet_replica.cc:333] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.236992 11392 raft_consensus.cc:2243] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.237959 11392 raft_consensus.cc:2272] T cbc4036faaa84306b29e44414e08b97b P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.241184 11392 tablet_replica.cc:333] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.241930 11392 raft_consensus.cc:2243] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.243033 11392 raft_consensus.cc:2272] T f34adaccdb2540ac81183b33de02f27a P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.246120 11392 tablet_replica.cc:333] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.246811 11392 raft_consensus.cc:2243] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.247678 11392 raft_consensus.cc:2272] T ba643b47e920428ca786ced660a6a5d5 P 0bcb11d332554f9eafea151e33814cbf [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.250597 11392 tablet_replica.cc:333] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.251212 11392 raft_consensus.cc:2243] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.251737 11392 raft_consensus.cc:2272] T f712fbaaa60341e289c89879c4a0aebe P 0bcb11d332554f9eafea151e33814cbf [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.254299 11392 tablet_replica.cc:333] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.255079 11392 raft_consensus.cc:2243] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.256363 11392 raft_consensus.cc:2272] T ce3ca40bfb7d44a28290f87cdf749fdf P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.259644 11392 tablet_replica.cc:333] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
W20260709 12:28:30.259717 21964 consensus_peers.cc:597] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.260319 11392 raft_consensus.cc:2243] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.260924 11392 raft_consensus.cc:2272] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.263517 11392 tablet_replica.cc:333] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf: stopping tablet replica
I20260709 12:28:30.264057 11392 raft_consensus.cc:2243] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.264523 11392 raft_consensus.cc:2272] T a653a791ef9f43329be55e94cfa5e4bc P 0bcb11d332554f9eafea151e33814cbf [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.311713 11392 tablet_server.cc:196] TabletServer@127.11.32.1:0 shutdown complete.
W20260709 12:28:30.338498 21964 consensus_peers.cc:597] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.356519 11392 tablet_server.cc:179] TabletServer@127.11.32.2:0 shutting down...
I20260709 12:28:30.391629 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:30.392691 11392 tablet_replica.cc:333] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.393857 11392 raft_consensus.cc:2243] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.395229 11392 raft_consensus.cc:2272] T 309fc2e847d64c6c91e77fd7220aca03 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.399585 11392 tablet_replica.cc:333] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
W20260709 12:28:30.400473 21964 consensus_peers.cc:597] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 -> Peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Couldn't send request to peer a6a950f168eb4846bcacf3fd8ab51e88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.400535 11392 raft_consensus.cc:2243] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.402016 11392 raft_consensus.cc:2272] T 5e1c3400e1de46baa15e3d465f27e571 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.405483 11392 tablet_replica.cc:333] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.406352 11392 raft_consensus.cc:2243] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.407641 11392 raft_consensus.cc:2272] T 8713aed51e8b45be8f44b414245f5a20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.411031 11392 tablet_replica.cc:333] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.411953 11392 raft_consensus.cc:2243] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.412726 11392 raft_consensus.cc:2272] T a7c7e01fc30845f19c2ef0931d9e0b33 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.415685 11392 tablet_replica.cc:333] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.416517 11392 raft_consensus.cc:2243] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.417632 11392 raft_consensus.cc:2272] T 837d17f3e8b84109bf6fd77d06a3bb1f P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.420707 11392 tablet_replica.cc:333] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.421279 11392 raft_consensus.cc:2243] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:30.421460 21890 consensus_peers.cc:597] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.421970 11392 raft_consensus.cc:2272] T 6bcb41e0c54a462faf8457dccaf5bd20 P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.424625 11392 tablet_replica.cc:333] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.425230 11392 raft_consensus.cc:2243] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.425746 11392 raft_consensus.cc:2272] T 3d63746d1aaa410796e738e07e2863ef P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.428088 11392 tablet_replica.cc:333] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.428701 11392 raft_consensus.cc:2243] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.429701 11392 raft_consensus.cc:2272] T 29eefb0340e843319123ba8f60a9cfd5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.432147 11392 tablet_replica.cc:333] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.432852 11392 raft_consensus.cc:2243] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.433518 11392 raft_consensus.cc:2272] T cbc4036faaa84306b29e44414e08b97b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.435899 11392 tablet_replica.cc:333] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.436586 11392 raft_consensus.cc:2243] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.437106 11392 raft_consensus.cc:2272] T f34adaccdb2540ac81183b33de02f27a P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.439568 11392 tablet_replica.cc:333] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.440371 11392 raft_consensus.cc:2243] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.441000 11392 raft_consensus.cc:2272] T ce3ca40bfb7d44a28290f87cdf749fdf P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.444113 11392 tablet_replica.cc:333] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
W20260709 12:28:30.444633 21964 consensus_peers.cc:597] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 -> Peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Couldn't send request to peer a6a950f168eb4846bcacf3fd8ab51e88. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.444847 11392 raft_consensus.cc:2243] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.445569 11392 raft_consensus.cc:2272] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.447950 11392 tablet_replica.cc:333] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.448594 11392 raft_consensus.cc:2243] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.449136 11392 raft_consensus.cc:2272] T a653a791ef9f43329be55e94cfa5e4bc P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.451542 11392 tablet_replica.cc:333] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.452162 11392 raft_consensus.cc:2243] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.452632 11392 raft_consensus.cc:2272] T ba643b47e920428ca786ced660a6a5d5 P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.455886 11392 tablet_replica.cc:333] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.456810 11392 raft_consensus.cc:2243] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.457365 11392 raft_consensus.cc:2272] T f712fbaaa60341e289c89879c4a0aebe P a6a950f168eb4846bcacf3fd8ab51e88 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.459738 11392 tablet_replica.cc:333] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.460325 11392 raft_consensus.cc:2243] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.461663 11392 raft_consensus.cc:2272] T 259a2c4182f6430abe26383bb59ab3ba P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.463913 11392 tablet_replica.cc:333] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.464450 11392 raft_consensus.cc:2243] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.464993 11392 raft_consensus.cc:2272] T fb9b2d46c3af4399b39c04e435e63bfe P a6a950f168eb4846bcacf3fd8ab51e88 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.468171 11392 tablet_replica.cc:333] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88: stopping tablet replica
I20260709 12:28:30.468717 11392 raft_consensus.cc:2243] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.469955 11392 raft_consensus.cc:2272] T 20c9d57544fa4577989a8f7969fc6f6b P a6a950f168eb4846bcacf3fd8ab51e88 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:30.470664 21964 consensus_peers.cc:597] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 -> Peer 0bcb11d332554f9eafea151e33814cbf (127.11.32.1:44129): Couldn't send request to peer 0bcb11d332554f9eafea151e33814cbf. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.1:44129: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.535156 11392 tablet_server.cc:196] TabletServer@127.11.32.2:0 shutdown complete.
I20260709 12:28:30.576014 11392 tablet_server.cc:179] TabletServer@127.11.32.3:0 shutting down...
W20260709 12:28:30.609736 21964 consensus_peers.cc:597] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 -> Peer a6a950f168eb4846bcacf3fd8ab51e88 (127.11.32.2:44643): Couldn't send request to peer a6a950f168eb4846bcacf3fd8ab51e88. Status: Network error: Client connection negotiation failed: client connection to 127.11.32.2:44643: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:30.615097 11392 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:30.616163 11392 tablet_replica.cc:333] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.617375 11392 raft_consensus.cc:2243] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.618286 11392 raft_consensus.cc:2272] T 309fc2e847d64c6c91e77fd7220aca03 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.621565 11392 tablet_replica.cc:333] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.622191 11392 raft_consensus.cc:2243] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.622695 11392 raft_consensus.cc:2272] T 8713aed51e8b45be8f44b414245f5a20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.624936 11392 tablet_replica.cc:333] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.625547 11392 raft_consensus.cc:2243] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.626026 11392 raft_consensus.cc:2272] T 5e1c3400e1de46baa15e3d465f27e571 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.628201 11392 tablet_replica.cc:333] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.628772 11392 raft_consensus.cc:2243] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.629643 11392 raft_consensus.cc:2272] T a7c7e01fc30845f19c2ef0931d9e0b33 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.631814 11392 tablet_replica.cc:333] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.632370 11392 raft_consensus.cc:2243] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.632862 11392 raft_consensus.cc:2272] T 837d17f3e8b84109bf6fd77d06a3bb1f P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.635006 11392 tablet_replica.cc:333] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.635555 11392 raft_consensus.cc:2243] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.636018 11392 raft_consensus.cc:2272] T 6bcb41e0c54a462faf8457dccaf5bd20 P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.638105 11392 tablet_replica.cc:333] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.638631 11392 raft_consensus.cc:2243] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.639109 11392 raft_consensus.cc:2272] T 3d63746d1aaa410796e738e07e2863ef P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.641113 11392 tablet_replica.cc:333] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.641732 11392 raft_consensus.cc:2243] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.642174 11392 raft_consensus.cc:2272] T 29eefb0340e843319123ba8f60a9cfd5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.644132 11392 tablet_replica.cc:333] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.644670 11392 raft_consensus.cc:2243] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.645150 11392 raft_consensus.cc:2272] T fb9b2d46c3af4399b39c04e435e63bfe P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.647182 11392 tablet_replica.cc:333] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.647708 11392 raft_consensus.cc:2243] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.648156 11392 raft_consensus.cc:2272] T 20c9d57544fa4577989a8f7969fc6f6b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.650202 11392 tablet_replica.cc:333] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.650728 11392 raft_consensus.cc:2243] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.651206 11392 raft_consensus.cc:2272] T cbc4036faaa84306b29e44414e08b97b P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.653704 11392 tablet_replica.cc:333] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.654466 11392 raft_consensus.cc:2243] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.655066 11392 raft_consensus.cc:2272] T f34adaccdb2540ac81183b33de02f27a P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.657907 11392 tablet_replica.cc:333] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.658389 11392 raft_consensus.cc:2243] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.658782 11392 raft_consensus.cc:2272] T 259a2c4182f6430abe26383bb59ab3ba P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.660725 11392 tablet_replica.cc:333] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.661155 11392 raft_consensus.cc:2243] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.661931 11392 raft_consensus.cc:2272] T f712fbaaa60341e289c89879c4a0aebe P 391c5f190db448bd981ce1e56cc044f1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.663980 11392 tablet_replica.cc:333] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.664463 11392 raft_consensus.cc:2243] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.664798 11392 raft_consensus.cc:2272] T ba643b47e920428ca786ced660a6a5d5 P 391c5f190db448bd981ce1e56cc044f1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.666795 11392 tablet_replica.cc:333] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.667250 11392 raft_consensus.cc:2243] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.668038 11392 raft_consensus.cc:2272] T b6e2c7ac4a2f42e5ae0d1e48a2c65add P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.670055 11392 tablet_replica.cc:333] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.670516 11392 raft_consensus.cc:2243] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:30.670913 11392 raft_consensus.cc:2272] T ce3ca40bfb7d44a28290f87cdf749fdf P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.672819 11392 tablet_replica.cc:333] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1: stopping tablet replica
I20260709 12:28:30.673228 11392 raft_consensus.cc:2243] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.673998 11392 raft_consensus.cc:2272] T a653a791ef9f43329be55e94cfa5e4bc P 391c5f190db448bd981ce1e56cc044f1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.716526 11392 tablet_server.cc:196] TabletServer@127.11.32.3:0 shutdown complete.
I20260709 12:28:30.752866 11392 master.cc:562] Master@127.11.32.62:36379 shutting down...
I20260709 12:28:30.776672 11392 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:30.777344 11392 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:30.777805 11392 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5af41c5de0db473da5c81aa52c26bddc: stopping tablet replica
I20260709 12:28:30.798929 11392 master.cc:584] Master@127.11.32.62:36379 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (21185 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (44821 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (364234 ms total)
[  PASSED  ] 8 tests.
I20260709 12:28:30.855829 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2229 messages since previous log ~34 seconds ago
I20260709 12:28:30.856104 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2227 messages since previous log ~34 seconds ago
I20260709 12:28:30.856302 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2225 messages since previous log ~34 seconds ago
I20260709 12:28:30.856527 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:28:30.856730 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~53 seconds ago
I20260709 12:28:30.856949 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 1 messages since previous log ~151 seconds ago
I20260709 12:28:30.857234 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 13 messages since previous log ~0 seconds ago
I20260709 12:28:30.857575 11392 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~20 seconds ago
